Sign In

MedText-llama-2-70b-Guanaco-QLoRA-fp16 (Medical Knowledge LLM LoRA)

33

235

4

Updated: Oct 5, 2024

toolinformation

Type

LoRA

Stats

235

0

Reviews

Published

Jul 29, 2023

Base Model

Other

Training

Steps: 1,323
Epochs: 3

Training Images

Download

Hash

AutoV2
BB93A56C27

This is a LoRA for the Llama-2-70b-Guanaco LLM. This is not a LoRA for Stable Diffusion.

This is a Medical Knowledge LoRA made for use with this model: llama-2-70b-Guanaco-QLoRA-fp16 https://huggingface.co/TheBloke/llama-2-70b-Guanaco-QLoRA-fp16) (you can use the quantized version of the model too).

I'm experimenting with making LLM LoRAs and thought this one tuned out good enough to share. Use at your own risk however, I am not a medical expert and do not take responsibility for the model producing incorrect information.

This LoRA was made using Oobabooga (https://github.com/oobabooga/text-generation-webui) and these training data: https://huggingface.co/datasets/BI55/MedText

I'll be working on various versions of this LoRA (and other types of LoRAs) as I explore the various ways in which to construct these add-on models.

The Hugging Face page for all this is here:
https://huggingface.co/AARon99/MedText-llama-2-70b-Guanaco-QLoRA-fp16

If you too are curious on how to construct these LLM based LoRAs, the Hugging Face page has additional information intended to help beginners, like myself.