diff --git a/README.md b/README.md index 1cfdfc8..cf8cfcf 100644 --- a/README.md +++ b/README.md @@ -42,6 +42,53 @@ + + +## Quick Start + +- LLaVA-v1.5 + +1. Install LLaVA. + +```shell +git clone https://github.com/haotian-liu/LLaVA.git +cd LLaVA +pip install -e ".[train]" +``` + +2. Automatically download the pre-trained weights from Q-Instruct. + +```python +from llava.mm_utils import get_model_name_from_path +from llava.eval.run_llava import eval_model + +# default LLaVA-v1.5 (7B) +# change to `model_path = "teowu/llava_v1.5_13b_qinstruct_preview_v0.1"` for LLaVA-v1.5 (13B) +model_path = "teowu/llava_v1.5_7b_qinstruct_preview_v0.1" + +prompt = "Which is the darkest corner of the image?" +image_file = "fig/sausage.jpg" + +args = type('Args', (), { + "model_path": model_path, + "model_base": None, + "model_name": get_model_name_from_path(model_path), + "query": prompt, + "conv_mode": None, + "image_file": image_file, + "sep": ",", +})() + +eval_model(args) +``` + +- mPLUG-Owl-2 + +Coming soon. + +- InternLM-XComposer-VL + +Coming soon. ## Model Zoo diff --git a/fig/sausage.jpg b/fig/sausage.jpg new file mode 100644 index 0000000..4dc3ce2 Binary files /dev/null and b/fig/sausage.jpg differ