Skip to content

It is a llm application having customizable RAG LLM facility as well as Generic Q/A LLM.

License

Notifications You must be signed in to change notification settings

RANA-ATI/All-in-one-LLM-Application

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

All in one LLM

This is a LLM based application. It has LLama-v2 LLM used. One can utilize one of the two facilities.

  • Simple LLM : You can ask questions, and the application will provide relevant answers based on the information it has.
  • Customzied RAG : RAG is a technique that combines information retrieval with language generation, allowing for more precise and informative responses to user queries. One has to upload pdf files to utilize its power and just query through to have results from those PDFs

Setup

  1. Clone the repository to your local machine:
git clone <repository_url>
  1. Install the required dependencies using pip:
pip install -r requirements.txt
  1. Replace <your_replicate_api_token> in the customizable_llm_rag.py and simple_llm.py files with your actual Replicate API token.

Usage

Once you've completed the setup, you can start the application by running:

python app.py

This will start the Flask server, and you can access the application via your web browser at http://localhost:5000.

License

This project is licensed under the MIT License.

About

It is a llm application having customizable RAG LLM facility as well as Generic Q/A LLM.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published