Talk to Wikipedia offline using llama.cpp models and semantic search over the index of the whole English Wikipedia (44 million paragraphs).
System requirements: 16 GB or RAM, Mac or Linux.
bash setup.sh
python chat.py
The Chat UI will be available at http://127.0.0.1:8081
Wiki page viewer: http://127.0.0.1:8082
Raw LLM UI: http://127.0.0.1:8080