# Models
Place .gguf model files in this directory.

The filename must match the LLAMA_MODEL value in .env.
For example, if LLAMA_MODEL=llama3.1-8b-instruct.Q4_K_M.gguf,
place that file here.

Download from HuggingFace:
  https://huggingface.co/models?search=gguf