top of page
AI QA Bot v2.0
Python
How might we use the LLAMA-2 to create a chat bot that answers questions based on a provided set of PDFs?
Project Overview
Created and optimized a Python application that calls a Milvus databse of vectorized PDFs and uses a quantized version of LLAMA-2-7b-chat to answer topical questions related to the PDFs supplied.
Outcome
This project opened my eyes to the power of local compute and just how far open source frameworks can take you. Additionally, it displayed to me the power of using customized datasets within an LLM.
Methods and tools used
If you would like to learn more about the methods used on this project,
bottom of page