Date: Jul 2024 - Present
Roles: AI Engineer, Data Scientist, Project Manager
This project was completed while I was a consultant at Melio AI, and some of the project details have been obfuscated.
Overview
Led the design, implementation, monitoring, evaluation and project management of a of an agentic RAG chatbot system. The chatbot successfully handled user queries, saving human resources and improving operational efficiency.
My Responsibilities
- Managed a team of 3 developers and engaged with clients to determine requirements.
- Designed the system architecture, tools, and evaluation methods.
- Automated adversarial (red team) testing for abuse prevention.
Outcomes/Impact
- Delivered a minimum viable product (MVP) chatbot that handles simple queries and escalates unresolved issues to humans, saving time and resources.
Tools Used
- Python
- AWS
- AWS Bedrock
- AWS Bedrock Agents
- AWS Lambda
- LangChain
- LangServe
- Langfuse
- Anthropic Claude
- HuggingFace
- FAISS
- Gradio
- Terraform