Date: Jul 2024 - Present
Roles: AI Engineer, Data Scientist, Project Manager
This project was completed while I was a consultant at Melio AI, and some of the project details have been obfuscated.
Overview
Led the design, implementation, monitoring, evaluation and project management of a of an agentic RAG chatbot system. The chatbot successfully handled user queries, saving human resources and improving operational efficiency. The entire system infrastructure was captured as code to enable repeatable deployments.
My Responsibilities
- Managed a team of 3 developers
- Engaged with clients to determine requirements.
- Designed the system architecture, tools, and evaluation methods.
- Automated adversarial (red team) testing for abuse prevention.
Outcomes/Impact
- Delivered a minimum viable product (MVP) chatbot that handles simple queries and escalates unresolved issues to humans, saving time and resources.
Tools Used
- Python
- AWS
- AWS Bedrock
- AWS Bedrock Agents
- AWS Lambda
- AWS API Gateway
- AWS CDK
- LangChain
- LangServe
- Langfuse
- Anthropic Claude
- HuggingFace
- FAISS
- Gradio