AI Agent Engineer, Onlinx Solutions
Jul 2024 to Present
- Built a spend guard in front of LLM APIs that caps tokens and budget per request. A capped request returned 64 output tokens instead of 2,618.
- Packaged it as a Docker Compose stack and wrote a Helm chart for Kubernetes. A rolling restart of 6 pods had 0 failed requests out of 287,403.
- Built a voice agent on Pipecat and LiveKit that handles several calls at the same time, and ran apps on AWS with load balancers, CloudFront, IAM and cost management.