Founder, infrastructure
Trillionir AI
A flat-rate LLM inference API with OpenAI and Anthropic compatible routing.
- Shipped a flat-rate LLM inference API with OpenAI and Anthropic compatible routing, so clients swap in with zero code changes.
- Built a model evaluation pipeline with openbench against a custom OpenAI-compatible proxy, benchmarking models including Gemma 4 31B, Rnj-1 8B, Devstral 24B, and SmolLM 135M.
- Debugged HuggingFace dataset namespace issues and Ubuntu 24.04 environment problems to get the pipeline running end to end.