Krrish Dholakia

Krrish Dholakia is co-founder of LiteLLM, the open-source library and gateway for calling many language model APIs in one format. He built it with Ishaan Jaffer at BerriAI, which went through Y Combinator in winter 2023.

A Hundred Lines of If/Else at BerriAI

The library grew out of BerriAI's own "chat-with-your-data" application, he wrote on HackerNoon. When the team added Azure and Cohere and wrote fallbacks for failed calls, provider-specific code turned into "multiple ~100 line if/else statements," and debugging problems exploded.

So they hid the calls behind a single class with consistent inputs, outputs and exceptions. That became LiteLLM, a simple package for calling Azure, Anthropic, OpenAI, Cohere and Replicate the same way.