Martian

Martian claims to be the world’s first LLM router developer. Its platform allows enterprises to utilize the best-performing LLM based on their request type, helping to reduce GenAI usage costs. The system is built on Martian's proprietary “Model Mapping” technology, which transforms complex LLMs into more interpretable architectures, marking the first commercial application of mechanistic interpretability. The company claims its platform allows enterprises to achieve higher performance and lower costs than OpenAI’s GPT-4.

Martian also offers a “Model Gateway” solution to benchmark LLM performance using its router.

The company generates revenue via access to its API, charging USD 20 per 5,000 requests sent to it. The company also offers a custom pricing scheme for enterprises seeking to deploy their models on a virtual private cloud (VPC) or build a specialized router for specific tasks.

Key customers and partnerships

As of September 2024, Martian was used by 300+ engineers across companies such as OpenAI, Amazon, and Zapier.

Martian also partnered with Accenture to integrate its dynamic routing capabilities with Accenture's switchboard services, enhancing AI systems for clients (September 2024).

Competitors: None under coverage. (Martian claims to offer the world’s first LLM router to optimize model performance and cost.)