OctoAI

OctoML provides a platform that helps enterprises optimize and deploy trained ML models to any hardware. The company also transforms ML models into portable software functions and provides a service that automatically detects and resolves dependencies to optimize ML model code.

The latest iteration of its platform is called OctoAI . It is a self-optimizing infrastructure service designed to assist companies in building and deploying AI applications, with a particular emphasis on generative AI applications. OctoAI is a managed computing service that supports businesses in utilizing pre-existing open-source models and refining them using their own data to host personalized models. Users can easily prioritize their preferences, such as latency or cost, and OctoAI will automatically determine the appropriate hardware for their needs. Furthermore, it provides access to a library of popular open-source large language models (LLMs), such as Stable Diffusion 2.1, Dolly v2, LLaMA 65B, Whisper, FlanUL, and Vicuna, which developers can use to build their AI applications.

As of June 2022, the company had an employee headcount of more than 140.

Key customers and partnerships

OctoML serves Global 100 companies such as Toyota, Sony, Google, Microsoft, Facebook, and Intel.

Funding and financials

In November 2021, the company raised USD 85 million in a Series C funding round led by Tiger Global Management. The funds were utilized to build out its partner ecosystem and expand its team across engineering and sales functions.