Credal AI

Founded in 2022, Credal is a startup that gives enterprises a way to connect their internal data to text-generating, cloud-hosted AI models. 

The Developer RAG platform of Credal can be used to build general knowledge or domain-specific, AI-powered chatbots for a range of use cases. Credal sits between users, submitting prompts and an API from a third-party LLM provider like OpenAI or Anthropic and acting as a “co-pilot” that can be deployed in existing apps like Slack. 

The platform has the ability to automatically direct prompts to the “most appropriate” LLM if a company is using more than one, based on factors like the sensitivity of the data being submitted, cost, company policy, and a model’s technical capabilities. It sometimes employs more than one LLM to accomplish tasks, such as using Anthropic’s Claude and GPT-4 to structure company documents. 

The Enterprise LLM Gateway product enables users to automatically redact, anonymize, or otherwise warn the user when sensitive data is about to be sent off-network, such as to an LLM hosted on a public cloud. Furthermore, it provides logs that show data sharing between LLMs. 

It is claimed that Credal is one of the few vendors of its kind to be registered under the Data Privacy Framework, the recent US-EU agreement that governs the transfer of personal data between the two countries. 

Key customers and partnerships

As of October 2023, the company had 11 customers and claimed that several of them have signed “six-figure” contracts. Since its launch in 2022, Credal handled over a quarter of a million LLM calls and around 100,000 corporate documents.