Aleph Alpha, a German AI startup, has launched Pharia-1-LLM-7 billion-control and Pharia-1-LLM-7 billion-control-aligned LLMs to provide concise, length-controlled responses in European languages.
The models use "grouped-query attention" for improved inference speed and "rotary position embeddings" to better understand word positions in sentences. Moreover, both the models have 7 billion parameters.
The company has open-sourced its training codebase "Scaling" under the same license, allowing researchers to examine and potentially improve the training process. The company also claims that its approach aligns with EU regulations.
Based in Germany, Aleph Alpha specializes in developing GenAI solutions that are secure and transparent for enterprises and governments. The company's flagship product, Luminous, is an LLM that can communicate in multiple languages, including German, French, Spanish, Italian, and English.
By using this site, you agree to allow SPEEDA Edge and our partners to use cookies for analytics and personalization. Visit our privacy policy for more information about our data collection practices.