Matrix is an early-stage venture capital firm, investing from idea through Series A. As a close-knit team of former founders and company builders, Matrix has partnered with companies from Apple and FedEx to Oculus and Canva.  Other Matrix investments include Fivetran, Suno, Side, Afterpay, CTRL-Labs, Oculus, Zendesk, Hubspot, Apollo GraphQL, Flock Safety, GOAT, Postmates, Acacia Communications, and Sila.

Matrix

Amplify Partners invests in technical founders solving technical problems for the enterprise. They invest in early-stage companies pioneering novel applications in machine intelligence and computer science.

Amplify Partners

South Park Commons is a community of technologists and builders dedicated to helping each other explore, learn, and figure out what's next—or as we call it, go from -1 to 0. We believe great ideas very rarely come about in isolation. The SPC Fund invests in companies that emerge from our members' explorations, ensuring the community's longevity and supporting the next stage of our founders' journeys.

South Park Commons

Context Ventures is an advisory and project management firm that specializes in helping municipalities, nonprofit organizations, corporate and community-based philanthropies and developers initiate, cultivate, and implement sustainable projects and programs that support cities and their communities.

Context Ventures

General Catalyst is a venture capital firm that provides early-stage and growth equity investments. The company provides ongoing momentum that accelerates ideas, careers, and companies toward standout success.

General Catalyst

NVIDIA is a computing platform company, innovating at the intersection of graphics, HPC, and AI. The company specializes in the manufacture of graphics-processor technologies for workstations, desktop computers, and mobile devices. The company is a major supplier of integrated circuits used for personal computer motherboard chipsets, graphics processing units (GPUs), and game consoles.

NVIDIA

Andreessen Horowitz is a venture capital firm specializing in investing in seed, start-ups, early, mid-stage, growth, and late-stage. It prefers to invest in the social media business and technology sector with a focus on software, back-end infrastructure, the infrastructure of the Internet, cloud computing, enterprise software and services, consumer, business Internet, mobile-Internet, consumer Internet, cloud computing, data storage, social network browsers data-storage, consumer electronics, networking functions, software related biology, biotech, and medicine companies at the intersection of computer science and life sciences with a focus on digital therapeutics, cloud technology in biology, and computational medicine.

Andreessen Horowitz

Luma AI

Luma AI is a generative AI startup that enables users to transform text descriptions into corresponding 3D models. Luma AI aims to empower individuals to effortlessly capture and immerse themselves in a realistic 3D representation of the world. The mission is to catalyze a significant advancement in how we share memories, explore products, and navigate online spaces. The goal is to propel photos and videos into the realm of mixed-reality, shaping the way we experience a three-dimensional future.

Luma AI is developing AI-powered technology that allows the creation of photorealistic 3D models of real-life objects from photographs or video footage. This enables fast and cheap creation of models for gaming, VR, ecommerce, and other applications.

Exploring the limitless possibilities of AI

Generative AI Applications

Luma AI is a San Francisco-based startup developing AI-powered technology that allows the creation of photorealistic 3D models of real-life objects from photographs or video footage. This enables fast and cheap creation of models for gaming, VR, ecommerce, and other applications.

Foundation Models

Luma AI debuts Dream Machine 1.6 video generator with camera motions

Luma AI is developing AI-powered technology that allows the creation of photorealistic 3D models of real-life objects from photographs or video footage. This enables fast and cheap creation of models for gaming, VR, ecommerce, and other applications.The company’s flagship product is an iOS application that scans objects to generate 3D models. Luma also offers its technology to developers via an API, enabling integration into products and services.In <a href="https://sp-edge.com/updates/32794">August 2024</a>, Luma AI launched Dream Machine 1.5, an upgraded version of its AI-powered text-to-video model. Dream Machine 1.5 introduces enhanced realism, improved motion tracking, and more intuitive prompt understanding. It also features the ability to render text within generated videos, better handling of non-English prompts, and faster video generation, producing five seconds of high-quality video in approximately two minutes. In<a href="https://sp-edge.com/updates/33672"> September 2024</a>, the company launched an application programming interface (API) for Dream Machine to allow users to build applications and services utilizing Dream Machine outside the Luma AI website.Luma leverages generative AI and neural radiance fields (NeRF) technology, a specialized neural network trained to build a complete scene using photos taken from multiple angles to generate its 3D models.In January 2024, the company was valued between USD 200 million and USD 300 million.

DeckRobot is a platform compatible with Microsoft PowerPoint that leverages AI to transform raw slides into enterprise-ready presentations. DeckRobot AI transforms draft slides into professional, on-brand slides by adapting graphics from a vast library of slide examples. Users can apply an unlimited number of styles to any slide deck, including old documents, client materials, or web-sourced slides.DeckRobot offers enhancements for individual slides, such as adding approved icons and images, object alignment, slide resizing, and text validation through AI checks. DeckRobot's plugin acts as a time-saving tool for PowerPoint users, reducing manual work and potentially saving up to 80% of working time. The plugin emphasizes creating visually appealing presentations that adhere to company brand guidelines while maintaining content quality.Key customers and partnershipsAs of April 2024, the company reportedly worked with 70% of the largest consulting and audit companies.

DeckRobot

Based in Italy, Contents.com is a generative AI-powered multimedia creation tool directed at marketing teams, bloggers, publishers, web agencies, ecommerce sites, and large corporations looking to scale content output. The company operates as a SaaS platform that provides tools to support the entire content creation workflow, combining AI-generated output with manual finishing. Contents.com’s features include:1) Industry trends: Uses AI to provide an overview of popular content trends during a specified time period2) AI Chat: A natural language chatbot that can answer questions on any topic or be used to generate content ideas3) AI Writer: Generates content based on a selected template, including blog posts, social media posts, product descriptions, marketing emails, search engine optimized content, and summarized and rephrased content4) AI Art: Generates images based on text inputs, a selected style, and destination content type5) Text to Audio: Converts text documents into audio, with several AI voices available for selection and generates text transcripts from audio input6) AI Translation: Translates content into 25+ languages (January 2024) and offers human translation7) Professional writing services: Completion and review of AI-generated content or fully outsourced content creation by human writersContents.com also offers a customizable enterprise solution, enabling large organizations to automate their content creation processes.The firm claims that its solution can generate content 10x faster.In April 2023, Contents.com acquired Scribeur, its main French competitor, expanding its customer base to include major French and European brands. In the same month, the firm also acquired translation company Traduzione.it. In addition, in May 2023, the company acquired Scribox, an Italian content marketing marketplace, to leverage Scribox's expertise in custom content creation, SEO, and social media marketing.Key customers and partnershipsAs of May 2023, Contents.com’s users included Allianz, Billboard, IKEA, Oppo, and Accenture.

Contents.com

Estonia-based Alpha3D utilizes GenAI technologies to allow users to automatically convert text prompts or 2D images of real-world objects into interactive 3D digital assets. The platform aims at simplifying the 3D model creation process, making it more accessible and scalable for users regardless of their 3D-modeling knowledge. Alpha3D's technology has potential applications in various domains, such as augmented reality (AR), virtual reality (VR), virtual try-on (VTO), gaming, the metaverse, and even non-fungible tokens (NFTs), allowing a wide range of digital interactions and experiences​.The platform claims to automatically generate 3D content 10x faster and up to 100x cheaper than traditional methods, without requiring 3D modeling expertise.Key customers and partnershipsAs of September 2023, Alpha3D had managed to garner a user base of nearly 100,000 platform users, including Viva Technology, Threedium, Wanna, PwC, and FARFETCH.In June 2023, the company partnered with Tryme, a company specializing in custom software solutions, to advance the creation of AI-generated 3D models for eyewear by combining Alpha3D's rapid 2D-to-3D conversion with TRYME's virtual try-on platform.

Alpha3D

OASIS is a human-centric AI research lab that offers photorealistic AI avatars for remote work. Users can enter text, record audio, or write directly on the screen, and the AI will rewrite based on specified preferences or settings, allowing users to generate rewritten content for various purposes, such as improving clarity, style, or readability. The cross-platform app allows users to use the AI avatar when using a camera, including Zoom, Google Meet, Microsoft Teams, FaceTime, and WhatsApp.

OASIS

Canada-based Maket specializes in utilizing GenAI to automate the design of residential floor plans, aiding architects, designers, and developers in efficiently creating various design iterations​. Additionally, Maket offers a suite of tools, including a virtual assistant for informed desig-making, assistance with navigating zoning codes, and regulatory compliance checks. The platform is also integrated with Rhino, Autodesk Autocad, and Autodesk Revit.Key customers and partnerships&nbsp;In April 2022, Maket formed a strategic partnership with <a href="https://mila.quebec/en/mila-and-maket-announce-a-new-partnership-to-leverage-ai-for-generative-architecture/#:~:text=MONTREAL%20%E2%80%93%20April%2020%2C%202022,architecture%2C%20engineering%20and%20construction">Mila</a>, a deep-learning research institute, to advance AI-powered architectural planning​.Key competitors: None comparable (Maket is the only design startup we have identified that uses GenAI to automate the design of residential floor plans.)

Maket

Companies that offer solutions to generate text from a prompt, where output is independent of previous interactions, such as specialized content creation tools

Companies that offer solutions to create and edit images and GIFs, including techniques such as inpainting, outpainting, upscaling, and stylizing

Companies that generate or synthesize voice and audio, including voice cloning, text-to-speech, and language translation

Companies that specialize in generating 3D content, including the creation of game assets (virtual worlds, non-playable characters), product visualization, and other 3D models

Companies that offer solutions to create and edit video content, including scene generation, background replacement, stylizing, and frame interpolation

Companies that offer solutions to generate contextually relevant text responses across multiple conversational exchanges, such as natural language chatbots

Generative AI applications are built on foundation models that are trained using advanced ML models

The technology allows the creation of digital avatars and virtual games

All companies within the space offer a product or service based on generative AI

The technology allows the creation of personalized content

Some applications leverage NLP to train models to process and respond to language-based prompts

Generative AI applications are built on in-house or third-party foundation models

Luma AI is a San Francisco-based startup developing AI-powered technology that allows the creation of photorealistic 3D models of real-life objects from photographs or video footage. This enables fast and cheap creation of models for gaming, VR, ecommerce, and other applications.The company’s flagship products are “<a href="https://lumalabs.ai/genie?view=create">Genie</a>,” a generative foundation model for users to create 3D images, an iOS application that scans objects to generate 3D models, and “<a href="https://lumalabs.ai/dream-machine">Dream machine</a>,” a foundation model specializing in video generation. Luma also offers its technology to developers through the API model, enabling integration into products and services.&nbsp;In <a href="https://sp-edge.com/updates/32794">August 2024</a>, Luma AI launched Dream Machine 1.5, an upgraded version of its AI-powered text-to-video model. Dream Machine 1.5 introduces enhanced realism, improved motion tracking, and more intuitive prompt understanding. It also features the ability to render text within generated videos, better handling of non-English prompts, and faster video generation, producing five seconds of high-quality video in approximately two minutes.<a href="https://sp-edge.com/updates/33672">In September 2024</a>, Luma AI launched an API for its Dream Machine video-generation model, allowing users to build applications and services utilizing Dream Machine outside of the Luma AI website. The API offers several tools, including text-to-video generation, image-to-video transformation, keyframe control, video extension and looping, camera motion control, and variable aspect ratios.

<div>
 
 AI21 is an Israel-based AI research lab developing large language models (LLMs). The firm also builds GenAI applications based on its LLMs, marketing them to businesses and consumers.&nbsp;
 
 
 AI21 launched its first AI model, &ldquo;Jurassic-1,&rdquo; in August 2021, offering two versions. The larger variant, Jurassic-1 Jumbo, contained 178 billion parameters&mdash;three billion more than OpenAI&rsquo;s 175-billion parameter GPT-3 model. Similar to GPT-3, Jurassic is able to write emails and articles, summarize text, compose poetry and recipes, create website layouts, and generate code.&nbsp;
 
 
 The firm concurrently launched AI21 Studio, a platform allowing users to train custom versions of Jurassic-1 and embed them into products via an API.&nbsp;
 
 
 In May 2022, AI21 confirmed it was working on a new AI system, called the &ldquo;modular reasoning knowledge and language&rdquo; or &ldquo;MRKL&rdquo; framework (pronounced &ldquo;miracle&rdquo;). MRKL augments LLMs, connecting to external sources and symbolic reasoning models to enable the generation of accurate historical information, news on current events, and dynamic information, such as weather, exchange rates, and Wikipedia information. This allows models to accurately answer math queries by calling a calculator and navigate more complex questions by breaking down queries into parts. An initial implementation of MRKL, Jurassic-X, is available on AI21 Studio, which allows users to connect LLMs to their own databases and navigate their data using natural language.
 
 
 In March 2023, the firm launched &ldquo;Jurassic-2,&rdquo; a successor to its initial language model. The new LLM differs from Jurassic-1 and most popular LLMs, in that it incorporates semantic reasoning into its text generation processes alongside statistical inference, enabling the model to more reliably and accurately respond to queries.
 
 
 AI21 says this was achieved by training Jurassic-2 in two phases: A traditional self-supervised phase using an extensive corpus of unstructured and unlabeled data and a second phase, involving a large volume of labeled data to teach the model to follow instructions. Jurassic-2 did not initially implement the MRKL framework, although AI21 confirmed it as an upcoming feature.
 
 
 The company claims that its foundation models are 30% more efficient than those of other providers and it also does not charge additional fees for the use of fine-tuned models.
 
 
 
 
 In March 2024,
 <a href="https://sp-edge.com/updates/27995">
 AI21 launched Jamba,
 </a>
 a model that integrates the Mamba Structured State Space model (SSM) technology and transformer components. The company further introduced 
 <a href="https://sp-edge.com/updates/32879">
 Jamba 1.5 Mini and Jamba 1.5 Large
 </a>
 to offer high performance and efficiency for long-context language processing in August 2024. The models have a hybrid architecture combining Transformer and Mamba approaches, allowing for quality responses with large context windows.
 
 
 Key customers and partnerships
 
 
 As of June 2023, AI21&rsquo;s customers include Latitude, Easyway, Verb, Tweet Hunter, and Harambee.
 
</div>

AI21 Labs

UK-based Stability AI is actively involved in building AI applications and offers a range of foundation models, including:Text-to-image modelStable Diffusion (SDXL 1.0): The open-source text-to-image model incorporates a dual network architecture with a 3.5-billion parameter base model and a 6.6-billion parameter refiner. The model was trained on image-caption pairs from the LAION-5B dataset derived from Common Crawl data. It excels in high-quality image generation, spatial object positioning, and complex concept recognition. The model can be fine-tuned for specific tasks using techniques such as embeddings, hypernetworks, and tools like DreamBooth, a deep-learning generation model.<a href="https://sp-edge.com/updates/30420">Stable Diffusion 3 Medium:</a> a text-to-image open-source AI models with 2 billion parameters utilizing a Diffusion Transformer Architecture and can be fine-tuned using small datasets.<a href="https://sp-edge.com/updates/32260">Stable Fast 3D:</a> Text-to-image model generates 3D images from a single 2D image.In November 2023, the company launched <a href="https://sp-edge.com/updates/23352">two new products</a> Sky Replacer and Stable 3D. Sky Replacer lets users manipulate the aesthetic of the sky in their photos from a choice of nine alternatives, enhancing the overall image appeal and Stable 3D aims to simplify the process of creating textured 3D objects, from images or text prompts, into a quick, automatic activity.Text-to-text modelsStable Beluga 1: The instruction-following language model is based on LLaMA 65 billion and has reasoning capabilities.Stable Beluga 2 (FreeWilly): An expansion to Stable Beluga 1, this model is based on LLaMA 70 billion and reportedly ranks near the top of the Open LLM Leaderboard.StableLM is an open-source language model suite; the company has released alpha versions of three billion- and seven-billion parameter models, with 15 to 65 billion-parameter models to follow. It's designed to generate text and code, and can power various downstream applications. <a href="https://sp-edge.com/updates/25750">Stable LM 2 1.6B, </a>an AI language model designed for multiple languages, was released in January 2024.The Japanese StableLM Alpha, is a seven-billion parameter Japanese language model, which claims to have superior performance compared to other publicly available Japanese language models. It offers text generation capabilities and is released under the Apache License 2.0 for commercial use, with an additional research version available for research purposes.StableCode has three billion parameters and is specifically designed to help programmers with coding tasks by providing autocomplete suggestions and responses to programming instructions.Text-to-audio modelStable Audio, which has 907 million parameters, uses a latent diffusion model architecture for audio and is conditioned on various factors including text metadata, audio file duration, and start time. This conditioning allows control over the content and length of the generated audio.Text-to-image model<a href="https://sp-edge.com/updates/26910">Stable Diffusion 3,</a> which has 800 million range and 8 billion parameters and combines a diffusion transformer architecture and flow matching. Additionally, the model can depict multi-subject prompts, create images, and correct spelling. <a href="https://sp-edge.com/updates/30068">Public preview</a> of this model was announced in June 2024.<a href="https://sp-edge.com/updates/26645">Stable Cascade,</a> a text-to-image model developed with a three-phase approach for image creation and modification.Text-to-video model<a href="https://sp-edge.com/updates/24289">Stable Video Diffusion</a>, an AI model designed to produce videos from images, offered as a research preview. The models, SVD and SVD-XT, can generate short, high-quality clips but come with limitations.<a href="https://sp-edge.com/updates/27695">Stable Video 3D (SV3D), </a>a GenAI tool to create 3D videos to create multi-view 3D models from a single input image and can produce short video content from image or text prompts.<a href="https://sp-edge.com/updates/31945">Stable Video 4D,</a> a model that enables users to upload video and obtain dynamic videos from different views.There has been considerable debate about the ethical and copyright implications of using stable diffusion to create images. The model is particularly permissive when it comes to creating different types of content, which has raised concerns about its potential for abuse. In response to its permissiveness, Stability AI has become involved in copyright infringement lawsuits, with artists and Getty Images raising legal objections to the use of their content in the model's training data.In March 2024, <a href="https://sp-edge.com/updates/27872">Stability AI's founder and CEO, Emad Mostaque, resigned from his role </a>and the company's board to focus on the development of decentralized AI to bring transparency and competitiveness to AI.In April 2024, the company made Stable Diffusion 3 and Stable Diffusion 3 Turbo available on the <a href="https://sp-edge.com/updates/28612">Stability AI developer platform API.</a>In May 2024, Stability AI <a href="https://sp-edge.com/updates/29321">introduced Stable Artisan,</a> a tool to enable media generation for Discord users.Key customers and partnershipsIn December 2022, Stability AI entered a partnership with Amazon, with AWS designated as the preferred cloud provider to facilitate the development and expansion of Stability AI's AI models.In March 2024,<a href="https://sp-edge.com/updates/27403"> Stability AI partnered with Tripo AI,</a> a provider of AI 3D models, to release TripoSR for 3D object reconstruction to cater to the demands of entertainment, gaming, industrial design, and architecture professionals, with responsive outputs for visualizing detailed 3D objects.In April 2024, the company<a href="https://sp-edge.com/updates/28612"> partnered with Fireworks AI,</a> a provider of API platforms, to deliver Stable Diffusion 3 and Stable Diffusion 3 Turbo for enterprises.In September 2024, the company <a href="https://sp-edge.com/updates/33262">launched Stable Image Ultra, Stable Diffusion 3 Large, and Stable Image Core</a>, its text-to-image models on Amazon Bedrock.

Stability AI

Cohere is a Canadian startup founded in 2019 by Aidan Gomez, Ivan Zhang, and Nick Frosst, with backgrounds in natural language processing and prior experience at Google Brain. The firm specializes in the development and deployment of large language models (LLMs) for various applications across enterprise and business use cases. Its foundation model, Cohere Command, is a large natural language text generation model with 52.4 billion parameters, focused on task-oriented dialogue, creating summarization, copywriting, dialogue extraction, and question answering.Cohere also provides Cohere Embed, a model designed to generate vector embeddings that capture the essence of text, improving capabilities in search, content moderation, and intent recognition. These embeddings help empower Cohere's multilingual customizable models, which can be fine-tuned to cater to specific use cases and industries. Additionally, Cohere ensures secure deployment options, including private cloud solutions, for added data security and privacy. In November 2023, Cohere unveiled <a href="https://sp-edge.com/updates/23446">Embed V3</a> with advanced capabilities in matching documents to queries, increasing the efficiency of retrieval augmented generation, and reducing the operational costs of LLM applications. In February 2024, the company introduced <a href="https://sp-edge.com/updates/26583">Aya,</a> an open-source LLM that supports 101 languages.According to Stanford University's HELM benchmarks, Cohere's Command model ranks among the highest-performing models available.In March 2024,<a href="https://sp-edge.com/updates/27502"> Cohere released an advanced language model, “Command-R,</a>” for enterprises. The model offers improved performance on retrieval augmented generation (RAG) and tool usage, with longer context windows of up to 128,000 tokens.In April 2024, <a href="https://sp-edge.com/updates/28198">the company released an advanced language model, Command R+</a>, for business applications. The model offers enhanced retrieval augmented generation (RAG) with citation, supports 10 business languages, and automates workflows. Additionally, <a href="https://sp-edge.com/updates/28463">Cohere also released Rerank 3,</a> a model designed to enhance enterprise search and RAG systems. In the same month, <a href="https://sp-edge.com/updates/28509">the company also introduced a private beta for Cohere Compass,</a> a foundation embedding model designed to allow multi-aspect data indexing and searching, and also <a href="https://sp-edge.com/updates/28789">launched a toolkit available for developers to build AI applications</a> faster, offering production-ready applications that can be deployed across cloud providers, with enhanced security and customization options.In May 2024, Cohere introduced <a href="https://sp-edge.com/updates/29350">Command R Fine-Tuning</a> for enhanced performance for business application workload and<a href="https://sp-edge.com/updates/29761"> released Aya 23, </a>a multilingual language model capable of handling 23 languages,available in 8 billion and 35 billion parameters.<a href="https://sp-edge.com/updates/34141">In September 2024</a>, Cohere released updated versions of its APIs for its AI models Chat, Embed, Rerank, and Classify. These updates, collectively called “API V2,” introduced several upgrades to its existing models, including mandatory model version specification in API calls, consolidation of input parameters for Chat API, and improved tool integration capabilities.&nbsp;Key customers and partnershipsIn November 2021, Cohere partnered with Google Cloud to leverage its infrastructure support and TPUs for product development and deployment. Cohere also partnered with other major cloud providers like AWS and Oracle.In March 2024,<a href="https://sp-edge.com/updates/27307"> Cohere partnered with consultancy firm Accenture</a> to integrate its Command model and retrieval augmented generation (RAG) capabilities to offer GenAI solutions for businesses.In April 2024, <a href="https://sp-edge.com/updates/28932">Cohere partnered with Amazon </a>to incorporate Command R+ and Command R to Amazon's cloud platform, Bedrock.In June 2024, the company<a href="https://sp-edge.com/updates/30492"> partnered with Borderless AI,</a> a provider of AI-powered HR solutions, to create tailored AI agents for HR tasks.The company entered into a <a href="https://sp-edge.com/updates/31052">strategic partnership with i-5O,</a> a provider of AI solutions for manufacturing, as part of Cohere's Startup Program and also partnered with <a href="https://sp-edge.com/updates/31590">Fujitsu</a> in July 2024 to develop a Japanese LLM.In September 2024, Cohere <a href="https://sp-edge.com/updates/33458">partnered with Nomura Research Institute (NRI)</a>, a Japanese consulting firm, to develop the NRI Financial AI Platform.

Cohere

Founded in 2022, Hippocratic AI is a healthcare-focused AI model developed by Health GPT. At its core, Hippocratic AI uses a state-of-the-art (SOTA) large language model (LLM) designed to improve healthcare processes, particularly in non-diagnostic tasks. Hippocratic AI aims to differentiate itself from traditional LLMs by prioritizing pre-training with trusted, evidence-based healthcare content rather than the broader Internet. Claimed to be the first safety-focused LLM for healthcare, the model undergoes a unique Reinforcement Learning with Human Feedback process, known as RLHF-HP, which involves working with healthcare professionals to validate its readiness for use. In addition, the model aims to incorporate a compassionate “bedside manner” in its interactions with patients, recognizing the impact of empathy on emotional wellbeing and health outcomes.According to the company, Hippocratic AI outperformed GPT-4 in majority of tests and certifications. Out of 114 evaluations, it outperformed GPT-4 in 105 cases, with a notable margin of +5% in 74 evaluations and +10% in 43 certifications.Key customers and partnerships&nbsp;In August 2023, the company launched the Hippocratic AI Founding Partner Program, an initiative through which the company collaborates with leading healthcare organizations to become founding partners and actively participate in the development and validation of Hippocratic AI's LLM and technology. The program includes establishing use cases, ensuring clinical and patient safety, and contributing to the advancement of healthcare-specific AI applications. In February 2024, these companies began <a href="https://sp-edge.com/updates/27145">beta</a> testing their LLM for non-diagnostic applications in healthcare.In March 2024, <a href="https://sp-edge.com/updates/27696">Hippocratic AI partnered with NVIDIA</a> to develop AI healthcare agents that have low-latency conversational interactions with patients.

Hippocratic AI

<div>
 
 Founded in 2023, GenHealth.ai is a startup focused on advancing healthcare solutions through the use of GenAI. Its proprietary approach involves training a foundation transformer model, known as DOOG-E, on extensive healthcare data, including 50+ million of coded patient claims and clinical information. DOOG-E is a specialized Generative Pre-Trained Transformer (GPT) AI designed for healthcare applications, with 70 million parameters and one billion tokens. Unlike traditional large language models, DOOG-E is a large medical model (LMM) that uses medical events such as ICD, CPT, RxNorm, and LOINC codes as its &quot;language&quot; to predict future sequences of health events based on historical data.
 
 
 The company claims that its LMM, trained on medical data, is less prone to bias and hallucination compared to its GenAI, large language models (LLM), rendering it more dependable for healthcare applications.
 
 
 Funding and financials&nbsp;
 
 
 In July 2023, the company raised USD 13 million in early funding co-led by Craft Venture and Obvious Ventures. It planned to use the funds to support the development and expansion of its LMM for various healthcare applications, including risk adjustment, care management, and financial benchmarking.
 
 
 
</div>

GenHealth

Foundation models that can handle a range of natural language processing (NLP) use cases. Typical tasks include generating summaries, translating, answering questions, and classifying text. These models typically use text inputs and generate text outputs.

Fine-tuned versions of large language models, which are focused on specific tasks and applications (e.g. code generation, medical event prediction, financial NLP tasks, etc). These are usually developed by training LLMs using custom data and also serve as foundation models that can be developed even further. These models typically use text inputs and can generate text and/or code outputs.

Foundation models that translate visual data based on features and contextual information identified during training. This enables models to interpret images and video, applying those interpretations to predictive or decision-making tasks. Typical tasks include image recognition and classification into categories. These models typically use image and/or video inputs and generate text outputs.

Foundation models that are trained to understand and work with two or more forms of input data (e.g., text and images) to solve problems and complete tasks using both natural language processing and computer vision. These models can also generate outputs across textual and visual modalities. Typical tasks include visual question answering, image captioning, and generating images based on text descriptions. These models typically use text and/or visual inputs and generate text and/or visual outputs.

Foundation models that use big data to suggest or recommend additional products to consumers. These models are designed to predict user-item interaction probabilities and provide recommendations to users. The models are trained to make these inferences based on historical data on customer interactions and non-interactions. These models typically use user features, item features and user interactions as inputs, and generate numeric values like ratings predictions and matching probabilities as outputs.

Foundation models that are capable of automatic speech recognition, transcription in multiple languages, and translation from these languages to English. These are sometimes referred to as audio models. These models typically use speech/audio as inputs and generate text outputs.

Foundation models that transform user text prompts into video clips.

Foundation models that generate music from text descriptions.

All companies within the space are building large AI models

Companies in this space leverage NLP to train LLMs

The hub exclusively covers companies that have built foundation models

All companies within the space can leverage their foundation models for generative AI applications

The technology enables the creation of personalized content

PROMINENT_CATEGORY

<div>
 The San Francisco-based startup Luma AI has launched an application programming interface (API) for its Dream Machine video generation model. This will allow users to build applications and services using Dream Machine outside of the Luma AI website.
 Dream Machine API provides advanced video generation tools such as text-to-video generation, image-to-video transformation, keyframe control, video extension, looping, camera motion control, and variable aspect ratios. These tools let users create videos from simple text instructions or static images, control the narrative flow, and optimize videos for different platforms.
 The API is now available for use. The price is USD 0.32 per million pixels generated. This equates to USD 0.35 for a five-second video at 720p resolution with 24 frames per second.
 
</div>

Luma AI

EDGE Insights

About EDGE

Contact Us

Resources

Area of Focus

Technology Research Made Effortless