We’re excited to share the primary fashions within the Llama 4 herd can be found as we speak in Azure AI Foundry and Azure Databricks, which permits individuals to construct extra personalised multimodal experiences. These fashions from Meta are designed to seamlessly combine textual content and imaginative and prescient tokens right into a unified mannequin spine. This progressive method permits builders to leverage Llama 4 fashions in purposes that demand huge quantities of unlabeled textual content, picture, and video knowledge, setting a brand new precedent in AI growth.
We’re excited to share the primary fashions within the Llama 4 herd can be found as we speak in Azure AI Foundry and Azure Databricks, which permits individuals to construct extra personalised multimodal experiences. These fashions from Meta are designed to seamlessly combine textual content and imaginative and prescient tokens right into a unified mannequin spine. This progressive method permits builders to leverage Llama 4 fashions in purposes that demand huge quantities of unlabeled textual content, picture, and video knowledge, setting a brand new precedent in AI growth.
At this time, we’re bringing Meta’s Llama 4 Scout and Maverick fashions into Azure AI Foundry as managed compute choices:
- Llama 4 Scout Fashions
- Llama-4-Scout-17B-16E
- Llama-4-Scout-17B-16E-Instruct
- Llama 4 Maverick Fashions
- Llama 4-Maverick-17B-128E-Instruct-FP8
Azure AI Foundry is designed for multi-agent use instances, enabling seamless collaboration between completely different AI brokers. This opens up new frontiers in AI purposes, from complicated problem-solving to dynamic process administration. Think about a crew of AI brokers working collectively to research huge datasets, generate inventive content material, and supply real-time insights throughout a number of domains. The probabilities are countless.
To accommodate a spread of use instances and developer wants, Llama 4 fashions are available in each smaller and bigger choices. These fashions combine mitigations at each layer of growth, from pre-training to post-training. Tunable system-level mitigations defend builders from adversarial customers, empowering them to create useful, secure, and adaptable experiences for his or her Llama-supported purposes.
Llama 4 Scout fashions: Energy and precision
We’re sharing the primary fashions within the Llama 4 herd, which is able to allow individuals to construct extra personalised multimodal experiences. In response to Meta, Llama 4 Scout is likely one of the finest multimodal fashions in its class and is extra highly effective than Meta’s Llama 3 fashions, whereas becoming in a single H100 GPU. And Llama4 Scout will increase the supported context size from 128K in Llama 3 to an industry-leading 10 million tokens. This opens up a world of prospects, together with multi-document summarization, parsing in depth consumer exercise for personalised duties, and reasoning over huge codebases.
Focused use instances embody summarization, personalization, and reasoning. Because of its lengthy context and environment friendly measurement, Llama 4 Scout shines in duties that require condensing or analyzing in depth info. It might probably generate summaries or studies from extraordinarily prolonged inputs, personalize its responses utilizing detailed user-specific knowledge (with out forgetting earlier particulars), and carry out complicated reasoning throughout massive data units.
For instance, Scout might analyze all paperwork in an enterprise SharePoint library to reply a particular question or learn a multi-thousand-page technical handbook to offer troubleshooting recommendation. It’s designed to be a diligent “scout” that traverses huge info and returns the highlights or solutions you want.
Llama 4 Maverick fashions: Innovation at scale
As a general-purpose LLM, Llama 4 Maverick comprises 17 billion lively parameters, 128 consultants, and 400 billion complete parameters, providing top quality at a cheaper price in comparison with Llama 3.3 70B. Maverick excels in picture and textual content understanding with assist for 12 languages, enabling the creation of subtle AI purposes that bridge language boundaries. Maverick is right for exact picture understanding and artistic writing, making it well-suited for common assistant and chat use instances. For builders, it gives state-of-the-art intelligence with excessive velocity, optimized for finest response high quality and tone.
Focused use instances embody optimized chat eventualities that require high-quality responses. Meta fine-tuned Llama 4 Maverick to be a superb conversational agent. It’s the flagship chat mannequin of the Meta Llama 4 household—consider it because the multilingual, multimodal counterpart to a ChatGPT-like assistant.
It’s notably well-suited for interactive purposes:
- Buyer assist bots that want to grasp photographs customers add.
- AI inventive companions that may talk about and generate content material in numerous languages.
- Inner enterprise assistants that may assist staff by answering questions and dealing with wealthy media enter.
With Maverick, enterprises can construct high-quality AI assistants that converse naturally (and politely) with a world consumer base and leverage visible context when wanted.
Architectural improvements in Llama 4: Multimodal early-fusion and MoE
In response to Meta, two key improvements set Llama 4 aside: native multimodal assist with early fusion and a sparse Combination of Consultants (MoE) design for effectivity and scale.
- Early-fusion multimodal transformer: Llama 4 makes use of an early fusion method, treating textual content, photographs, and video frames as a single sequence of tokens from the beginning. This allows the mannequin to grasp and generate numerous media collectively. It excels at duties involving a number of modalities, akin to analyzing paperwork with diagrams or answering questions on a video’s transcript and visuals. For enterprises, this enables AI assistants to course of full studies (textual content + graphics + video snippets) and supply built-in summaries or solutions.
- Chopping-edge Combination of Consultants (MoE) structure: To attain good efficiency with out incurring prohibitive computing bills, Llama 4 makes use of a sparse Combination of Consultants (MoE) structure. Basically, because of this the mannequin includes quite a few knowledgeable sub-models, known as “consultants,” with solely a small subset lively for any given enter token. This design not solely enhances coaching effectivity but in addition improves inference scalability. Consequently, the mannequin can deal with extra queries concurrently by distributing the computational load throughout numerous consultants, enabling deployment in manufacturing environments with out necessitating massive single-instance GPUs. The MoE structure permits Llama 4 to develop its capability with out escalating prices, providing a major benefit for enterprise implementations.
Dedication to security and finest practices
Meta constructed Llama 4 with the very best practices outlined of their Developer Use Information: AI Protections. This consists of integrating mitigations at every layer of mannequin growth from pre-training to post-training and tunable system-level mitigations that defend builders from adversarial assaults. And, by making these fashions out there in Azure AI Foundry, they arrive with confirmed security and safety guardrails builders come to anticipate from Azure.
We empower builders to create useful, secure, and adaptable experiences for his or her Llama-supported purposes. Discover the Llama 4 fashions now within the Azure AI Foundry Mannequin Catalog and in Azure Databricks and begin constructing with the newest in multimodal, MoE-powered AI—backed by Meta’s analysis and Azure’s platform power.
The supply of Meta Llama 4 on Azure AI Foundry and thru Azure Databricks gives prospects unparalleled flexibility in selecting the platform that most closely fits their wants. This seamless integration permits customers to harness superior AI capabilities, enhancing their purposes with highly effective, safe, and adaptable options. We’re excited to see what you construct subsequent.