It seems like just yesterday that I wrote about the impact of Llama 3.1, and now we're facing another significant milestone in artificial intelligence with the release of Llama 3.2 on September 25, 2024.
Introduction
Meta has just announced the llama 3.2, an innovation that promises to transform the edge and vision AI landscape. This new version features large-scale language models (LLMs) for small and medium-sized vision (11B and 90B) and lightweight text-only models (1B and 3B), designed to adapt to mobile and edge devices. Available in pre-trained and instruction-tuned versions, these models offer exceptional flexibility and performance for a wide range of applications.
What's New in Llama 3.2
Mobile and Edge Optimized Templates
The models llama 3.2 of 1B and 3B now support a context length of up to 128K tokens, setting a new standard for device applications such as:
- Multilingual knowledge retrieval and summarization
- Instruction follow-up
- Rewrite tasks run locally
Optimized for Qualcomm, MediaTek, and ARM processor hardware, these models enable efficient processing without the need for heavy infrastructure.
Advances in Computer Vision
The vision models llama 3.2 11B and 90B models can immediately replace their text counterparts, outperforming even closed-source models like Claude 3 Haiku on image understanding tasks. Unlike other open-source multimodal models, both pre-trained and aligned models are available for custom tuning using torchtune, in addition to being able to be tested with the Meta AI assistant.
Llama Stack: Simplifying Development
Meta is releasing the first official distributions of Flame Stack, which significantly simplify how developers work with Llama models in different environments:
- Single-node
- On-premises
- In the cloud
- On the device
This enables turnkey implementation of recovery-augmented generation (RAG) applications and security-integrated tools, accelerating development time and reducing complexity.
Strategic Partnerships
In collaboration with partners such as AWS, Databricks, Dell, Fireworks, Infosys e Together AI, Meta is expanding the reach of the Llama Stack to enterprise customers. Distribution to devices is carried out through PyTorch ExecuTorch, while single-node distribution is facilitated by Don't.
Openness that Drives Innovation
Meta continues to share its work because it believes that openness drives innovation. Llama 3.2 leads the way in openness, modifiability, and cost-efficiency, enabling more people to realize creative and transformative breakthroughs using generative AI.
Availability
The models llama 3.2 are available for download at llama.com e hugging face, in addition to being accessible for immediate development on a broad ecosystem of partner platforms, including:
- AMD
- Google Cloud
- IBM
- Microsoft Azure
- NVIDIA
- Oracle cloud
- And many others
Final Thoughts
It seems like only yesterday I discussed the impact of Llama 3.1, and now Llama 3.2 is here to raise the bar even higher. The speed at which technology evolves is truly impressive. I'm excited to see how these advances will be applied across different industries and how they can positively influence our projects and solutions.
