MiniCPM-V2.6: MiniMax's Open-Sourced Multimodal Model for On-Device AI Gets an Upgrade
AD |
MiniCPM-V2.6: MiniMax's Open-Sourced Multimodal Model for On-Device AI Gets an UpgradeOn August 7th, MiniMax, an artificial intelligence company, officially open-sourced its latest on-device AI multimodal model MiniCPM-V2
MiniCPM-V2.6: MiniMax's Open-Sourced Multimodal Model for On-Device AI Gets an Upgrade
On August 7th, MiniMax, an artificial intelligence company, officially open-sourced its latest on-device AI multimodal model MiniCPM-V2.6. This model, with a mere 8 billion parameters, achieves the best performance (SOTA) among models with less than 20 billion parameters in tasks such as single-image, multi-image, and video understanding.
The launch of MiniCPM-V2.6 marks a new milestone in the evolution of on-device AI multimodal models. This model brings several breakthroughs:
I. Feature Expansion:
- Real-time Video Understanding: MiniCPM-V2.6 is the first to achieve real-time video understanding on edge devices. This means users can perceive and understand video content in real-time without relying on the cloud.
- Multi-Image Joint Understanding: The model can process multiple images simultaneously and perform joint understanding and analysis, which is significant for applications like image search and multi-image scene comprehension.
- Multi-Image ICL Visual Analogical Learning: MiniCPM-V2.6 enables cross-image analogical learning, transferring and sharing knowledge across multiple images. This equips the on-device model with stronger learning capabilities.
- Multi-Image OCR: The model possesses the ability to recognize text content in multiple images, opening new possibilities for applications like automatic text recognition and information extraction.
II. Performance Breakthrough:
- High Pixel Density: The pixel density of the MiniCPM-V2.6 model is twice that of GPT-4o, indicating it can process more information with the same memory footprint, thereby enhancing operational efficiency.
- Fast Inference Speed: The quantized model requires only 6GB of memory and achieves an inference speed of 18 tokens per second on edge devices, 33% faster than its predecessor, ensuring rapid responses on edge devices.
- Cross-Platform Support: The model supports multiple languages and inference frameworks, expanding its applicability and increasing its flexibility.
III. Upgraded OCR Capabilities:
- Enhanced OCR Performance: MiniCPM-V2.6 maintains its SOTA performance in OCR while extending it to various scenarios such as single-image, multi-image, and video understanding.
- Unified High-Definition Visual Architecture: The model utilizes a unified high-definition visual architecture to transfer and share OCR capabilities, enabling a smooth expansion from single-image to multi-image and video, significantly reducing the number of visual tokens and resource consumption.
Open Source and Accessibility:
MiniCPM-V2.6 is now open-sourced on GitHub and HuggingFace, allowing developers to freely access and utilize the model for further development and application.
The open-source release of MiniCPM-V2.6 not only invigorates the development of on-device AI multimodal models but also provides developers with more powerful and flexible tools, promoting the implementation of AI technology across diverse scenarios.
The release of this model will further fuel the advancement of on-device AI, delivering more convenient and intelligent experiences to users. As technology evolves, on-device AI will demonstrate its unique advantages in more domains, positively impacting humanity.
Disclaimer: The content of this article is sourced from the internet. The copyright of the text, images, and other materials belongs to the original author. The platform reprints the materials for the purpose of conveying more information. The content of the article is for reference and learning only, and should not be used for commercial purposes. If it infringes on your legitimate rights and interests, please contact us promptly and we will handle it as soon as possible! We respect copyright and are committed to protecting it. Thank you for sharing.(Email:[email protected])
Mobile advertising space rental |
Tag: MiniCPM-V2.6 MiniMax Open-Sourced Multimodal Model for On-Device AI Gets
Dong Mingzhu Steps Down as Chairman of Gree Xin Hui Medical, Li Gangfei Takes Over
NextApple is set to release iOS 17.6.1 update, further refining the user experience
Guess you like
-
Pinduoduo's "Trillion-Yuan Support" Plan: A Three-Year, 100 Billion Yuan Investment to Build a Multi-Win Business EcosystemDetail
2025-04-03 14:41:29 11
-
Huyu Xianxiang and AVIC Optoelectronics Institute Forge Strategic Partnership to Shape China's eVTOL Avionics LandscapeDetail
2025-04-02 18:39:02 1
-
Haier Smart Home's 8th Global R&D Innovation Awards: Illuminating Better Lives with Technology, Achieving User SatisfactionDetail
2025-04-02 15:57:33 21
-
Huawei's 2025 China Digital Power Partner Conference: Carbon-Neutral Path for China, Shared Value CreationDetail
2025-03-31 18:57:09 11
-
OPPO Think Tank: A New Paradigm for Chinese Enterprises' Globalization From Wusha Village to the Global High-End MarketDetail
2025-03-31 18:48:21 1
-
ICLR 2025: Chinese Universities and Companies Showcase AI Prowess with Numerous Accepted Papers; Stanford-HKUST Collaboration Achieves Perfect ScoreDetail
2025-03-31 14:54:45 11
-
Huawei HarmonyOS Smart Home Partner Summit: Deep Dive into Spatial Intelligence Transformation and Ecosystem Development StrategyDetail
2025-03-31 13:01:45 1
-
AI Large Models Drive Innovation in Humanoid Robots and Autonomous Driving: 2025 as a Key MilestoneDetail
2025-03-31 13:00:04 1
-
Eight Cities Pilot Credit Supervision Data Openness, Empowering Micro and Small Enterprises with Mobile Payment PlatformsDetail
2025-03-26 09:32:47 1
-
Xiaomi's "Just a Little Profit": The Deep Logic and Sustainability Behind its Low-Margin StrategyDetail
2025-03-25 15:07:32 21
- Detail
-
The Ninth Huawei ICT Competition China Challenge Finals Conclude Successfully: Kunpeng and Ascend Tracks Crown Their ChampionsDetail
2025-03-24 16:26:03 11
-
Ronshen Sugar Cube Refrigerator: The Official Product of the 2025 FIFA Club World Cup, Ushering in a New Era of Healthy Food PreservationDetail
2025-03-24 15:40:35 1
-
Zhihu Launches New Version of Zhihu Straight Answer: Deep Integration of AI and Community to Enhance Professionalism and CredibilityDetail
2025-03-24 14:04:38 1
-
China Construction Ninth Harmony (Zhongjian Jiuhe) and Huawei HarmonyOS Smart Home Deepen Strategic Partnership at AWE2025, Building a Green and Intelligent Future HomeDetail
2025-03-23 15:21:15 41
-
ZuoYeBang Books Leads the New Trend in Intelligent Education Publishing at Changsha Book FairDetail
2025-03-21 15:15:33 1
-
Tianyancha: Shielding Consumer Safety and Reshaping Business Trust with DataDetail
2025-03-21 08:47:58 1
-
Hisense at AWE2025: AI Empowerment, Leading the Transformation of Future Smart LivingDetail
2025-03-20 18:24:11 1
-
Haier TV Makes a Stunning Debut at AWE 2024: Zhiyuan AI Large Model and PureScene Care Screen Usher in a New Era of Smart HomesDetail
2025-03-20 15:17:20 1
-
China Power's Xin Yuan Zhi Chu (New Source Smart Storage): Open Energy Intelligence Computing Center Leads Intelligent Transformation of the Energy IndustryDetail
2025-03-20 15:15:39 1