In a groundbreaking move, Microsoft has unveiled its latest arsenal in the tech race, introducing two custom-designed chips, Azure Maia AI Accelerator and Azure Cobalt CPU. These chips, the result of years of covert refinement in a Silicon lab on Microsoft’s Redmond campus, are set to revolutionize the landscape of AI services and cloud computing.

Maia AI Accelerator 

The Maia chip is tailored to accelerate AI computing tasks, a direct response to the burgeoning costs associated with delivering AI services. Specifically designed to power Microsoft’s $30-a-month “Copilot” service, the Maia chip is optimized for running large language models, including those integral to Microsoft’s Azure OpenAI service. By routing most AI efforts through common foundational AI models, Microsoft aims to drastically improve efficiency and tackle the challenge of high AI service costs.

Azure Cobalt CPU

Complementing Maia is the Cobalt chip, a central processing unit (CPU) strategically designed to compete with Amazon Web Services’ Graviton series of in-house chips. Utilizing technology from Arm Holdings, Cobalt has undergone rigorous testing, proving its mettle by powering Teams, Microsoft’s business messaging tool. Unlike its counterparts, Cobalt will not be restricted for internal use; Microsoft plans to sell direct access to Cobalt, presenting a competitive alternative to AWS’s chips.

Acknowledging the stiff competition with Amazon Web Services, Microsoft is keen on emphasizing the competitive performance and price-to-performance ratio of its Cobalt chip. This strategic move aligns with Microsoft’s overarching strategy, which revolves around designing chips to enhance efficiency, reduce costs, and ultimately offer superior solutions to customers.

Technical details reveal that both Maia and Cobalt chips are manufactured using cutting-edge 5-nanometer technology from TSMC. The Maia chip, in a cost-effective twist, employs standard Ethernet network cabling, eschewing the more expensive custom Nvidia networking technology used in OpenAI’s supercomputers.

Analysts view Microsoft’s approach with the Maia chip as a clever maneuver, allowing the company to capitalize on selling AI services in the cloud until personal devices become powerful enough. AWS’s Graviton chip, reportedly boasting 50,000 customers, underscores the fierce competition in the AI chip market, with AWS emphasizing ongoing innovation in delivering future chip generations.

The unveiling of Maia and Cobalt chips marks a significant step in Microsoft’s quest for efficient, scalable, and sustainable computing power. These chips not only address the demands of AI workloads but also play a crucial role in optimizing infrastructure systems from silicon to servers for both internal and customer workloads.

As the tech giant sets its sights on designing second-generation versions of Maia and Cobalt, the future promises continued optimization across every layer of the technological stack for enhanced performance, power efficiency, and cost-effectiveness. Microsoft’s venture into custom-designed chips is poised to reshape the AI landscape and propel the industry toward new horizons.

Related:

• Nvidia, world’s premier AI chip maker, skyrockets to global dominance and record-breaking heights
• Microsoft appears to quietly close Windows 10 Mobile App Store
• OpenAI is Putting a Hold on New Sign-ups for ChatGPT Plus

(via)

The post Microsoft takes a leap in AI with Custom-Designed Chips Maia and Cobalt appeared first on Gizmochina.

Microsoft is likely to unveil its first artificial intelligence (AI) chip next month, according to a report by tech publication The Information. The move is seen as a bid to reduce Microsoft’s reliance on Nvidia’s graphics processing unit (GPU) chips, which are in high demand and have been in short supply.

Microsoft’s AI chip, codenamed Athena, is designed for data center server. It is expected to compete with NVIDIA’s flagship H100 GPU, which are currently used by Microsoft and other cloud providers to power large language models (LLMs) and other AI applications.

The Information first reported on Athena in April of this year. The chip is expected to be unveiled at Microsoft’s Ignite conference which is scheduled to take place from November 14-17.

The development of Athena comes at a time when there is a growing demand for AI chips. LLMs, in particular, require a lot of computing power to train and run. As a result, there is a shortage of AI chips, which has driven up prices.

Microsoft-backed OpenAI is also reportedly exploring the possibility of developing its own AI chips. By developing its own AI chip, they are hoping to reduce its reliance on Nvidia and other chipmakers. This could also help Microsoft to cut costs and improve the performance of its cloud services. Google and Amazon are also developing their own AI chips, suggesting that the AI chip market is set to grow rapidly.

RELATED:

• OnePlus Ace 2 Pro vs Xiaomi 13T Pro: Specs Comparison
• Amazon Bedrock Draws Thousands of Users as It Aims to Challenge Microsoft and Google…
• Microsoft, Google, and OpenAI Unite for Responsible AI Development
• Google’s Complaint Against Microsoft Could Have Far-reaching Implications for Industry
• Microsoft, Google, and Apple among most exploited in 2022 zero-day vulnerabilities

The post Microsoft to debut its first AI chip next month to reduce reliance on Nvidia appeared first on Gizmochina.