📺 Stream EntrepreneurTV for Free 📺

Meta Reveals Its Plans To Reimagine the AI Infrastructure This includes first generation custom silicon chip for running AI models, a new AI-optimized data center design and the second phase of their 16,000 GPU supercomputer for AI research

By Teena Jose

Opinions expressed by Entrepreneur contributors are their own.

You're reading Entrepreneur India, an international franchise of Entrepreneur Media.

Twitter

The social networking giant Meta revealed its plan to make strides in with the development of its in-house chip specifically designed for running AI models. This includes a first generation custom silicon chip for running AI models, a new AI-optimized data centre design and the second phase of their 16,000 GPU supercomputer for AI research.

In a recent blog post titled, 'Reimagining our infrastructure for the AI age', Santosh Janardhan, VP and head of infrastructure has stated, "Our artificial intelligence (AI) compute needs will grow dramatically over the next decade as we break new ground in AI research, ship more cutting-edge AI applications and experiences across our family of apps, and build our long-term vision of the metaverse. We are executing on an ambitious plan to build the next generation of Meta's AI infrastructure and today, we're sharing some details on our progress."

"Alongside the custom silicon chip for AI models, Meta is also working on an AI-optimized data center design and the second phase of a massive 16,000 GPU supercomputer dedicated to AI research. These initiatives aim to facilitate the development and deployment of larger and more sophisticated AI models at scale," he added.

As per the post, the company is reimagining how coding is done with the deployment of CodeCompose, a generative AI-based coding assistant developed to boost developer productivity throughout the software development lifecycle.

The centerpiece of Meta's infrastructure advancements is the MTIA (Meta Training and Inference Accelerator), their in-house custom accelerator chip family. According to Meta, MTIA is designed specifically for inference workloads and offers superior compute power and efficiency compared to CPUs. Combining MTIA chips with GPUs will result in improved performance, reduced latency, and greater efficiency for each workload. Meta's blog posts acknowledged that its first MTIA chip stumbled with high-complexity AI models, but further noted that it handled low and medium complexity models more efficiently than competitor chips.

Meta also announced plans to redesign its data centres with modern AI-oriented networking and cooling systems, with the first facility set to break ground this year. The new design is expected to be 31% cheaper and built twice as fast as the company's current data centres.

"We're always focused on delivering long-term value and impact to guide our infrastructure vision. We believe our track record of building world-class infrastructure positions us to continue leading in AI over the next decade and beyond," the blog noted.

Teena Jose

News Desk Reporter with Entrepreneur India

Teena is a post graduate in financial journalism. She has an avid interest in content creation, digital media and fashion.
Side Hustle

These Coworkers-Turned-Friends Started a Side Hustle on Amazon — Now It's a 'Full Hustle' Earning Over $20 Million a Year: 'Jump in With Both Feet'

Achal Patel and Russell Gong met at a large consulting firm and "bonded over a shared vision to create a mission-led company."

Business News

These Are the 10 Most Profitable Cities for Airbnb Hosts, According to a New Report

Here's where Airbnb property owners and hosts are making the most money.

Side Hustle

How to Turn Your Hobby Into a Successful Business

A hobby, interest or charity project can turn into a money-making business if you know the right steps to take.

Science & Technology

Service as a Strategy — How to Build a Sustainable, Future-Ready Tech Business

The benefits of transitioning from traditional SaaS models to service-based models — and how to do it successfully.

Business News

Samsung's New Ad Pokes Fun at Apple's Controversial 'Crush' Ad

Creative universes overlap in a new ad from Samsung.

Productivity

Want to Be More Productive? Here's How Google Executives Structure Their Schedules

These five tactics from inside Google will help you focus and protect your time.