Meta Reveals Its Plans To Reimagine the AI Infrastructure This includes first generation custom silicon chip for running AI models, a new AI-optimized data center design and the second phase of their 16,000 GPU supercomputer for AI research

By Teena Jose

Opinions expressed by Entrepreneur contributors are their own.

You're reading Entrepreneur India, an international franchise of Entrepreneur Media.

Twitter

The social networking giant Meta revealed its plan to make strides in with the development of its in-house chip specifically designed for running AI models. This includes a first generation custom silicon chip for running AI models, a new AI-optimized data centre design and the second phase of their 16,000 GPU supercomputer for AI research.

In a recent blog post titled, 'Reimagining our infrastructure for the AI age', Santosh Janardhan, VP and head of infrastructure has stated, "Our artificial intelligence (AI) compute needs will grow dramatically over the next decade as we break new ground in AI research, ship more cutting-edge AI applications and experiences across our family of apps, and build our long-term vision of the metaverse. We are executing on an ambitious plan to build the next generation of Meta's AI infrastructure and today, we're sharing some details on our progress."

"Alongside the custom silicon chip for AI models, Meta is also working on an AI-optimized data center design and the second phase of a massive 16,000 GPU supercomputer dedicated to AI research. These initiatives aim to facilitate the development and deployment of larger and more sophisticated AI models at scale," he added.

As per the post, the company is reimagining how coding is done with the deployment of CodeCompose, a generative AI-based coding assistant developed to boost developer productivity throughout the software development lifecycle.

The centerpiece of Meta's infrastructure advancements is the MTIA (Meta Training and Inference Accelerator), their in-house custom accelerator chip family. According to Meta, MTIA is designed specifically for inference workloads and offers superior compute power and efficiency compared to CPUs. Combining MTIA chips with GPUs will result in improved performance, reduced latency, and greater efficiency for each workload. Meta's blog posts acknowledged that its first MTIA chip stumbled with high-complexity AI models, but further noted that it handled low and medium complexity models more efficiently than competitor chips.

Meta also announced plans to redesign its data centres with modern AI-oriented networking and cooling systems, with the first facility set to break ground this year. The new design is expected to be 31% cheaper and built twice as fast as the company's current data centres.

"We're always focused on delivering long-term value and impact to guide our infrastructure vision. We believe our track record of building world-class infrastructure positions us to continue leading in AI over the next decade and beyond," the blog noted.

Wavy Line
Teena Jose

News Desk Reporter with Entrepreneur India

Teena is a post graduate in financial journalism. She has an avid interest in content creation, digital media and fashion.

Related Topics

Leadership

5 Traits and Characteristics of Successful Entrepreneurs in 2023

Entrepreneurship has become the new trending topic in the business world. In 2023, the entrepreneurial world is expected to flourish more than ever, and it will take a certain set of skills to be a successful entrepreneur. This article highlights what it takes to be a successful entrepreneur in 2023.

Growing a Business

How to Grow Your Business With Social Media

Miriam Fried, owner of MF Strong, shares why a solid online presence, including social media and Yelp, is important for starting a business and achieving continued growth.

Devices

Save $50 Off This Charging Station for Father's Day

Give dad the gift of power with this charging station.

News and Trends

EV Finance Company Revfin Secures $5 Million Investment From DFC

Revfin plans to utilize the funds for new products and expansion to new geographies

Growing a Business

14 Easy Ways to Rank Your Website Higher on Google

Despite Google's algorithm and regular updates, you can quickly boost your website's ranking with these tips.

Starting a Business

Free Event | June 27: Get the Answers to Your Solopreneur Challenges

Running a one person business is challenging, but we're here to help you. Tune into our video series, Solopreneur Office Hours, as our expert, Terry Rice, answers your most pressing questions.