Get All Access for $5/mo

Meta Reveals Its Plans To Reimagine the AI Infrastructure This includes first generation custom silicon chip for running AI models, a new AI-optimized data center design and the second phase of their 16,000 GPU supercomputer for AI research

By Teena Jose

Opinions expressed by Entrepreneur contributors are their own.

You're reading Entrepreneur India, an international franchise of Entrepreneur Media.

Twitter

The social networking giant Meta revealed its plan to make strides in with the development of its in-house chip specifically designed for running AI models. This includes a first generation custom silicon chip for running AI models, a new AI-optimized data centre design and the second phase of their 16,000 GPU supercomputer for AI research.

In a recent blog post titled, 'Reimagining our infrastructure for the AI age', Santosh Janardhan, VP and head of infrastructure has stated, "Our artificial intelligence (AI) compute needs will grow dramatically over the next decade as we break new ground in AI research, ship more cutting-edge AI applications and experiences across our family of apps, and build our long-term vision of the metaverse. We are executing on an ambitious plan to build the next generation of Meta's AI infrastructure and today, we're sharing some details on our progress."

"Alongside the custom silicon chip for AI models, Meta is also working on an AI-optimized data center design and the second phase of a massive 16,000 GPU supercomputer dedicated to AI research. These initiatives aim to facilitate the development and deployment of larger and more sophisticated AI models at scale," he added.

As per the post, the company is reimagining how coding is done with the deployment of CodeCompose, a generative AI-based coding assistant developed to boost developer productivity throughout the software development lifecycle.

The centerpiece of Meta's infrastructure advancements is the MTIA (Meta Training and Inference Accelerator), their in-house custom accelerator chip family. According to Meta, MTIA is designed specifically for inference workloads and offers superior compute power and efficiency compared to CPUs. Combining MTIA chips with GPUs will result in improved performance, reduced latency, and greater efficiency for each workload. Meta's blog posts acknowledged that its first MTIA chip stumbled with high-complexity AI models, but further noted that it handled low and medium complexity models more efficiently than competitor chips.

Meta also announced plans to redesign its data centres with modern AI-oriented networking and cooling systems, with the first facility set to break ground this year. The new design is expected to be 31% cheaper and built twice as fast as the company's current data centres.

"We're always focused on delivering long-term value and impact to guide our infrastructure vision. We believe our track record of building world-class infrastructure positions us to continue leading in AI over the next decade and beyond," the blog noted.

Teena Jose

News Desk Reporter with Entrepreneur India

Teena is a post graduate in financial journalism. She has an avid interest in content creation, digital media and fashion.
News and Trends

"45% of All Ongoing Hydropower Projects in India are Ours": Patel Engineering

Patel Engineering reported a turnover of INR 4,400 crore in the last fiscal year, with a projected 10 per cent growth for the current year.

Side Hustle

'Hustling Every Day': These Friends Started a Side Hustle With $2,500 Each — It 'Snowballed' to Over $500,000 and Became a Multimillion-Dollar Brand

Paris Emily Nicholson and Saskia Teje Jenkins had a 2020 brainstorm session that led to a lucrative business.

Science & Technology

5 Automation Strategies Every Small Business Should Follow

It's time we make IT automation work for us: streamline processes, boost efficiency and drive growth with the right tools and strategy.

Science & Technology

5 Rule-Bending AI Hacks to Make Your Mornings More Productive and Profitable

By 2025, AI will transform productivity by streamlining workflows and cutting costs. Major companies like Microsoft, Google, and OpenAI are leading the way, advancing AI into "Phase 3," where tools act as digital assistants. Discover 5 AI hacks to boost efficiency and redefine your daily routine.

Business Ideas

63 Small Business Ideas to Start in 2024

We put together a list of the best, most profitable small business ideas for entrepreneurs to pursue in 2024.

News and Trends

Suchi Semicon Set to Inaugurate Gujarat's First OSAT Facility in Surat This November

Gujarat's first outsourced semiconductor assembly and test (OSAT) facility is expected to create about 1,200 jobs, focusing on advanced semiconductor assembly and testing