NEWSLETTER

By clicking submit, you agree to share your email address with TFN to receive marketing, updates, and other emails from the site owner. Use the unsubscribe link in the emails to opt out at any time.

NVIDIA rival Groq grabs $750M at $6.9B valuation  to scale inference infrastructure

Groq chip
Image credits: Groq

Groq, a Silicon Valley chip company pioneering ultra-fast AI inference, has closed a $750 million funding round, giving it a post-money valuation of $6.9 billion. The raise was led by Dallas-based investment firm Disruptive, joined by major names including BlackRock, Neuberger Berman, Deutsche Telekom Capital Partners, and a large West Coast mutual fund manager. Existing backers Samsung, Cisco, D1, Altimeter, 1789 Capital, and Infinitum also doubled down. 

As chip demand remains elevated, particularly for AI and data-heavy workloads, Groq is positioned as a frontrunner to capture market share in the rapidly expanding inference computing market, which is projected to reach $400 billion annually within five years.

Building the backbone of next-gen compute

Groq’s technology already powers more than two million developers and Fortune 500 companies. Its American-built inference infrastructure is designed for speed and efficiency, giving enterprises a reliable alternative as competition for compute intensifies. The company has been steadily expanding its reach, building on data center capacity in North America, Europe, and the Middle East, while preparing for further global expansion.

The White House has taken notice of Groq’s work, with recent executive orders promoting the export of the American AI Technology Stack. By prioritising US-origin compute platforms for global use, this policy positions Groq as a key player in extending America’s influence in critical technology infrastructure. This alignment with national strategy adds a geopolitical dimension to Groq’s business, giving it both commercial and strategic significance.

From Google to Groq: A founder’s journey 

Groq was founded in 2016 by Jonathan Ross, a former Google engineer best known for co-developing the Tensor Processing Unit (TPU) chip at the tech giant. With a vision to design purpose-built chips optimised for AI, Ross took Groq out of stealth mode with a clear focus: to accelerate AI workloads with unmatched speed, quality, and efficiency

At its core, Groq specialises in AI inference, the process of running trained models in real-time. The company has developed its own proprietary Language Processing Units (LPUs): custom-designed chips that process AI inference tasks efficiently. These LPUs are tailored for applications where real-time response is critical, such as autonomous vehicles, advanced robotics, and large-scale data centres.

Unlike general-purpose GPUs, Groq’s LPUs are built specifically for inference, offering significant advantages in energy efficiency (up to 10x more efficient), speed (processing up to 800 tokens per second), and scalability. The company provides both cloud-based solutions through GroqCloud and on-premises options, appealing to enterprises looking for flexible, high-performance AI infrastructure.

Charting the future of AI infrastructure

With $750 million in fresh capital, Groq is set to accelerate its expansion into new markets and further refine its technology stack. The funding gives it the firepower to strengthen its data centre footprint and serve the rising tide of customers requiring faster, cheaper, and more accessible compute. The company has already secured a $1.5 billion commitment from Saudi Arabia, which is expected to generate approximately $500 million in revenue this year.

In a market experiencing supply constraints, Groq’s promise lies in its ability to scale where traditional chipmakers struggle. By combining a mission-driven approach with heavyweight investor backing and government policy tailwinds, Groq has established itself as a cornerstone in the next chapter of global computing infrastructure. Its latest raise not only validates its growth trajectory but also signals how critical specialised chipmakers will be in powering the future of technology.

“Inference is defining this era of AI, and we’re building the American infrastructure that delivers it with high speed and low cost,” said Jonathan Ross, Groq Founder and CEO

“As AI expands, the infrastructure behind it will be as essential as the models themselves,” said Alex Davis, Founder, Chairman, and CEO of Disruptive. “Groq is building that foundation, and we couldn’t be more excited to partner with Jonathan and his team in this next chapter of explosive growth.”

Total
0
Shares
Related Posts
Total
0
Share
tfn-logo-2-220x220-removebg-preview

Get daily funding news briefings in the tech world delivered right to your inbox.

Enter Your Email
join our newsletter. thank you
TFN Banner