Groq opens one of Australia's largest AI inference sites

AI inference provider Groq and Equinix have launched one of Australia’s largest high-speed AI inference infrastructure sites in Sydney.

The 4.5 MW installation at an Equinix International Business Exchange data centre is designed to provide up to five times faster compute power at a lower cost than traditional GPUs and hyperscaler clouds. The deployment leverages the Equinix Fabric software-defined interconnection service to provide secure, low-latency, high-speed interconnectivity to the GroqCloud for production AI workloads.

The facility will provide access to Groq’s Language Processing Unit Inference Engine, which uses a custom-built compiler and leverages open-source large language models. It has been purpose-built for AI inference and language.

Groq CEO and founder Jonathan Ross said there is currently not sufficient computing capability globally for everyone to build AI.

“That’s why Groq and Equinix are expanding access, starting in Australia,” he said.

Groq GM for APAC Scott Albin said the region is a key growth market for the company.

“Over half of our global developers [are] already using GroqCloud based here,” he said. “Our deployment in Equinix’s Sydney data centre is our first step to bring high-performance, cost-efficient AI inference closer to the region, enabling secure, low-latency access while supporting data sovereignty and privacy. Together, we’re building the infrastructure to drive AI innovation and growth in Asia–Pacific.”

Equinix Australia managing director Guy Danskine said the company’s collaboration with Groq “highlights the power of Equinix Fabric in enabling secure, low-latency connectivity for AI workloads, helping organisations accelerate innovation while ensuring compliance with the local data sovereignty and privacy requirements”.

The partnership has been recognised by the federal government, with Assistant Minister for Science, Technology and the Digital Economy Dr Andrew Charlton stating that the government welcomes responsible data centre investment in the market.

“We are continuing to work to attract more because we know this is required for a successful digital economy,” he said. “Australia is a natural home for this type of world-class capability. It is great to see investments that bring high-performance, cost-efficient AI tools to the region.”

The fast-growing Australian AI market is projected to be worth $315 billion by 2028, according to the CSIRO.

Image caption: One of Equinix’s International Business Exchange Sydney data centres, SY4. Image: Supplied