In a report, Groq says its LPUs are scalable and will be joined with each other employing optical interconnect across 264 chips. it might even further be scaled working with switches, but it will increase to latency. https://www.sincerefans.com/blog/groq-funding-and-products