In-package optical, a key enabler for Artificial Intelligence & Machine Learning
Leading photonics companies are exploring in-package optical I/O technology to enable communication between computing chips.
- Revenue generated by the Co-Packaged Optics market is expected to reach US$2.6 billion in 2033, following a 46% CAGR between 2022 and 2033.
- Co-Packaged Optics gains attention in High-Performance Computing.
- PIC s enable co-packaging for power- and cost-effective optical interconnects.
Through networking applications and especially AI and ML systems, CPO leads the way, announces Yole Intelligence, part of Yole Group. AI models have an insatiable demand for compute, storage, and data movement, and the capabilities of traditional architectures will become the main bottleneck for scaling ML. As a result, new optical interconnects have emerged for HPC and its new disaggregated architecture. Industry calls it in-package optical I/O technology. In-package optical I/O technology for xPUs, memory, and storage can help achieve the necessary bandwidths. The basic idea is to bring optics to very short reach transmission distances, such as intra-rack applications or within a system.
In its new report, Co-packaged Optics for Datacenter 2023, Yole Intelligence investigates CPO technology. Analysts provide detailed forecasts of the market split by technology architecture and review the industry in detail, including its supply chain. The technological approaches and current challenges are also well described. In addition, this study examines the global challenges and focuses on the power and energy aspects.
Martin Vallo, Ph.D., Senior Analyst, Photonics, specializing in optical communication and semiconductor lasers within the Photonics and Sensing division at Yole Intelligence“Currently, many challenges stem from using electrical I/Os. Applications such as AI/ML frequently need to move data rapidly from one chip to another or one board to another. Consequently, the computing chips need more communication, either through a larger number of pads or very high speed in a single pad. Additionally, data movement power is the primary driver of power increases in server chips”.
In-package optical I/O technology is coupled with packaging innovations such as chiplets and silicon photonics. These solutions provide up to 1000x the bandwidth at 1/10 the power of electrical I/O alternatives. Most of the optical I/O solutions will offer a disaggregated, remote laser that provides platform flexibility as well as field replaceability.
The bandwidth scaling roadmap of optical I/O chiplets starts with the capability of carrying 2Tbps bandwidth in each direction with a bandwidth per shoreline of 200 Gbps/mm as developed by Ayar Labs. According to Yole Intelligence, readiness for 1 – 10 Tbps/mm bandwidth per shoreline will be available by the end of the decade. Some users are more optimistic about readiness and availability on > 20 Tbps and > 50 Tbps off-package shoreline bandwidth, but we think it’s too aggressive.
Titre du visueljune 2021
You have to be registered to download our medias.
Usage restriction: Images may not be used against the interests of Yole Développement (Yole Group) and its entities, Yole Intelligence, or System Plus Consulting (Yole SystemPlus). For more information, please contact the Public Relations team.
Copyright : © Yole Développement, 2023
Licence : Images can be used online and for printing, without modification
Eric Mounier, Ph.D., Fellow Analyst at Yole Intelligence“The potential for billions of optical interconnects in the future is driving leading foundries such as Tower Semiconductor (Acquired by Intel), GlobalFoundries (March 2022 announcement), ASE Group, TSMC, and Samsung to prepare mass production process flows, including silicon photonics, to accept any PIC architecture from design houses. All of them are joining forces in industry consortiums such as PCIe, CXL, and UCIe.”
Accelerating data movement in AI/ML systems is the main driver for adopting optical interconnects for next-generation HPC systems. Using optical I/O in ML hardware can help to solve the problems caused by the explosive growth of data. Deep photonics integration, driven by advances in silicon photonics, has already demonstrated its viability in specific data center applications. And optical I/O chiplet architecture will definitely continue its story even beyond Datacom.
Yole Intelligence’s photonics and lighting team invites you to follow the latest innovations and applications on www.yolegroup.com.
In this regard, do not miss the presentations made by the analysts at Photonics West 2023:
- How Photonics will Contribute to Quantum Technologies and Applications – Eric Mounier
- Global insights into the key photonics technologies enabling transceivers with terabit capacities – Martin Vallo
- Co-packaged optics are inching closer to reality – Martin Vallo
Discover more HERE.
- PIC : Photonic Integrated Circuit
- AI : Artificial Intelligence
- ML : Machine Learning
- CPO : Co-Packaged Optics
- HPC : High Performance Computing
- I/O : Input/Output driver. The output driver on the switch or processor host ASIC.
- S.I. : semi-insulating