Published April 2, 2024 | Version v1
Dataset Open

Data from: Large-scale photonic chiplet Taichi empowers 160-TOPS/W artificial general intelligence

  • 1. Tsinghua Shenzhen International Graduate School*
  • 2. Tsinghua University

Description

The everlasting pursuit for a more powerful artificial general intelligence (AGI) continuously demands for higher computing performance. Breaking the restrictions from the Moore's Law, integrated photonic neural networks have shown great potential in terms of superior processing speed and high energy-efficiency. However, the capacity and scalability are restricted by the unavoidable and time-varying on-chip errors that only simple tasks and shallow models (e.g., 10-category digits classification with thousand-parameter-level networks) can be on-chip realized optically. To support modern AGIs with optical computing, we innovate Taichi, large-scale photonic chiplets owning millions-of-neuron on-chip computing capability with 160 TOPS/W energy efficiency. For the first time, Taichi experimentally realized on-chip optical neural networks (ONNs) with over 13.96M neurons for thousand-category-level classification (tested 91.89% of accuracy for 1623-category Omniglot dataset) and high-fidelity artificial intelligence-generated content (AIGC) with state-of-the-art performances, while achieving up to 2 orders of magnitude improvement in computing efficiency than state-of-the-art AI chips. Based on an integrated diffractive-interference-hybrid design and a general distributed computing architecture, Taichi paves its own way for large-scale on-chip ONN models and advanced tasks, further exploiting the flexibility and potential of optical devices, which will lead to a giant leap in scalability, accuracy and efficiency to support modern AGI.

Notes

Funding provided by: Ministry of Science and Technology of China*
Crossref Funder Registry ID:
Award Number: 2021ZD0109901

Funding provided by: National Natural Science Foundation of China
Crossref Funder Registry ID: https://ror.org/01h0zpd94
Award Number: 62125106

Funding provided by: National Natural Science Foundation of China
Crossref Funder Registry ID: https://ror.org/01h0zpd94
Award Number: 62088102

Funding provided by: Shuimu Tsinghua Scholar Program*
Crossref Funder Registry ID:
Award Number:

Methods

The preprocessed dataset that modified from the original ones. We resized/cropped the dimension of the images and re-origanized the training-testing splitting in the original datasets, to fit the data requirements by our optical computing hardware Taichi chiplets.

Files

Dataset1_CIFAR10.zip

Files (14.6 GB)

Name Size Download all
md5:54948ff654e72809af15eb77ab5b8ebe
463.9 MB Preview Download
md5:7434d550554c617c1e3a55354c909209
4.7 GB Download
md5:10bb6910c2fc56f298c2035772a734be
4.7 GB Download
md5:e299c157270304a4ef9a98cddd9c529e
4.7 GB Preview Download
md5:f711d54f05339bd550a4fdd6ee3148e6
15.4 MB Preview Download
md5:e3dd5db9e4fdcf7b4c34a3a97f061725
2.1 MB Preview Download
md5:568bb99b3af6e44a45546915e5497777
3.9 kB Preview Download