FugakuNEXT is the codename for the follow-on flagship supercomputer for Japan after Fugaku. It is slated to be deployed in 2030, and RIKEN is the development lead for the system. Its high-level goals include:
- 5x to 10x improvement in HPC application performance over Fugaku
- more than 50 EFLOPS for AI training (100-200 EFLOPS peak)
- 50x-100x application speedup when using AI surrogates
The details of the project were summarized on a digital poster at SC24:
Satoshi Matsuoka has started talking about their vision for FugakuNEXT since around 2022. The vision for its CPU is:1
Themes that may be relevant to a processor or node include:1
- 3D stacking of memory and logic (as depicted above)
- Silicon photonics
- Large SRAMs, a la AMD 3D VCache
- Specialized tensor core-like data paths for scientific motifs like stencils, convolution, FFTs
- CGRA instead of or in addition to SIMD
- Processing-in-memory (PIM)
The CGRA is called out as a “strong scaling accelerator” candidate, so perhaps the CPU socket will have tiles of general-purpose CPU cores as well as CGRA tiles.