Customized Memories for Memory-Centric Computing
In the era of AI and IoT, the volume of generated data is increasing exponentially. Storing, processing, and analyzing these data require substantial computational power and storage capacity, which are enabled by advancement in semiconductor devices, integrated circuits, and systems. Consequently, CPU, GPU, and memory technologies are rapidly evolving to meet these demands. Memory technologies are central to this evolution, playing critical roles in both computation and data storage. Among the mainstream memories, DRAM, SRAM, and Flash continue to attract significant investment and research, aiming for higher performance and greater efficiency. Meanwhile, researchers are also exploring emerging memory technologies such as ReRAM, FeRAM, and MRAM with great innovation and enthusiasm.
Memory-centric computing is emerging as a viable approach to complement traditional processor-centric computing. This paradigm enables AI computations, such as multiply-and-accumulate (MAC), to be carried out in close proximity to or even within memory units. By reducing data movement, this approach enhances energy efficiency and accelerates processing speed. Various memory technologies can support this methodology, tailored to specific application requirements. Notably, 3D Flash memories are distinguished as excellent candidates for AI computing and data search applications. They offer high storage capacity, significant on-off current ratio, tunable read currents with tight distribution, low read disturbance, and robust massively parallel operation, making them ideally suited for the demands of AI workloads.
In this presentation, the speaker will outline the current status, challenges, and future prospects of customized memories for memory-centric computing. Additionally, he will highlight several applications that showcase the potential of these technologies in a data-driven world.
Key Technologies Covered
- Memories for computing and data storage
- Memory-centric computing, near-memory computing, in-memory computing
- AI related computation, multiply-and-accumulate (MAC), vector database search
- Retrieval augmented generation (RAG), recommendation system, etc.