---
title: Processing-in-Memory (PIM)
type: technology
url: "https://www.envisioning.com/research/substrate/south-korea__processing-in-memory"
hub: substrate
summary: SK Hynix is embedding compute logic directly inside DRAM chips, reducing the data movement bottleneck that wastes up to 60% of energy in conventional AI systems.
---

# Processing-in-Memory (PIM)

SK Hynix is embedding compute logic directly inside DRAM chips, reducing the data movement bottleneck that wastes up to 60% of energy in conventional AI systems.
- Technology Readiness Level: 6/9
- Impact: 3/5
- Investment: 3/5
SK Hynix's AiM (Accelerator-in-Memory) technology embeds processing units within HBM and GDDR memory chips, allowing basic compute operations to happen where data already resides rather than shuttling it to a separate CPU or GPU. The first-generation AiM chips target AI inference workloads like recommendation systems and natural language processing.

The data movement problem is the dominant energy cost in modern computing — moving a byte of data from DRAM to a processor consumes 100-1000x more energy than the computation itself. PIM architectures attack this directly by putting simple multiply-accumulate units inside the memory array. Samsung has parallel PIM research (HBM-PIM), making Korea the only country with two companies simultaneously developing production-grade processing-in-memory.

PIM is unlikely to replace GPUs for large-scale AI training, but for inference at the edge and in data centers, it promises 2-5x energy efficiency improvements. As AI inference costs begin to dwarf training costs, PIM could become a critical technology for sustainable AI deployment.

---
Source: Envisioning — Technology Research Institute (https://www.envisioning.com/research/substrate/south-korea__processing-in-memory)