MIG
A hardware-level GPU partitioning technology introduced with the NVIDIA Ampere architecture. It divides a single physical GPU into up to seven fully independent instances, each with dedicated memory, cache, and compute engines, providing isolation approaching that of separate physical cards.
Core Facts
Timeline (last 90 days)
MIG has relatively coarse granularity and fixed partitioning schemes, making it unable to fully replace software-level time-slicing scheduling.
NVIDIA's MIG is only available on data-center-grade cards (such as A100 and H100) and is not supported on consumer-grade RTX cards.
Green Contexts share similar goals with MIG and MPS (improving GPU utilization and isolation) but differ in positioning: MIG is a hardware physical partition with the strongest isolation but lower flexibility, MPS targets multi-process sharing, and Green Contexts provides finer-grained programmatic control within a single process.
More reliable methods for reducing GPU idle power consumption are setting a power limit via nvidia-smi, using MIG partitioning, or unloading the model when there are no requests, rather than relying on environment variables of uncertain origin.
NVIDIA introduced MIG technology in the Ampere architecture in 2020, allowing a single physical GPU to be partitioned into up to 7 independent instances.
Kubernetes原生不具备感知GPU的能力，GPU设备插件以DaemonSet形式运行在每个GPU节点上，用户可通过nvidia.com/gpu声明申请GPU；GPU不支持超卖，除非使用MIG或MPS等虚拟化技术
GPU不支持超卖，一张卡要么整卡分配要么不分配，除非使用MIG或MPS等虚拟化技术
All Facts (11)
NVIDIA's MIG technology enables hardware-level resource isolation on high-end GPUs such as the A100/H100.
80%UnverifiedNVIDIA MIG仅支持A100/H100等高端卡且切分粒度有限，vGPU方案需要额外购买商业许可证
85%UnverifiedNVIDIA's MIG technology allows a single GPU to be partitioned into multiple independent instances, capable of raising resource utilization from the 30–50% of traditional approaches to higher levels.
70%UnverifiedMIG has relatively coarse granularity and fixed partitioning schemes, making it unable to fully replace software-level time-slicing scheduling.
50%UnverifiedNVIDIA's MIG is only available on data-center-grade cards (such as A100 and H100) and is not supported on consumer-grade RTX cards.
50%UnverifiedGreen Contexts share similar goals with MIG and MPS (improving GPU utilization and isolation) but differ in positioning: MIG is a hardware physical partition with the strongest isolation but lower flexibility, MPS targets multi-process sharing, and Green Contexts provides finer-grained programmatic control within a single process.
50%UnverifiedMore reliable methods for reducing GPU idle power consumption are setting a power limit via nvidia-smi, using MIG partitioning, or unloading the model when there are no requests, rather than relying on environment variables of uncertain origin.
50%UnverifiedNVIDIA introduced MIG technology in the Ampere architecture in 2020, allowing a single physical GPU to be partitioned into up to 7 independent instances.
50%UnverifiedKubernetes原生不具备感知GPU的能力，GPU设备插件以DaemonSet形式运行在每个GPU节点上，用户可通过nvidia.com/gpu声明申请GPU；GPU不支持超卖，除非使用MIG或MPS等虚拟化技术
50%UnverifiedGPU不支持超卖，一张卡要么整卡分配要么不分配，除非使用MIG或MPS等虚拟化技术
50%UnverifiedMIG是NVIDIA在Ampere架构（A100，2020年）中引入的特性，提供真正硬件级隔离
50%