Time Slicing
A GPU scheduling strategy that divides GPU time into small segments and rotates allocation among multiple tasks, reducing wait times for short jobs and improving overall resource utilization. It requires balancing context-switching overhead against response latency.
Timeline (last 90 days)
Ai2's scheduler employs a time-slicing mechanism that allows multiple jobs to run alternately on the same set of GPUs, reducing wait times for short jobs.
The choice of time-slice granularity requires a trade-off between response latency and switching overhead: slices that are too short waste time on state migration, while slices that are too long fail to improve wait times for short jobs.
All Facts (2)
Ai2's scheduler employs a time-slicing mechanism that allows multiple jobs to run alternately on the same set of GPUs, reducing wait times for short jobs.
50%UnverifiedThe choice of time-slice granularity requires a trade-off between response latency and switching overhead: slices that are too short waste time on state migration, while slices that are too long fail to improve wait times for short jobs.
50%