Unverified50% confidenceBenchmarkExact time
On an i5-10300H CPU, the OpenVINO EP in ONNX Runtime delivers inference performance almost exactly identical to the standard CPU EP.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/7/2026
First Seen
Valid until: 2/5/2027
Sources
Related Entities
Related Claims
UnverifiedOpenVINO runtime's Inference Engine automatically selects the optimal execution backend based on the target hardware, invoking code paths optimized for instruction sets such as AVX-512 and AVX2 on CPUs.72% similarUnverifiedOn a quad-core mobile CPU, power walls and thermal limits often cause parallel efficiency to saturate early, and the MLAS-based optimizations of the standard CPU EP are already close to the hardware limit, so OpenVINO's additional graph optimization gains are diluted.71% similarUnverifiedIf a model contains operators unsupported by the OpenVINO EP, falling back to the CPU EP introduces extra overhead that cancels out part of the performance advantage.71% similarUnverifiedIf a model contains a large number of custom operators, the standard CPU EP may be the safest choice; if you want GPU acceleration without being tied to CUDA, DirectML is worth a try; OpenVINO is better suited to scenarios with Intel-specific hardware and validated models.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1146525API
curl https://kongchang.com/api/v1/knowledge/claims/1146525MCP
get_claim(id=1146525)