RAPIDS Accelerator for Apache Spark
An Apache Spark plugin introduced by NVIDIA that uses cuDF and GPUs to accelerate Spark job execution. It achieves columnar batch processing by replacing physical plan nodes, and supports transparent acceleration of SQL, DataFrame, and some UDFs.
Timeline (last 90 days)
The RAPIDS Accelerator for Apache Spark is a Spark plugin provided by NVIDIA based on cuDF that, by replacing nodes in Spark's physical execution plan, lets SQL, DataFrame, and some UDFs execute on the GPU in a columnar batch manner.
When the RAPIDS Accelerator for Apache Spark encounters a custom UDF, it cannot translate it automatically, so a developer or Agent must provide an equivalent implementation executable on the GPU.
All Facts (2)
The RAPIDS Accelerator for Apache Spark is a Spark plugin provided by NVIDIA based on cuDF that, by replacing nodes in Spark's physical execution plan, lets SQL, DataFrame, and some UDFs execute on the GPU in a columnar batch manner.
50%UnverifiedWhen the RAPIDS Accelerator for Apache Spark encounters a custom UDF, it cannot translate it automatically, so a developer or Agent must provide an equivalent implementation executable on the GPU.
50%