Parallel Processing

CUDA is a parallel computing platform and API model created by NVIDIA for leveraging GPU power.

NCCL is a library developed by NVIDIA for high-performance collective communication in GPU applications.