Abstract
- A Multi-core Chip with thousands of tiny cores
Optimised for Parallel Computing
Look at the CPU Core it has!
Game rendering
So many cores allows us to perform a ton of linear algebra calculation for game graphic rendering.
Great for training AI
AI training involves a ton of Matrix Multiplication on dataset which can be done independently.
Hard to program
That is why we have Nvidia’s CUDA Toolkit which utilises GPU’s parallel computing for general purpose computing.
Comparison with CPU
- CPU one core is way more power, and able to handle complication logics like Pipeline Branching and a lot of the real world application needs to run Instruction in a sequential manner
- GPU shines when we need Parallelism (并行性) and the workload doesn’t depend on each other