Its not about geometry, it's a parallel compute thing thing. CPUs typically don't have more than 10 or 20 cores. GPU have 100s to 1000s.

Matmul is very well parallelized. More, lower power cores will always pay off handsomely.