Compare gpu cloud providers by price and performances
OVH Gpu pricing and many more. Check our Introduction to GPU performances in italian
A PFLOPSDAY is a unit of computing equivalent to the number of math operations performed by a computer with a capacity of 10^15 ops/sec for an entire day. It is just a handy way to say 86_400_000_000_000_000_000 math operations.
The training of GPT-3 (175B parameters) required a whooping figure of 4000 PFLOPSDAY(s) 😮