Databricks tests have similar results
Databricks, a large service bureau, has the scale, expertise, and incentive to do things carefully. There are small differences that would change with a different set of tests. These numbers are strongly suggestive of very rough parity between the chips on the market in December 2023. Intel & AMD are not far behind Nvidia,
|FP16 or BF16 TFLOP/s
|HBM Memory (GB)
|Peak Power Consumption
|Rack Units (RU)
PR types, reporters, and salesmen find small differences and shout them to the rooftops. In practice, the benchmarks have so many limits that small differences mean little. Extrapolating to real-world use adds further sources of error.
There are lies, damned lies, and benchmarks. They are notoriously unreliable. Companies choose the most favorable ones and the options that make them shine. Some train on the data in the benchmark.
Huawei has a high-performance chip which rarely is considered outside China.