FLOPS Calculator: Peak GFLOPS, TFLOPS for CPU and GPU

FLOPS Calculator

Estimate theoretical peak floating-point throughput from cores times clock times FLOPs per cycle. Choose a CPU SIMD ISA such as AVX2 or AVX-512, or switch to GPU mode using shaders times two for the fused multiply-add, then scale by FP16, FP32, or FP64 precision and multiply across every socket or GPU to read GFLOPS, TFLOPS, and the FP64 rate.

🖥Choose a Compute Type

🎯Real CPU and GPU Presets

📝Hardware Inputs

Physical cores that run the SIMD units.

Total FP32 lanes across all streaming units.

All-core boost clock in GHz, not the base clock.

FMA is fused multiply-add, so it counts as 2 FLOPs.

Enter FLOPs per cycle directly if ISA is Custom.

Sets the main result rate relative to FP32.

Fraction of FP32 throughput available at FP64.

Number of identical CPUs or GPUs in the system.

Peak GFLOPS 0 per single chip
Peak TFLOPS 0 per single chip
FP64 rate 0 double precision TFLOPS
Total across all chips 0 selected precision

🔢Formula Snapshot

C x f x kcores clk fpc
FMA2 FLOPs
1e121 TFLOPS
x Nsockets / GPUs

📋FP32 FLOPs per Cycle by ISA

Instruction SetSIMD WidthFP32 per CycleNotes
Scalar x87 / SSE132 to 128-bit21 add + 1 mul or FMA
SSE2 to SSE4 + FMA3128-bit84 lanes, mul and add
AVX (no FMA)256-bit168 lanes add and mul
AVX2 + FMA3256-bit168 lanes fused per port
AVX-512 single FMA512-bit3216 lanes fused
AVX-512 dual FMA512-bit64Two 512-bit FMA ports
Arm NEON + FMA128-bit84 lanes, Apple and Arm
Arm SVE2 256-bit256-bit16Server scalable vectors

📊Precision Scaling Factors

PrecisionBitsCPU vs FP32Consumer GPUData-Center GPU
FP16 half16-bit2x (with support)1x to 2x2x to 4x
BF16 brain float16-bit2x1x to 2x2x to 4x
FP32 single32-bit1x baseline1x baseline1x baseline
TF32 tensor19-bitnot nativevariesup to 8x tensor
FP64 double64-bit1/21/16 to 1/321/2

📏FLOPS Unit Scale

UnitSymbolFLOPSTypical Example
KiloflopskFLOPS1e31960s early computers
MegaflopsMFLOPS1e61980s workstations
GigaflopsGFLOPS1e9Single desktop core
TeraflopsTFLOPS1e12Modern GPU or CPU
PetaflopsPFLOPS1e15Large GPU cluster
ExaflopsEFLOPS1e18Frontier-class systems

🗃Real CPU and GPU Peak FLOPS Comparison

ChipTypeCores / ShadersClockFP32 per CyclePeak FP32
Ryzen 9 7950XCPU AVX2164.5 GHz16~1.15 TFLOPS
Core i9-13900KCPU AVX2243.9 GHz16~1.5 TFLOPS
Xeon Platinum 8480CPU AVX-512562.9 GHz64~10.4 TFLOPS
EPYC 9654CPU AVX-512963.55 GHz32~10.9 TFLOPS
Apple M2 MaxCPU NEON123.68 GHz8~0.35 TFLOPS
RTX 4090GPU FP32163842.52 GHz2~82.6 TFLOPS
RX 7900 XTXGPU FP3261442.5 GHz2~61.4 TFLOPS
NVIDIA A100GPU FP6469121.41 GHz2~19.5 FP32 TFLOPS
NVIDIA H100 SXMGPU FP32168961.98 GHz2~67 TFLOPS
Threadripper 7980XCPU AVX-512643.2 GHz32~6.6 TFLOPS

Formula Breakdown

Peak = C x f x kTheoretical peak FLOPS equals cores C times clock frequency f in hertz times FLOPs per cycle per core k. Clock in GHz is multiplied by 1e9 to reach hertz.
FMA counts as 2A fused multiply-add does a multiply and an add in one instruction, so each FMA lane contributes 2 FLOPs. That is why AVX2 on 8 FP32 lanes gives 16 FLOPs per cycle.
SIMD width sets kWider vectors process more lanes at once. FP32 lanes are width in bits divided by 32, then doubled for FMA. SSE gives 8, AVX2 gives 16, AVX-512 gives 32.
GPU = S x 2 x fA GPU peak is shader or CUDA core count S times 2 for FMA times boost clock f in hertz. An RTX 4090 with 16384 cores at 2.52 GHz reaches about 82.6 TFLOPS.
Precision ratioFP16 is often 2x FP32. FP64 is half of FP32 on CPUs and data-center GPUs, but only 1/16 to 1/32 on consumer gaming GPUs.
Scale to readable unitsDivide FLOPS by 1e9 for GFLOPS, 1e12 for TFLOPS, and 1e15 for PFLOPS. A result of 1.15e12 FLOPS reads as 1.15 TFLOPS.
Total = per-chip x NMultiply one chip by the number of sockets or GPUs N. Two identical GPUs at 40 TFLOPS each give 80 TFLOPS of aggregate peak.

💡FLOPS Estimation Tips

Use the all-core boost, not base: Peak FLOPS scales linearly with clock, so plugging in a 3.0 GHz base instead of a sustained 4.5 GHz all-core boost understates throughput by a full third. AVX-512 workloads often clock 300 to 700 MHz below the advertised single-core boost because the wide units draw more power, so use a realistic sustained figure rather than the marketing peak.
Peak is not delivered performance: This tool reports theoretical peak, which assumes every core issues a fused multiply-add every single cycle with no stalls. Real LINPACK efficiency is typically 60 to 90 percent on CPUs and 70 to 95 percent on GPUs once memory bandwidth and cache misses are counted, so multiply the peak by roughly 0.7 to 0.9 to estimate achievable FLOPS.

If you’ve seen marketing materials from contemporary processors, chances are you saw a lot about core count and clock speed. Those aren’t interchangeable units of processing power. A processor with fewer instructions and a very fast clock speed will often perform worse than a processor with a wider vector width and a slower clock. Floating point operations per second (FLOPS) are the best direct measurement of raw computing power. Why? Because it takes into account all variables without cherry-picking what looks good.

How many cores? How fast do those cores spin? And how much can a given core gets done during each clock cycle? Hype be damned. Here’s the simple formula for theoretical peak FLOPS. Take the frequency in hertz and multiply it by the number of parallel execution units. Multiply again by the number of FLOPs they completes each cycle. This last bit is where most people get tripped up.

The Real Way to Measure Computer Power

More cores isn’t everything. You also need to account for what your cores are doing. Today’s processors use SIMD, which stands for single instruction multiple data, to process information in vectors. They process a vector of numbers simultaneously. An AVX2 256-bit register contains eight thirty-two-bit floats. Every lane gets hit with one instruction. Small features of architecture have huge impacts. One such feature is called Fused Multiply-Add, or FMA. It do a multiply-and-add in a single operation, meaning it’s two floating-point operations.

One instruction touches all eight AVX2 lanes. Multiply that times two (operations) and you get sixteen FP32 FLOPs out of a single core, per cycle. That’s eight using narrower SSE instructions. AVX-512 has a wider lane count of thirty-two. For servers, double the number of FMA units and we’re at sixty-four.

Plug all this into calculator, and it will do the math for you. No need to remember coefficients; it shows why wider vectors are useful. For servers, double the number of FMA units and we’re at sixty-four. Plug all this in the calculator, and it will do the math for you. No need to remember coefficients; it demonstrates value of wider vectors.

The same idea applies for graphics processors, though they do things differently. A GPU consists of thousands of tiny shader core, while a CPU typically has a couple dozen wider cores. Since each shader core can executes an FMA every cycle, the equation is: (shader count x 2) x clock frequency. With more than sixteen thousand shaders operating near 2.5 GHz on an RTX 4090, that’s more than eighty teraflops of peak single-precision performance. On the GPU side, we swap out the core count for a shader count and tweak the per-lane number so it matches up. That way, you don’t have to plug numbers into a calculator and hope your math was right to get a meaningful comparison between a gaming card and a server CPU.

All else is secondary to precision. Double precision is the pricey choice; double precision on consumer gaming cards can be throttled down to a fraction (sometimes as low as 1/32), since most games don’t need that amount of accuracy. FP64 on data center CPUs and GPUs will usually run at half the speed of FP32. Single precision is the workhorse. Half precision at sixteen bits often runs twice as fast because two numbers fit into the space one would otherwise take up. The tool separates out this double-precision speed and puts it in its own result card, which is key if you’re not rendering frames but rather running some sort of scientific simulation.

All FLOPS numbers come with one honest caveat. The number generated above is a theoretical peak. That means we assume there are no memory bottlenecks. We also assume there are no cache misses or stalls. Finally, we assume each core spits out a full vector once a cycle. Of course, real workloads don’t hit that ceiling. Well-tuned benchmark code may reach seventy to ninety percent of the peak. And ordinary code will run much lower because it is limited by something other than the ability to do math, usually bandwidth. So think of the peak value as an upper bound but not a guarantee.

Use a preconfigured spec like the Ryzen 9 7950X to see what a familiar set of specs decomposes into in terms of clock speed, cores, and FLOPs per cycle. Now adjust them one at a time. Double the clock? Yes, peak doubles. Change from single to double precision? Yes, the rate drops. Need an answer for your render farm size, or wondering how your spec sheet breaks down into teraflops? This clear calculation provides an answer based off the simple fact of multiplying cores by clock speed and operations per cycle.

You should of used this before.

FLOPS Calculator: Peak GFLOPS, TFLOPS for CPU and GPU