How to Revolutionize Your Browser Performance Testing with JetStream 3

By ● min read

Introduction

The web evolves fast, and so must the tools we use to measure its performance. JetStream 3, the latest collaboration between Apple, Google, and Mozilla, introduces critical updates to benchmark scoring—especially for WebAssembly (Wasm). This guide will walk you through the key problems in previous benchmarks, the innovative solutions in JetStream 3, and how you can apply these lessons to your own performance testing. By the end, you'll understand why traditional metrics fail and how JetStream 3 sets a new standard.

What You Need

• Access to a modern browser (e.g., Safari Technology Preview, Chrome Canary, Firefox Nightly) that supports JetStream 3.
• JetStream 3 benchmark suite (available at the official JetStream website).
• Basic understanding of JavaScript and WebAssembly concepts (helpful but not required).
• A performance testing environment (a quiet machine, closed apps, consistent power settings).
• Optional: Browser developer tools for deeper analysis of subtest results.

Step 1: Recognize the Limits of Outdated Benchmarks

Older benchmarks like JetStream 2 were designed for a different era of the web. They measured WebAssembly (Wasm) in two separate phases: startup and runtime. This made sense when Wasm was used mainly for large C/C++ applications that tolerated a long initial load in exchange for high throughput. Over time, browser engines optimized startup so heavily that for small workloads, startup time effectively hit zero milliseconds in Date.now() measurements. This created an infinity problem—a score of 5000 / 0 produced infinity, breaking the scoring system. If your current benchmark still uses such phase-based scoring, it's likely masking real performance.

Step 2: Understand the Infinity Problem

When engines like WebKit reduced instantiation time from 100 ms to 2 ms, micro-optimizations that were once noise (0.1 ms) suddenly became 5% improvements. JetStream 2.2 had to patch the harness to clamp scores to 5000 to avoid infinite values. This is a red flag: the benchmark no longer accurately reflects user experience. The infinity problem taught us that a benchmark must evolve alongside engine improvements, or it becomes a target for narrow optimizations that don't help real-world applications.

Step 3: Learn How JetStream 3 Rethinks WebAssembly Benchmarking

JetStream 3 abandons separate startup and runtime phases for Wasm. Instead, it integrates Wasm into larger, realistic workflows where instantiation is part of the critical path. For example, Wasm is now used in image decoders, UI frameworks, and JavaScript libraries—scenarios where a zero startup time in a microbenchmark doesn't reflect the full cost in a complex page load. The new suite uses higher-resolution timing (via performance.now()) and applies weighted scoring that accounts for the frequency and impact of different operations. To see the change, compare a Wasm subtest in JetStream 2 versus JetStream 3; the latter will show more nuanced results that reveal where engines still lag.

Step 4: Evaluate the Shift from Microbenchmarks to Realistic Scales

JetStream 3 emphasizes scale—modern web applications are large and interconnected. The suite includes tests that simulate multi-page interactions, large DOM trees, and heavy JavaScript bundles. This mirrors how users actually experience performance. When testing, focus on overall scores rather than individual sub-scores, and look for consistency across multiple runs. If an engine scores high in small microbenchmarks but low in JetStream 3's integrated tests, it may have over-optimized for trivial workloads.

Step 5: Apply JetStream 3 Insights to Your Own Performance Testing

Use these lessons to design your own benchmarks:

1. Avoid phase-based scoring for operations that can be instant—integrate them into complete user journeys.
2. Use high-resolution timers like performance.now() to capture sub-millisecond differences.
3. Weight workloads by real-world frequency (e.g., a common UI update should have less weight than a rare heavy computation).
4. Test for an entire session—load multiple pages, interact with elements, and measure cold and warm startup.
5. Regularly update benchmarks to match current web best practices or they will become optimization targets rather than measurement tools.

Tips for Getting the Most Out of JetStream 3

• Run multiple trials—at least three—and report the median score to reduce variance.
• Close all other tabs and applications to minimize background noise.
• Compare across browsers using the same hardware to see how different engines handle the new workload mix.
• Use the developer console to examine subtest timings; JetStream 3 exposes a detailed results table.
• Watch for score clamping—if you see repeating scores of 5000, the benchmark may still have edge cases where infinity protection kicks in.
• Keep your browser updated—new engine optimizations may shift scores significantly.

Conclusion

JetStream 3 marks a fundamental shift in how we measure web performance, moving away from artificial phases and toward realistic, integrated workloads. By understanding the infinity problem and the new approach to WebAssembly, you can avoid misleading metrics and focus on what matters: real user experience. Use this guide to run, interpret, and apply JetStream 3 results in your own performance work.