Why is my Lighthouse score different from PageSpeed Insights?

21 Aug 2019

This article will explain why you might see score and metric differences between PageSpeed Insights (or web.dev) and other tools.

Other tools might be:

  • Running Lighthouse on your local machine
  • Monitoring your page with DebugBear
  • Using other Lighthouse-based monitoring tools

Client locations

If you live in the UK, opening a website that's hosted in London will be faster than opening one that's hosted in New York.

PageSpeed Insights picks the server based on your current location. There are four locations:

  • Northwestern US (Oregon)
  • Southeastern US (South Carolina)
  • Northwestern Europe (Netherlands)
  • Asia (Taiwan)

DebugBear tests pages from a server in South Carolina by default.

If access to the site you want to analyze is restricted by the user's location DebugBear uses a proxy to show a regional IP to the website. This adds around 10ms to each request.

Network throttling

To achieve realistic and consistent results, Lighthouse uses a throttled network connection to analyze pages. However, there are different ways of throttling the connection.

PageSpeed Insights loads the page without any throttling, and then simulates how the page might have loaded on a slower connection.

DebugBear throttles the local network connection and then loads the page. This is more realistic, but also takes more time and increases variance between analyses.

Read more about the different throttling methods and the impact they have.

CPU performance

If a site runs a lot of JavaScript code or requires complex layout computations, a faster CPU will make the page load faster.

Every time Lighthouse analyzes a page it runs a very simple benchmark. The DebugBear servers reach a score around 540, while PageSpeed Insights reports a score around 660. So the PSI servers are slightly faster.

HTTP/2

PageSpeed Insights currently doesn't support HTTP/2 and the HTTP/2 audit is disabled. If you run Lighthouse locally or use DebugBear, HTTP/2 is correctly detected and supported.

Chrome version

What Chrome version is used can affect performance as well. For example, newer versions may have performance improvements that make them faster.

As of September 2019 PSI uses Chrome 74 while DebugBear uses Chrome 75.

Different timeout settings

If the page doesn't render or finish loading after a certain amount of time Lighthouse will give up and finish the page analysis. This might be before the page actually finished loading.

Here are the timeout settings as of September 2019:

Waiting for... PageSpeed Insights DebugBear
First Contentful Paint 15 45s
Load 35s 120s

Note that because PSI uses simulated throttling it can generally get away with lower timeouts than a tool like DebugBear that actually slows down the page load.

What are the right values?

So what tool takes the best measurements, PageSpeed Insights, running Lighthouse locally, or using a hosted tool like DebugBear?

Lab-based testing can only ever generate a snapshot of how your page behaves in a certain environment. How well that snapshot reflects the experience of your users depends on what the environment that your users load your page in looks like.

If you want to find out how fast your site is for real users you need to capture performance data for real users.

DebugBear is a website monitoring tool built for front-end developers. Track performance metrics and Lighthouse scores in CI and production. Learn more.

Get new articles on web performance by email.

© 2019 DebugBear Ltd