Reading time 4 min

It’s important for both technical and business teams to understand the different web performance monitoring options that are available as well as their various use cases and the benefits of each.

Let’s start with a brief definition of two of the more prominent web performance methodologies: synthetic monitoring and real user monitoring (also known as RUM).

Understanding Web Performance Monitoring Methodologies

  1. Synthetic Monitoring. Synthetic monitoring vendors provide a remote (often global) infrastructure that visits a website periodically and records the performance data for each run. The measured traffic is not of your actual users; it is synthetically generated to collect data on page performance.
  2. Real User Monitoring (RUM). Real user monitoring vendors provide an agent (JavaScript) that is injected on each page of a website or application. The agent reports on the page load data for every request that is made for each page. As the name suggests, this technique monitors an application’s actual (real) user interactions.

Synthetic vs RUM

Which Is Best: Synthetic Monitoring or Real User Monitoring?

Both RUM and synthetic monitoring are useful for managing the performance of websites and applications, and the two methodologies work well when paired together. They each bring different – and complementary – information to the table.

For example, in a case study published by Gilt Groupe, Eric Shepherd, who was formerly Gilt’s principal front end engineer, noted that:

Both RUM and synthetic monitoring give different views of our performance, and are useful for different things. RUM helps us understand long-term trends, and synthetic monitoring helps us diagnose and solve shorter-term performance problems.

Now let’s take a deeper dive into six of the benefits that synthetic monitoring provides over real user monitoring.

Six Benefits of Synthetic Monitoring Over Real User Monitoring

  1. Test at Every Stage of Development. Synthetic monitoring can be used to test websites and web applications in pre-production, while real user monitoring can only be used in production. These pre-production test results can be used to baseline performance and set alert thresholds when an application or website is live, but they also can help to prevent performance issues from making it into production at all, when it can be costly and time-consuming to retroactively fix them.
  2. Monitor in a Controlled Environment. Synthetic monitoring actively allows users to monitor the performance of their website or application with a set of controlled variables (geography, network, device, browser, cached vs. uncached) over time. This is valuable because it allows users to block out much of the noise that is reported with real user monitoring. As a result, users can identify latency and downtime promptly, and they can then scientifically isolate and diagnose the root cause of any performance issues that may arise.
  3. AB Test the Performance Impact of Third Parties. AB Test the Performance Impact of Third Parties. Synthetic monitoring affords users the ability to create tests that exclude or include third-party assets. This allows site admins to easily demonstrate to other stakeholders the performance impact of a particular third party. For example, an engineering lead could create a test that excludes a problematic marketing plugin and run the test side-by-side with another test that includes the plugin to clearly show the impact of the plugin on availability and performance. A user could also leverage synthetic monitoring to quantify the impact of switching third-party ad providers or their CDN.
  4. Benchmark Against Competitors. Because synthetic monitoring doesn’t require any installation or code injection on a website to start, users can easily monitor the performance of any of their competitors’ websites and applications. Then, they can effectively benchmark their own performance against those key competitors over time.
  5. Benchmark Against Competitors - Synthetic

  6. Run 24/7 Monitoring. If an issue arises during off-hours or other low-traffic periods, synthetic monitoring provides the insight you need to quickly identify, isolate, and resolve problems before they affect users and negatively impact both revenue and brand equity.
  7. Baseline and Analyze Performance Trends Across Geographies. With synthetic monitoring, baseline tests can be set up to mirror the way your end-users truly access your applications. These baseline tests can monitor key transactions from a wide range of geographic locations while testing from multiple browsers and devices.

Takeaways

The key to a holistic view of your website or application’s user experience is to harness the power of both real user monitoring and synthetic monitoring. Synthetic monitoring has many important strengths, and a synthetic-only approach to web performance can be beneficial. However, understanding the benefits of a real user monitoring platform and then incorporating it as part of a broader web performance strategy can provide additional, critical insight to ensure that a site or application is not only fast but also tailored toward the needs of the real end-users.

About Rigor

Rigor combines synthetic monitoring with an intelligent optimization engine to not only find performance issues but also to deliver a prioritized list of actionable fixes. For more information about how Rigor can help your business find, fix, and prevent the performance issues that affect UX, reach out for a free trial.

Suggested Blog Posts

The Perception Gap for Poor Web Performance

E-commerce revenue continues to grow,as consumers turn away from shopping in brick-and-mortar stores to shopping online.  However, many businesses are not prepared for this growth because they do not fully understand the market and how to invest in...

Read More

Using Browser Trends to Maintain a Better Site

Because of the multifarious nature of web clients today, it’s important to consider the usage statistics when designing, implementing, and managing your site. However, misconceptions often arise when determining what browsers to design...

Read More

Finding Causes of Intermittent Errors from Google Webmaster Tools

Google Webmaster Tools is a web service that allows webmasters to view the status of their sites as seen by Google and the Googlebot crawlers. In addition to indexing your site structure and content, the Googlebot crawlers also record data on perform...

Read More

Optimization Options not Always Optimal

Web designers and developers are always looking for ways to speed up their page load times. Yahoo has an excellent article written on the best practices for speeding up your page. How do you know if implementing one of their suggested practices will...

Read More