Blog Feed Post

Built from the Roots of Synthetic Monitoring: Our Story

Synthetic monitoring has been around in the tech industry for over two decades and its adoption rate has only been rising year after year. With that, the number of companies who claim to offer synthetic monitoring has also been steadily increasing.

Prior to starting Catchpoint, our founders were responsible for some of the largest infrastructures in the world and used synthetic monitoring tools on a daily basis. After realizing there were certain challenges that needed to be addressed to provide an efficient digital experience, they decided to build their own tool to do the job.

According to our founders, there were four major challenges the current tools in the market could not overcome, as listed below:

Challenge #1: In the beginning stages of monitoring, there were a handful of companies who offered synthetic monitoring services that primarily focused on actively monitoring web applications from the end users’ perspectives, i.e. monitoring from different cities and ISPs. While the core monitoring methodology of these companies was correct, they failed to reduce the MTTR.

Challenge #2: The companies that emerged later adopted the strategy of building low-cost synthetic monitoring solutions. It failed to serve its purpose, though, because the adopted methodology was only partially correct.

Challenge #3: The Internet space evolved over the years with new technologies such as HTML5, single page apps, responsive websites, new caching methodologies, new protocols  (Websockets, HTTP/2, MQTT), and technology providers (DNS, ADC, CDN/Multi-CDN, Cloud/Multi-Cloud, SAAS, etc.) also evolved drastically. However, these synthetic monitoring services failed to adapt, in turn forcing companies to use services from multiple vendors.

Challenge #4: Finally, active monitoring/synthetic monitoring is all about collecting data actively from multiple perspectives and the collected data has multiple recipients – NOC, OPS, DEV, ENGG, marketing, business, vendors, etc. The users should be able to slice and dice the collected data based on their needs; however, almost all of the solutions in the market today have rigid reporting capabilities forcing users to explore yet another solution just to analyze the monitored data in a customized way.

This blog series is an effort to clearly define the synthetic monitoring methodology and establish an efficient way to measure digital experience by addressing all the four challenges highlighted above.

What is Synthetic Monitoring?

In three simple points:

  1. Synthetic monitoring is all about simulating an end user’s action on an application by using real web browsers/applications or emulators
  2. These actions/tests were scripted and built using programs such as Selenium and run on software agents/servers, which are distributed across multiple geographies and ISPs
  3. The actions/tests were configured to run at regular intervals which enabled companies to monitor applications 24/7

While this core methodology worked well, companies who offered monitoring services based on this methodology failed to address the four challenges described above.

Challenge 1: Reduce the mean time to repair (MTTR)

While the traditional synthetic monitoring solutions were good at detecting a problem, they couldn’t pinpoint the root cause of the problem. Which means the users had to run additional tests to isolate the issue and this made it difficult to detect the problem quickly.

Example 1: If a user is unable to access a website because of a DNS error, most synthetic solutions can report the errors, but won’t be able to indicate exactly what is failing within the DNS.

Example 2: If the user’s connection to an application times out, the synthetic solution will not be able to identify the cause of the failure. If the timeout resulted from an ISP failure, multi ISP failure, application failure, etc.

This leads to an incomplete diagnosis of a problem and a poor user experience.


We focused on reducing the MTTR while retaining the core methodology of synthetic monitoring. Catchpoint provides:

  • Intelligent monitoring platform where our monitoring nodes are stateless, which means that if the testing environment is not healthy, the test will not run and this helps avoids false positives.
  • Automated debugging. This replaces the manual troubleshooting required after an alert is triggered. Catchpoint automatically performs debugs such as DIG, DIG + Trace, Traceroute, Ping, Auto Verify tests, intelligent alerts, historical compare, and smartboards to look at all details at a single glance.

These features help reduce the MTTR significantly.

Challenge 2: Partial/incorrect adoption of synthetic monitoring methodology

While companies have adopted the approach of simulating end users actions, many hosted their monitoring nodes/servers on cloud services such as AWS, Softlayer, Azure, etc.

The issue with this approach is that end users don’t access your website or application from those servers. When deciding where to host our nodes, we considered these factors:

  • End users are located across thousands of cities and hundreds of ISPs
  • ISPs are not accountable for successfully delivering your content
  • ISPs must talk to each other, leading to latency and connectivity issues
  • Congested networks
  • CDNs focus at last mile optimization, not monitoring from the ISP is like blindly trusting your vendors


We knew that having a vast number of nodes and global coverage would enable our customers to accurately measure and monitor their applications from an end user’s perspective from any location including:

  • 80+ Countries
  • 180+ Cities
  • 200+ ISPs

Challenge 3: Failing to adapt to evolving technologies and needs

The technology eco-space has evolved drastically and includes new technologies such as:

  • Single Page Applications, IOT, Microservices
  • New protocols Web Sockets, MQTT
  • Simple DNS hosting to managed DNS providers, Application Delivered Controllers, Cloud Load Balancers
  • CDNs have moved on from just network acceleration & caching services to Managed DNS, WAF, FEO, Cloud services, etc.
  • REST & SOAP APIs: Companies are now providers and consumers of APIs, which enables them to integrate themselves with others and vice versa


We created a comprehensive synthetic monitoring solution that will evolve with the industry and technology. Catchpoint provides a comprehensive set of 15 test types:

  1. Web Tests
  2. Web Transactions
  3. API Transactions
  4. DNS Experience
  5. PING
  6. TCP
  7. Traceroute (ICMP, TCP, UDP)
  8. FTP
  9. SMTP
  10. Websockets
  11. SSH
  12. IMAP
  13. NTP
  14. SMTP
  15. MQTT

Additional features enable companies to capture custom metrics of your choice, evaluate vendor performance and your SLAs, and more.

Challenge 4: Rigid reporting

As discussed above, synthetic monitoring is all about collecting and analyzing data from multiple perspectives. Every company has a unique approach to analyze data, and catering to their needs is extremely important to ensure optimal value. This is the biggest limitation that is pushing users to either depend on their own spreadsheets and pivot charts or to buy third-party tools for data analysis.


The fact that the founders of Catchpoint were already familiar with similar solutions enabled them to understand the features and flexibility that the user expected from these tools. Catchpoint data analysis and reporting were built to address these challenges.

We offer 35+ metrics to choose from and provide flexibility for slicing and dicing data within the UI.

In addition to this, Catchpoint offers custom visualizations to enable users to build custom charts and graphs. Users can access their data from Catchpoint by integrating third-party tools, such as DataDog or Slack, using Webhooks and REST API.


Today’s digital landscape requires a monitoring platform that can:

  • Provide a comprehensive solution that covers the monitoring of all types of end points
  • Monitor from cities across geographies and ISPs – monitoring from the cloud is not an accurate measure of end-user experience
  • Modern monitoring features that can monitor and measure all the modern technologies
  • Intelligent solutions that can auto debug issues and in turn reduce MTTR

In our next blog, we will discuss different types of monitoring nodes/servers and when to use them.


The post Built from the Roots of Synthetic Monitoring: Our Story appeared first on Catchpoint's Blog - Web Performance Monitoring.

Read the original blog entry...

More Stories By Mehdi Daoudi

Catchpoint radically transforms the way businesses manage, monitor, and test the performance of online applications. Truly understand and improve user experience with clear visibility into complex, distributed online systems.

Founded in 2008 by four DoubleClick / Google executives with a passion for speed, reliability and overall better online experiences, Catchpoint has now become the most innovative provider of web performance testing and monitoring solutions. We are a team with expertise in designing, building, operating, scaling and monitoring highly transactional Internet services used by thousands of companies and impacting the experience of millions of users. Catchpoint is funded by top-tier venture capital firm, Battery Ventures, which has invested in category leaders such as Akamai, Omniture (Adobe Systems), Optimizely, Tealium, BazaarVoice, Marketo and many more.

Latest Stories
Evan Kirstel is an internationally recognized thought leader and social media influencer in IoT (#1 in 2017), Cloud, Data Security (2016), Health Tech (#9 in 2017), Digital Health (#6 in 2016), B2B Marketing (#5 in 2015), AI, Smart Home, Digital (2017), IIoT (#1 in 2017) and Telecom/Wireless/5G. His connections are a "Who's Who" in these technologies, He is in the top 10 most mentioned/re-tweeted by CMOs and CIOs (2016) and have been recently named 5th most influential B2B marketeer in the US. H...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
As you move to the cloud, your network should be efficient, secure, and easy to manage. An enterprise adopting a hybrid or public cloud needs systems and tools that provide: Agility: ability to deliver applications and services faster, even in complex hybrid environments Easier manageability: enable reliable connectivity with complete oversight as the data center network evolves Greater efficiency: eliminate wasted effort while reducing errors and optimize asset utilization Security: implemen...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
DXWorldEXPO LLC announced today that ICOHOLDER named "Media Sponsor" of Miami Blockchain Event by FinTechEXPO. ICOHOLDER give you detailed information and help the community to invest in the trusty projects. Miami Blockchain Event by FinTechEXPO has opened its Call for Papers. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Miami Blockchain Event by FinTechEXPO also offers s...
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
@DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises - and delivering real results.
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
DXWorldEXPO LLC announced today that Dez Blanchfield joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Dez is a strategic leader in business and digital transformation with 25 years of experience in the IT and telecommunications industries developing strategies and implementing business initiatives. He has a breadth of expertise spanning technologies such as cloud computing, big data and analytics, cognitive computing, m...
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
DXWorldEXPO LLC announced today that Kevin Jackson joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Kevin L. Jackson is a globally recognized cloud computing expert and Founder/Author of the award winning "Cloud Musings" blog. Mr. Jackson has also been recognized as a "Top 100 Cybersecurity Influencer and Brand" by Onalytica (2015), a Huffington Post "Top 100 Cloud Computing Experts on Twitter" (2013) and a "Top 50 C...
There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...