Welcome!

Blog Feed Post

Application Insights – 15 things every developer needs to know

Application Insights is Microsoft’s lightweight application performance monitoring service. I have collected a nice list of things that every developer should know. Including tips, key features, and limitations.

1. Make sure your app targets .NET 4.6, and .NET 2.0 is not supported

There are some changes in the 4.6 version of the .NET framework that enable some additional data collection abilities for Application Insights. Be sure to update your app and redeploy it. App Insights will work with 4.5 or newer but 4.6 is preferred.

I know it sounds crazy, but you wouldn’t believe how many people have older apps written in 2.0 that they still have to support and have never been upgraded. App Insights does not support 2.0 and they don’t have any plans to do so.

2. Warning! Sensitive data is not scrubbed from dynamic SQL queries

If your code uses dynamic SQL, Application Insights will collect the full query and upload it to Azure. This means if the query contained personal information, credit card numbers, or anything else that could be sensitive, it is getting uploaded from your server to Microsoft.

Another thing to know on this topic, App Insights never collect SQL parameters.

3. Key limitation: Finding slow SQL queries

Application insights provides reporting down to the server and database name being accessed. There is no to see how long individual queries take, which are the slowest, or being called the most often. There is also no way to setup monitoring for a specific SQL query.

To get a list of slow SQL queries, you would need to query SQL Server’s DMVs or use a different APM solution. If you are using SQL Azure it is has some built in tuning advisor functions for this too.

4. Azure App Services require a site extension for all features

You can add Application Insights to your project and deploy it to Azure as an App Service. App Insights will seem to work, but there are some things that don’t work until you install the site extension. You can install it via the Azure Portal. I specifically noticed full SQL queries were not collected without it.

5. View top exceptions in your application

Application insights has good reporting to group application exceptions so you can uniquely see which ones are occurring and how often.

application insights exceptionshttp://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1350w" sizes="(max-width: 600px) 100vw, 600px" />

How to send exceptions to App Insights

To ensure that all of your exceptions are collected you must install their SDK and make some code and config changes.

  1. Modify code to collect unhandled exceptions for MVC, global.asax, etc.
  2. If you use log4net, NLog, etc you can configure it to send your exceptions
  3. Manually report exceptions via their SDK if needed

Limitations and missing exceptions features

App Insights is missing some key features around exceptions. If you are having SQL timeouts for example, odds are they impact multiple applications. App Insights has no reporting across apps to easily see this.

  1. No way to see exceptions across all applications
  2. Some other APM solutions don’t require any code or config changes to collect unhandled exceptions
  3. No way to collect all “first chance” exceptions

Retrace can collect all exceptions, including first chance exceptions, with no code changes.

6. Asynchronous HttpClient calls are not supported

Almost all new ASP.NET development is now done in async and uses the common async/await pattern. Unfortunately, Application Insights does not support the recommended way to make HTTP calls with ASP.NET.

        public async Task HttpClientAsync()
        {
            log.Debug("Starting HttpClient.GetStringAsync()");
            string data;
            using (HttpClient hc = new HttpClient())
            {
                data = await hc.GetStringAsync("http://microsoft.com");
            }

            log.Debug("Completed HttpClient.GetStringAsync()");

            return Request.CreateResponse(HttpStatusCode.OK, data);
        }

App Insights does pick up the 2 logging messages via log4net, but doesn’t show anything for dependency calls.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 600px) 100vw, 600px" />

It does see it, it just doesn’t associate it with the ASP.NET web request.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 600px) 100vw, 600px" />

7. Tracking application dependencies

App Insights supports tracking dependency calls in your code. Microsoft’s documentation says SQL databases, HTTP calls, and Azure storage libraries are supported. Anything else requires using their SDK to manually track each dependency call.

Limitations

App Insights does not support some other notable key Azure dependencies include Service Bus and redis.

Some other APM solutions also support MongoDB, RavenDB, Elasticsearch, Redis, Memcached, AppFabric, MSMQ, NServiceBus, AWS services and more.

8. View all details for a single web request (transaction trace)

One of the key features to help track down what a request does is seeing the complete picture of logging, dependency calls, and other key events associated with a single web request.

The best way to do this in Application Insights is to click “All available telemetry for this operation”.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 285w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 974w" sizes="(max-width: 600px) 100vw, 600px" />

 

9. How to Identify why a request or entire application is slow

One suggestion is to customize the chart that you see when filter for a specific operation to add the “dependency duration”. This will help you see how that compares to overall server response time.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 1797px) 100vw, 1797px" />

Application Insights’ map feature can be useful for trying to identify the performance of dependencies. It will tell you the average time and % of failures.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 1082px) 100vw, 1082px" />

I would also suggest going to “Failures” from the menu to look for dependency failures and exceptions.

One thing that would be nice is a visual way to see how each dependency impacts overall performance. When there is a problem with one it is usually easy to see it spike.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 1379px) 100vw, 1379px" />
Screenshot from Retrace

10. Monitoring & Alerts features and limitations

Application Insights supports configuring alerts for a lot of different conditions. Including alerting on metrics like Server Exceptions, Request Rate, Process CPU, etc.

Monitoring limitations

  • No way to monitor a specific request (URL/action)
  • No way to monitor a specific SQL query
  • No way to monitor % of requests having errors
  • Can only monitor averages

Alerting limitations

  • Email or webhooks only
  • Can use a Logic App to send to SMS, Slack, and others
  • No built in concept of alert “escalation”
  • No concept of alert severity like warning vs critical
  • Alerts go to everyone or a hard coded list of emails. No good way to manage distribution lists unless done outside via email groups.

11. Reporting across applications

In Azure Application Insights, each app is more or less a “bucket” that all the diagnostics about each app gets reported to. There is no easy way to see exceptions, slow SQL queries, slow web requests and etc across all of your apps. The only workaround that can provide some very minimal visibility is making a custom dashboard and selecting some widgets across multiple apps.

12. Application Insights does support the concept of multiple “environments” (QA, Prod, etc)

Within an individual application, there is no high level way to separate out and report data by environment (i.e. Dev, QA, Prod). Microsoft has a couple workarounds that they recommend:

  1. Configure a unique “application” via separate instrumentation keys. This works but then there is no reporting across them. They are completely isolated.
  2. Use a custom field for the environement. You would then need to probably make your own dashboards and widgets in App Insights filtered down by that custom field.

13. App Insights is not a code profiler

Most application performance management (APM) solutions use code profiling to do data collection. Microsoft Application Insights does not use profiling. Instead it relies on collecting data via the .NET framework via ETW and other sources.

Because App Insights does not the CLR profiler, it causes a few limitations:

  • Lack of dependency support – The reason Microsoft Application Insights does not support a wide array of 3rd party dependencies is primarily because they don’t do code profiling that would let them instrument the libraries.
  • No custom profiling – One of the very useful features of APM solutions is being able to profile custom methods in your code to track their usage and performance. App Insights doesn’t support this. You would instead need to use their SDK and modify your code to report it.

14. Application Insights has a robust API, and you will likely need it

If you like instrumenting your apps manually to report performance data, you will love Application Insights. They have a robust API and SDKs for several programming languages  (.NET, java, node.js) that let’s you report requests, pages views, dependency calls, trace (log) messages, exceptions and more via their TelemetryClient.

Microsoft’s own description highlights it as being “extensible” as it relies on a lot of custom SDK usages to get rich data.

Application Insights is an extensible Application Performance Management (APM) service for web developers.

If your app uses Elasticsearch, mongodb, redis, or any other dependency and you would like to see it show up in Application Insights on Azure, you will need to change your code and manually report it.

15. How to use Application Insights with Windows Services

If you have a Windows Service type application that you want to track with App Insights, you will have to integrate their API in to your app. Every single place you make a database call, you can simply add a couple lines of code to report the query via their SDK.

As an example, check out this article about using Azure Worker Roles with Application Insights.

Need more than Application Insights?

Application Insights is awesome. However, like any application, it has its limitations and best use cases. I would describe App Insights as a “light APM” solution. If you want to take the time to use their SDK, you can make it do a lot of different things.

However, if you want the best APM available for ASP.NET developers with the entire goal of finding and fixing application problems as fast as possible, checkout Retrace. It is actually written in ASP.NET and is hosted on Azure. Monitoring Azure is our expertise!

Key differences:

  • All major application dependencies supported
  • Excellent reporting across apps and environments
  • Industry leading transaction trace views for developers
  • 100% support for async and .NET Core
  • Included and advanced logging functionality
  • No code or config changes required

The post Application Insights – 15 things every developer needs to know appeared first on Stackify.

Read the original blog entry...

More Stories By Stackify Blog

Stackify offers the only developers-friendly solution that fully integrates error and log management with application performance monitoring and management. Allowing you to easily isolate issues, identify what needs to be fixed quicker and focus your efforts – Support less, Code more. Stackify provides software developers, operations and support managers with an innovative cloud based solution that gives them DevOps insight and allows them to monitor, detect and resolve application issues before they affect the business to ensure a better end user experience. Start your free trial now stackify.com

Latest Stories
Moroccanoil®, the global leader in oil-infused beauty, is thrilled to announce the NEW Moroccanoil Color Depositing Masks, a collection of dual-benefit hair masks that deposit pure pigments while providing the treatment benefits of a deep conditioning mask. The collection consists of seven curated shades for commitment-free, beautifully-colored hair that looks and feels healthy.
The textured-hair category is inarguably the hottest in the haircare space today. This has been driven by the proliferation of founder brands started by curly and coily consumers and savvy consumers who increasingly want products specifically for their texture type. This trend is underscored by the latest insights from NaturallyCurly's 2018 TextureTrends report, released today. According to the 2018 TextureTrends Report, more than 80 percent of women with curly and coily hair say they purcha...
The textured-hair category is inarguably the hottest in the haircare space today. This has been driven by the proliferation of founder brands started by curly and coily consumers and savvy consumers who increasingly want products specifically for their texture type. This trend is underscored by the latest insights from NaturallyCurly's 2018 TextureTrends report, released today. According to the 2018 TextureTrends Report, more than 80 percent of women with curly and coily hair say they purcha...
We all love the many benefits of natural plant oils, used as a deap treatment before shampooing, at home or at the beach, but is there an all-in-one solution for everyday intensive nutrition and modern styling?I am passionate about the benefits of natural extracts with tried-and-tested results, which I have used to develop my own brand (lemon for its acid ph, wheat germ for its fortifying action…). I wanted a product which combined caring and styling effects, and which could be used after shampo...
The precious oil is extracted from the seeds of prickly pear cactus plant. After taking out the seeds from the fruits, they are adequately dried and then cold pressed to obtain the oil. Indeed, the prickly seed oil is quite expensive. Well, that is understandable when you consider the fact that the seeds are really tiny and each seed contain only about 5% of oil in it at most, plus the seeds are usually handpicked from the fruits. This means it will take tons of these seeds to produce just one b...
Steaz, the nation's top-selling organic and fair trade green-tea-based beverage company, announces its 2017 "Mind. Body. Soul." tour, which will bring authentic experiences inspired by the brand's signature Mind. Body. Soul. tagline to life across the country. The tour will inform, educate, inspire and entertain through events, digital activations and partner-curated experiences developed to support the three pillars of complete health and wellness.
The platform combines the strengths of Singtel's extensive, intelligent network capabilities with Microsoft's cloud expertise to create a unique solution that sets new standards for IoT applications," said Mr Diomedes Kastanis, Head of IoT at Singtel. "Our solution provides speed, transparency and flexibility, paving the way for a more pervasive use of IoT to accelerate enterprises' digitalisation efforts. AI-powered intelligent connectivity over Microsoft Azure will be the fastest connected pat...
There are many examples of disruption in consumer space – Uber disrupting the cab industry, Airbnb disrupting the hospitality industry and so on; but have you wondered who is disrupting support and operations? AISERA helps make businesses and customers successful by offering consumer-like user experience for support and operations. We have built the world’s first AI-driven IT / HR / Cloud / Customer Support and Operations solution.
ScaleMP is presenting at CloudEXPO 2019, held June 24-26 in Santa Clara, and we’d love to see you there. At the conference, we’ll demonstrate how ScaleMP is solving one of the most vexing challenges for cloud — memory cost and limit of scale — and how our innovative vSMP MemoryONE solution provides affordable larger server memory for the private and public cloud. Please visit us at Booth No. 519 to connect with our experts and learn more about vSMP MemoryONE and how it is already serving some of...
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understa...
Codete accelerates their clients growth through technological expertise and experience. Codite team works with organizations to meet the challenges that digitalization presents. Their clients include digital start-ups as well as established enterprises in the IT industry. To stay competitive in a highly innovative IT industry, strong R&D departments and bold spin-off initiatives is a must. Codete Data Science and Software Architects teams help corporate clients to stay up to date with the mod...
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility. As they do so, IT professionals are also embr...
Platform9, the leader in SaaS-managed hybrid cloud, has announced it will present five sessions at four upcoming industry conferences in June: BCS in London, DevOpsCon in Berlin, HPE Discover and Cloud Computing Expo 2019.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
When you're operating multiple services in production, building out forensics tools such as monitoring and observability becomes essential. Unfortunately, it is a real challenge balancing priorities between building new features and tools to help pinpoint root causes. Linkerd provides many of the tools you need to tame the chaos of operating microservices in a cloud native world. Because Linkerd is a transparent proxy that runs alongside your application, there are no code changes required. I...