Welcome!

Blog Feed Post

Application Insights – 15 things every developer needs to know

Application Insights is Microsoft’s lightweight application performance monitoring service. I have collected a nice list of things that every developer should know. Including tips, key features, and limitations.

1. Make sure your app targets .NET 4.6, and .NET 2.0 is not supported

There are some changes in the 4.6 version of the .NET framework that enable some additional data collection abilities for Application Insights. Be sure to update your app and redeploy it. App Insights will work with 4.5 or newer but 4.6 is preferred.

I know it sounds crazy, but you wouldn’t believe how many people have older apps written in 2.0 that they still have to support and have never been upgraded. App Insights does not support 2.0 and they don’t have any plans to do so.

2. Warning! Sensitive data is not scrubbed from dynamic SQL queries

If your code uses dynamic SQL, Application Insights will collect the full query and upload it to Azure. This means if the query contained personal information, credit card numbers, or anything else that could be sensitive, it is getting uploaded from your server to Microsoft.

Another thing to know on this topic, App Insights never collect SQL parameters.

3. Key limitation: Finding slow SQL queries

Application insights provides reporting down to the server and database name being accessed. There is no to see how long individual queries take, which are the slowest, or being called the most often. There is also no way to setup monitoring for a specific SQL query.

To get a list of slow SQL queries, you would need to query SQL Server’s DMVs or use a different APM solution. If you are using SQL Azure it is has some built in tuning advisor functions for this too.

4. Azure App Services require a site extension for all features

You can add Application Insights to your project and deploy it to Azure as an App Service. App Insights will seem to work, but there are some things that don’t work until you install the site extension. You can install it via the Azure Portal. I specifically noticed full SQL queries were not collected without it.

5. View top exceptions in your application

Application insights has good reporting to group application exceptions so you can uniquely see which ones are occurring and how often.

application insights exceptionshttp://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1350w" sizes="(max-width: 600px) 100vw, 600px" />

How to send exceptions to App Insights

To ensure that all of your exceptions are collected you must install their SDK and make some code and config changes.

  1. Modify code to collect unhandled exceptions for MVC, global.asax, etc.
  2. If you use log4net, NLog, etc you can configure it to send your exceptions
  3. Manually report exceptions via their SDK if needed

Limitations and missing exceptions features

App Insights is missing some key features around exceptions. If you are having SQL timeouts for example, odds are they impact multiple applications. App Insights has no reporting across apps to easily see this.

  1. No way to see exceptions across all applications
  2. Some other APM solutions don’t require any code or config changes to collect unhandled exceptions
  3. No way to collect all “first chance” exceptions

Retrace can collect all exceptions, including first chance exceptions, with no code changes.

6. Asynchronous HttpClient calls are not supported

Almost all new ASP.NET development is now done in async and uses the common async/await pattern. Unfortunately, Application Insights does not support the recommended way to make HTTP calls with ASP.NET.

        public async Task HttpClientAsync()
        {
            log.Debug("Starting HttpClient.GetStringAsync()");
            string data;
            using (HttpClient hc = new HttpClient())
            {
                data = await hc.GetStringAsync("http://microsoft.com");
            }

            log.Debug("Completed HttpClient.GetStringAsync()");

            return Request.CreateResponse(HttpStatusCode.OK, data);
        }

App Insights does pick up the 2 logging messages via log4net, but doesn’t show anything for dependency calls.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 600px) 100vw, 600px" />

It does see it, it just doesn’t associate it with the ASP.NET web request.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 600px) 100vw, 600px" />

7. Tracking application dependencies

App Insights supports tracking dependency calls in your code. Microsoft’s documentation says SQL databases, HTTP calls, and Azure storage libraries are supported. Anything else requires using their SDK to manually track each dependency call.

Limitations

App Insights does not support some other notable key Azure dependencies include Service Bus and redis.

Some other APM solutions also support MongoDB, RavenDB, Elasticsearch, Redis, Memcached, AppFabric, MSMQ, NServiceBus, AWS services and more.

8. View all details for a single web request (transaction trace)

One of the key features to help track down what a request does is seeing the complete picture of logging, dependency calls, and other key events associated with a single web request.

The best way to do this in Application Insights is to click “All available telemetry for this operation”.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 285w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 974w" sizes="(max-width: 600px) 100vw, 600px" />

 

9. How to Identify why a request or entire application is slow

One suggestion is to customize the chart that you see when filter for a specific operation to add the “dependency duration”. This will help you see how that compares to overall server response time.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 1797px) 100vw, 1797px" />

Application Insights’ map feature can be useful for trying to identify the performance of dependencies. It will tell you the average time and % of failures.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 1082px) 100vw, 1082px" />

I would also suggest going to “Failures” from the menu to look for dependency failures and exceptions.

One thing that would be nice is a visual way to see how each dependency impacts overall performance. When there is a problem with one it is usually easy to see it spike.

http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 300w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 768w, http://1piygz303e2p3ze2nt2kfhla.wpengine.netdna-cdn.com/wp-content/uploa... 1024w" sizes="(max-width: 1379px) 100vw, 1379px" />
Screenshot from Retrace

10. Monitoring & Alerts features and limitations

Application Insights supports configuring alerts for a lot of different conditions. Including alerting on metrics like Server Exceptions, Request Rate, Process CPU, etc.

Monitoring limitations

  • No way to monitor a specific request (URL/action)
  • No way to monitor a specific SQL query
  • No way to monitor % of requests having errors
  • Can only monitor averages

Alerting limitations

  • Email or webhooks only
  • Can use a Logic App to send to SMS, Slack, and others
  • No built in concept of alert “escalation”
  • No concept of alert severity like warning vs critical
  • Alerts go to everyone or a hard coded list of emails. No good way to manage distribution lists unless done outside via email groups.

11. Reporting across applications

In Azure Application Insights, each app is more or less a “bucket” that all the diagnostics about each app gets reported to. There is no easy way to see exceptions, slow SQL queries, slow web requests and etc across all of your apps. The only workaround that can provide some very minimal visibility is making a custom dashboard and selecting some widgets across multiple apps.

12. Application Insights does support the concept of multiple “environments” (QA, Prod, etc)

Within an individual application, there is no high level way to separate out and report data by environment (i.e. Dev, QA, Prod). Microsoft has a couple workarounds that they recommend:

  1. Configure a unique “application” via separate instrumentation keys. This works but then there is no reporting across them. They are completely isolated.
  2. Use a custom field for the environement. You would then need to probably make your own dashboards and widgets in App Insights filtered down by that custom field.

13. App Insights is not a code profiler

Most application performance management (APM) solutions use code profiling to do data collection. Microsoft Application Insights does not use profiling. Instead it relies on collecting data via the .NET framework via ETW and other sources.

Because App Insights does not the CLR profiler, it causes a few limitations:

  • Lack of dependency support – The reason Microsoft Application Insights does not support a wide array of 3rd party dependencies is primarily because they don’t do code profiling that would let them instrument the libraries.
  • No custom profiling – One of the very useful features of APM solutions is being able to profile custom methods in your code to track their usage and performance. App Insights doesn’t support this. You would instead need to use their SDK and modify your code to report it.

14. Application Insights has a robust API, and you will likely need it

If you like instrumenting your apps manually to report performance data, you will love Application Insights. They have a robust API and SDKs for several programming languages  (.NET, java, node.js) that let’s you report requests, pages views, dependency calls, trace (log) messages, exceptions and more via their TelemetryClient.

Microsoft’s own description highlights it as being “extensible” as it relies on a lot of custom SDK usages to get rich data.

Application Insights is an extensible Application Performance Management (APM) service for web developers.

If your app uses Elasticsearch, mongodb, redis, or any other dependency and you would like to see it show up in Application Insights on Azure, you will need to change your code and manually report it.

15. How to use Application Insights with Windows Services

If you have a Windows Service type application that you want to track with App Insights, you will have to integrate their API in to your app. Every single place you make a database call, you can simply add a couple lines of code to report the query via their SDK.

As an example, check out this article about using Azure Worker Roles with Application Insights.

Need more than Application Insights?

Application Insights is awesome. However, like any application, it has its limitations and best use cases. I would describe App Insights as a “light APM” solution. If you want to take the time to use their SDK, you can make it do a lot of different things.

However, if you want the best APM available for ASP.NET developers with the entire goal of finding and fixing application problems as fast as possible, checkout Retrace. It is actually written in ASP.NET and is hosted on Azure. Monitoring Azure is our expertise!

Key differences:

  • All major application dependencies supported
  • Excellent reporting across apps and environments
  • Industry leading transaction trace views for developers
  • 100% support for async and .NET Core
  • Included and advanced logging functionality
  • No code or config changes required

The post Application Insights – 15 things every developer needs to know appeared first on Stackify.

Read the original blog entry...

More Stories By Stackify Blog

Stackify offers the only developers-friendly solution that fully integrates error and log management with application performance monitoring and management. Allowing you to easily isolate issues, identify what needs to be fixed quicker and focus your efforts – Support less, Code more. Stackify provides software developers, operations and support managers with an innovative cloud based solution that gives them DevOps insight and allows them to monitor, detect and resolve application issues before they affect the business to ensure a better end user experience. Start your free trial now stackify.com

Latest Stories
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
Join us at Cloud Expo June 6-8 to find out how to securely connect your cloud app to any cloud or on-premises data source – without complex firewall changes. More users are demanding access to on-premises data from their cloud applications. It’s no longer a “nice-to-have” but an important differentiator that drives competitive advantages. It’s the new “must have” in the hybrid era. Users want capabilities that give them a unified view of the data to get closer to customers and grow business. The...
The current age of digital transformation means that IT organizations must adapt their toolset to cover all digital experiences, beyond just the end users’. Today’s businesses can no longer focus solely on the digital interactions they manage with employees or customers; they must now contend with non-traditional factors. Whether it's the power of brand to make or break a company, the need to monitor across all locations 24/7, or the ability to proactively resolve issues, companies must adapt to...
It is ironic, but perhaps not unexpected, that many organizations who want the benefits of using an Agile approach to deliver software use a waterfall approach to adopting Agile practices: they form plans, they set milestones, and they measure progress by how many teams they have engaged. Old habits die hard, but like most waterfall software projects, most waterfall-style Agile adoption efforts fail to produce the results desired. The problem is that to get the results they want, they have to ch...
IoT solutions exploit operational data generated by Internet-connected smart “things” for the purpose of gaining operational insight and producing “better outcomes” (for example, create new business models, eliminate unscheduled maintenance, etc.). The explosive proliferation of IoT solutions will result in an exponential growth in the volume of IoT data, precipitating significant Information Governance issues: who owns the IoT data, what are the rights/duties of IoT solutions adopters towards t...
Wooed by the promise of faster innovation, lower TCO, and greater agility, businesses of every shape and size have embraced the cloud at every layer of the IT stack – from apps to file sharing to infrastructure. The typical organization currently uses more than a dozen sanctioned cloud apps and will shift more than half of all workloads to the cloud by 2018. Such cloud investments have delivered measurable benefits. But they’ve also resulted in some unintended side-effects: complexity and risk. ...
With the introduction of IoT and Smart Living in every aspect of our lives, one question has become relevant: What are the security implications? To answer this, first we have to look and explore the security models of the technologies that IoT is founded upon. In his session at @ThingsExpo, Nevi Kaja, a Research Engineer at Ford Motor Company, discussed some of the security challenges of the IoT infrastructure and related how these aspects impact Smart Living. The material was delivered interac...
The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities. In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, posited that disruption is inevitable for comp...
In 2014, Amazon announced a new form of compute called Lambda. We didn't know it at the time, but this represented a fundamental shift in what we expect from cloud computing. Now, all of the major cloud computing vendors want to take part in this disruptive technology. In his session at 20th Cloud Expo, Doug Vanderweide, an instructor at Linux Academy, discussed why major players like AWS, Microsoft Azure, IBM Bluemix, and Google Cloud Platform are all trying to sidestep VMs and containers wit...
While DevOps most critically and famously fosters collaboration, communication, and integration through cultural change, culture is more of an output than an input. In order to actively drive cultural evolution, organizations must make substantial organizational and process changes, and adopt new technologies, to encourage a DevOps culture. Moderated by Andi Mann, panelists discussed how to balance these three pillars of DevOps, where to focus attention (and resources), where organizations might...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
No hype cycles or predictions of zillions of things here. IoT is big. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, Associate Partner at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He discussed the evaluation of communication standards and IoT messaging protocols, data analytics considerations, edge-to-cloud tec...
When growing capacity and power in the data center, the architectural trade-offs between server scale-up vs. scale-out continue to be debated. Both approaches are valid: scale-out adds multiple, smaller servers running in a distributed computing model, while scale-up adds fewer, more powerful servers that are capable of running larger workloads. It’s worth noting that there are additional, unique advantages that scale-up architectures offer. One big advantage is large memory and compute capacity...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the de...
Cloud applications are seeing a deluge of requests to support the exploding advanced analytics market. “Open analytics” is the emerging strategy to deliver that data through an open data access layer, in the cloud, to be directly consumed by external analytics tools and popular programming languages. An increasing number of data engineers and data scientists use a variety of platforms and advanced analytics languages such as SAS, R, Python and Java, as well as frameworks such as Hadoop and Spark...