Welcome!

Related Topics: Microsoft Cloud

Microsoft Cloud: Blog Post

Set Up Logging on Google Compute Engine in Less Than 5 Minutes

The need for comprehensive log data management for these platforms has grown

This blog was written by Logentries intern Russell Johnson, a student at MIT studying mechanical engineering and business.

As developers continue to rely more and more on cloud computing services like Amazon Web Services, Google Compute Engine, and Microsoft Azure, the need for comprehensive log data management for these platforms has grown as well  This post gives a quick overview of setting up Logentries on Google Compute Engine.

Although Google offers its own logging service, users seeking additional capabilities such as comprehensive tagging, real-time alerts, and shareable dashboards and graphs might want to forward their logs to a SaaS logging service like Logentries. In addition the Google logging capabilities can only be used on applications deployed through the Google AppEngine, so if you are running workloads on Google Compute Engine you will need to look elsewhere. The screenshot below shows the Google logging service connected to an elementary ‘Hello World' program deployed through the Google AppEngine. As you can see in these logs, Google's service provides some basic tags (Debug/Info/Warning/Error/Critical) and features (autofilled searching) that help provide valuable insight into the basic operational metrics of your application but for users who need to dig deeper into their logs by creating more personalized tags and more sophisticated sorting techniques, the service might seem limited. That's where Logentries comes in.

Google Compute Engine

Here's how you can send Logs to a logging service if you are using Google Compute Engine.

To get started with Google Compute, create a new project in your Google Developer's Console.  Once you've initiated and enabled billing for your project. You can easily clicking the blue ‘Create Instance' button on your project homepage.

Create a project

The available instances that can be created in the Google Compute engine are primarily Linux operating systems but they do offer a paid Windows option. For this post, we will examine a Linux instance but installing Logentries on a Google Windows instance is as easy as running the Logentries Windows Agent. Besides operating systems, Google allows you to choose other specs for your instance before you create it (i.e. amount of memory, number of virtual CPUs, and operating system). Once you've specified those details and created  your instance, it should appear under the Compute > Compute Engine tab in your project's sidebar. Once you've located the project you can SSH into the instance by clicking the SSH button under the ‘Connect' column.

SSH

To connect from your computer's local terminal (in this case I used a Mac running OSX), you'll need to install the Google SDK cloud computing tools, the instructions for which are linked to the window once you click the SSH button. Once you've run the specified SDK download commands in your local terminal, Google will prompt you to enter ‘gcloud auth login' which initiates the process of connecting your local terminal to your virtual machine. Once you've completed this process, which is as simple as following a link in your browser and copying down an identification code, you should be logged into your virtual machine.

Next log into your Logentries account and select ‘add a log' and following the Linux installation instructions.

Install Logentries in minutes

The simplest setup option is to use the Logentries Linux agent to forward logs to your Logentries account. The Linux agent installation is as easy as a one line command in the terminal. The agent will prompt you to input your Logentries account information and after a short installation should start sending logs to your account immediately (its always a good idea to refresh your Logentries Logs page). The installation should look something like this in your terminal:

Once you've checked that the host, and logs are up and running on your Logentries page, the set up is complete. You can explore other tutorials on the Logentries site to help you set up useful tags and alerts to make sure you get the most utility out of your logs.

Check out Logentries free 30-day trial and happy Google logging!

More Stories By Trevor Parsons

Trevor Parsons is Chief Scientist and Co-founder of Logentries. Trevor has over 10 years experience in enterprise software and, in particular, has specialized in developing enterprise monitoring and performance tools for distributed systems. He is also a research fellow at the Performance Engineering Lab Research Group and was formerly a Scientist at the IBM Center for Advanced Studies. Trevor holds a PhD from University College Dublin, Ireland.

Latest Stories
Without a clear strategy for cost control and an architecture designed with cloud services in mind, costs and operational performance can quickly get out of control. To avoid multiple architectural redesigns requires extensive thought and planning. Boundary (now part of BMC) launched a new public-facing multi-tenant high resolution monitoring service on Amazon AWS two years ago, facing challenges and learning best practices in the early days of the new service. In his session at 19th Cloud Exp...
"We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
The cloud promises new levels of agility and cost-savings for Big Data, data warehousing and analytics. But it’s challenging to understand all the options – from IaaS and PaaS to newer services like HaaS (Hadoop as a Service) and BDaaS (Big Data as a Service). In her session at @BigDataExpo at @ThingsExpo, Hannah Smalltree, a director at Cazena, provided an educational overview of emerging “as-a-service” options for Big Data in the cloud. This is critical background for IT and data professionals...
Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2017 New York The 7th Internet of @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, New York. Chris Matthieu is the co-founder and CTO of Octoblu, a revolutionary real-time IoT platform recently acquired by Citrix. Octoblu connects things, systems, people and clouds to a global mesh network allowing users to automate and control design flo...
You are moving to the Cloud. The question is not if, it’s when. Now that your competitors are in the cloud and lapping you, your “when” better hurry up and get here. But saying and doing are two different things. In his session at @DevOpsSummit at 18th Cloud Expo, Robert Reeves, CTO of Datical, explained how DevOps can be your onramp to the cloud. By adopting simple, platform independent DevOps strategies, you can accelerate your move to the cloud. Spoiler Alert: He also makes sure you don’t...
President Obama recently announced the launch of a new national awareness campaign to "encourage more Americans to move beyond passwords – adding an extra layer of security like a fingerprint or codes sent to your cellphone." The shift from single passwords to multi-factor authentication couldn’t be timelier or more strategic. This session will focus on why passwords alone are no longer effective, and why the time to act is now. In his session at 19th Cloud Expo, Chris Webber, security strateg...
"We are an all-flash array storage provider but our focus has been on VM-aware storage specifically for virtualized applications," stated Dhiraj Sehgal of Tintri in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Redis is not only the fastest database, but it has become the most popular among the new wave of applications running in containers. Redis speeds up just about every data interaction between your users or operational systems. In his session at 18th Cloud Expo, Dave Nielsen, Developer Relations at Redis Labs, shared the functions and data structures used to solve everyday use cases that are driving Redis' popularity.
The WebRTC Summit New York, to be held June 6-8, 2017, at the Javits Center in New York City, NY, announces that its Call for Papers is now open. Topics include all aspects of improving IT delivery by eliminating waste through automated business models leveraging cloud technologies. WebRTC Summit is co-located with 20th International Cloud Expo and @ThingsExpo. WebRTC is the future of browser-to-browser communications, and continues to make inroads into the traditional, difficult, plug-in web co...
Enterprise IT has been in the era of Hybrid Cloud for some time now. But it seems most conversations about Hybrid are focused on integrating AWS, Microsoft Azure, or Google ECM into existing on-premises systems. Where is all the Private Cloud? What do technology providers need to do to make their offerings more compelling? How should enterprise IT executives and buyers define their focus, needs, and roadmap, and communicate that clearly to the providers?
Amazon has gradually rolled out parts of its IoT offerings, but these are just the tip of the iceberg. In addition to optimizing their backend AWS offerings, Amazon is laying the ground work to be a major force in IoT - especially in the connected home and office. In his session at @ThingsExpo, Chris Kocher, founder and managing director of Grey Heron, explained how Amazon is extending its reach to become a major force in IoT by building on its dominant cloud IoT platform, its Dash Button strat...
"We are a custom software development, engineering firm. We specialize in cloud applications from helping customers that have on-premise applications migrating to the cloud, to helping customers design brand new apps in the cloud. And we specialize in mobile apps," explained Peter Di Stefano, Vice President of Marketing at Impiger Technologies, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Complete Internet of Things (IoT) embedded device security is not just about the device but involves the entire product’s identity, data and control integrity, and services traversing the cloud. A device can no longer be looked at as an island; it is a part of a system. In fact, given the cross-domain interactions enabled by IoT it could be a part of many systems. Also, depending on where the device is deployed, for example, in the office building versus a factory floor or oil field, security ha...
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
The idea of comparing data in motion (at the sensor level) to data at rest (in a Big Data server warehouse) with predictive analytics in the cloud is very appealing to the industrial IoT sector. The problem Big Data vendors have, however, is access to that data in motion at the sensor location. In his session at @ThingsExpo, Scott Allen, CMO of FreeWave, discussed how as IoT is increasingly adopted by industrial markets, there is going to be an increased demand for sensor data from the outermos...