Welcome!

Related Topics: Microsoft Cloud

Microsoft Cloud: Blog Post

Set Up Logging on Google Compute Engine in Less Than 5 Minutes

The need for comprehensive log data management for these platforms has grown

This blog was written by Logentries intern Russell Johnson, a student at MIT studying mechanical engineering and business.

As developers continue to rely more and more on cloud computing services like Amazon Web Services, Google Compute Engine, and Microsoft Azure, the need for comprehensive log data management for these platforms has grown as well  This post gives a quick overview of setting up Logentries on Google Compute Engine.

Although Google offers its own logging service, users seeking additional capabilities such as comprehensive tagging, real-time alerts, and shareable dashboards and graphs might want to forward their logs to a SaaS logging service like Logentries. In addition the Google logging capabilities can only be used on applications deployed through the Google AppEngine, so if you are running workloads on Google Compute Engine you will need to look elsewhere. The screenshot below shows the Google logging service connected to an elementary ‘Hello World' program deployed through the Google AppEngine. As you can see in these logs, Google's service provides some basic tags (Debug/Info/Warning/Error/Critical) and features (autofilled searching) that help provide valuable insight into the basic operational metrics of your application but for users who need to dig deeper into their logs by creating more personalized tags and more sophisticated sorting techniques, the service might seem limited. That's where Logentries comes in.

Google Compute Engine

Here's how you can send Logs to a logging service if you are using Google Compute Engine.

To get started with Google Compute, create a new project in your Google Developer's Console.  Once you've initiated and enabled billing for your project. You can easily clicking the blue ‘Create Instance' button on your project homepage.

Create a project

The available instances that can be created in the Google Compute engine are primarily Linux operating systems but they do offer a paid Windows option. For this post, we will examine a Linux instance but installing Logentries on a Google Windows instance is as easy as running the Logentries Windows Agent. Besides operating systems, Google allows you to choose other specs for your instance before you create it (i.e. amount of memory, number of virtual CPUs, and operating system). Once you've specified those details and created  your instance, it should appear under the Compute > Compute Engine tab in your project's sidebar. Once you've located the project you can SSH into the instance by clicking the SSH button under the ‘Connect' column.

SSH

To connect from your computer's local terminal (in this case I used a Mac running OSX), you'll need to install the Google SDK cloud computing tools, the instructions for which are linked to the window once you click the SSH button. Once you've run the specified SDK download commands in your local terminal, Google will prompt you to enter ‘gcloud auth login' which initiates the process of connecting your local terminal to your virtual machine. Once you've completed this process, which is as simple as following a link in your browser and copying down an identification code, you should be logged into your virtual machine.

Next log into your Logentries account and select ‘add a log' and following the Linux installation instructions.

Install Logentries in minutes

The simplest setup option is to use the Logentries Linux agent to forward logs to your Logentries account. The Linux agent installation is as easy as a one line command in the terminal. The agent will prompt you to input your Logentries account information and after a short installation should start sending logs to your account immediately (its always a good idea to refresh your Logentries Logs page). The installation should look something like this in your terminal:

Once you've checked that the host, and logs are up and running on your Logentries page, the set up is complete. You can explore other tutorials on the Logentries site to help you set up useful tags and alerts to make sure you get the most utility out of your logs.

Check out Logentries free 30-day trial and happy Google logging!

More Stories By Trevor Parsons

Trevor Parsons is Chief Scientist and Co-founder of Logentries. Trevor has over 10 years experience in enterprise software and, in particular, has specialized in developing enterprise monitoring and performance tools for distributed systems. He is also a research fellow at the Performance Engineering Lab Research Group and was formerly a Scientist at the IBM Center for Advanced Studies. Trevor holds a PhD from University College Dublin, Ireland.

Latest Stories
FinTechs use the cloud to operate at the speed and scale of digital financial activity, but are often hindered by the complexity of managing security and compliance in the cloud. In his session at 20th Cloud Expo, Sesh Murthy, co-founder and CTO of Cloud Raxak, showed how proactive and automated cloud security enables FinTechs to leverage the cloud to achieve their business goals. Through business-driven cloud security, FinTechs can speed time-to-market, diminish risk and costs, maintain continu...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
Existing Big Data solutions are mainly focused on the discovery and analysis of data. The solutions are scalable and highly available but tedious when swapping in and swapping out occurs in disarray and thrashing takes place. The resolution for thrashing through machine learning algorithms and support nomenclature is through simple techniques. Organizations that have been collecting large customer data are increasingly seeing the need to use the data for swapping in and out and thrashing occurs ...
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that’s no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, will explore how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He wi...
SYS-CON Events announced today that Datera, that offers a radically new data management architecture, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera is transforming the traditional datacenter model through modern cloud simplicity. The technology industry is at another major inflection point. The rise of mobile, the Internet of Things, data storage and Big...
When you focus on a journey from up-close, you look at your own technical and cultural history and how you changed it for the benefit of the customer. This was our starting point: too many integration issues, 13 SWP days and very long cycles. It was evident that in this fast-paced industry we could no longer afford this reality. We needed something that would take us beyond reducing the development lifecycles, CI and Agile methodologies. We made a fundamental difference, even changed our culture...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
In the enterprise today, connected IoT devices are everywhere – both inside and outside corporate environments. The need to identify, manage, control and secure a quickly growing web of connections and outside devices is making the already challenging task of security even more important, and onerous. In his session at @ThingsExpo, Rich Boyer, CISO and Chief Architect for Security at NTT i3, discussed new ways of thinking and the approaches needed to address the emerging challenges of security i...
Blockchain is a shared, secure record of exchange that establishes trust, accountability and transparency across business networks. Supported by the Linux Foundation's open source, open-standards based Hyperledger Project, Blockchain has the potential to improve regulatory compliance, reduce cost as well as advance trade. Are you curious about how Blockchain is built for business? In her session at 21st Cloud Expo, René Bostic, Technical VP of the IBM Cloud Unit in North America, will discuss th...
Docker containers have brought great opportunities to shorten the deployment process through continuous integration and the delivery of applications and microservices. This applies equally to enterprise data centers as well as the cloud. In his session at 20th Cloud Expo, Jari Kolehmainen, founder and CTO of Kontena, discussed solutions and benefits of a deeply integrated deployment pipeline using technologies such as container management platforms, Docker containers, and the drone.io Cl tool. H...
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
In his opening keynote at 20th Cloud Expo, Michael Maximilien, Research Scientist, Architect, and Engineer at IBM, discussed the full potential of the cloud and social data requires artificial intelligence. By mixing Cloud Foundry and the rich set of Watson services, IBM's Bluemix is the best cloud operating system for enterprises today, providing rapid development and deployment of applications that can take advantage of the rich catalog of Watson services to help drive insights from the vast t...
There is only one world-class Cloud event on earth, and that is Cloud Expo – which returns to Silicon Valley for the 21st Cloud Expo at the Santa Clara Convention Center, October 31 - November 2, 2017. Every Global 2000 enterprise in the world is now integrating cloud computing in some form into its IT development and operations. Midsize and small businesses are also migrating to the cloud in increasing numbers. Companies are each developing their unique mix of cloud technologies and service...
Cloud adoption is often driven by a desire to increase efficiency, boost agility and save money. All too often, however, the reality involves unpredictable cost spikes and lack of oversight due to resource limitations. In his session at 20th Cloud Expo, Joe Kinsella, CTO and Founder of CloudHealth Technologies, tackled the question: “How do you build a fully optimized cloud?” He will examine: Why TCO is critical to achieving cloud success – and why attendees should be thinking holistically ab...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, will introduce two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a...