Welcome!

Related Topics: Microsoft Cloud

Microsoft Cloud: Blog Post

Set Up Logging on Google Compute Engine in Less Than 5 Minutes

The need for comprehensive log data management for these platforms has grown

This blog was written by Logentries intern Russell Johnson, a student at MIT studying mechanical engineering and business.

As developers continue to rely more and more on cloud computing services like Amazon Web Services, Google Compute Engine, and Microsoft Azure, the need for comprehensive log data management for these platforms has grown as well  This post gives a quick overview of setting up Logentries on Google Compute Engine.

Although Google offers its own logging service, users seeking additional capabilities such as comprehensive tagging, real-time alerts, and shareable dashboards and graphs might want to forward their logs to a SaaS logging service like Logentries. In addition the Google logging capabilities can only be used on applications deployed through the Google AppEngine, so if you are running workloads on Google Compute Engine you will need to look elsewhere. The screenshot below shows the Google logging service connected to an elementary ‘Hello World' program deployed through the Google AppEngine. As you can see in these logs, Google's service provides some basic tags (Debug/Info/Warning/Error/Critical) and features (autofilled searching) that help provide valuable insight into the basic operational metrics of your application but for users who need to dig deeper into their logs by creating more personalized tags and more sophisticated sorting techniques, the service might seem limited. That's where Logentries comes in.

Google Compute Engine

Here's how you can send Logs to a logging service if you are using Google Compute Engine.

To get started with Google Compute, create a new project in your Google Developer's Console.  Once you've initiated and enabled billing for your project. You can easily clicking the blue ‘Create Instance' button on your project homepage.

Create a project

The available instances that can be created in the Google Compute engine are primarily Linux operating systems but they do offer a paid Windows option. For this post, we will examine a Linux instance but installing Logentries on a Google Windows instance is as easy as running the Logentries Windows Agent. Besides operating systems, Google allows you to choose other specs for your instance before you create it (i.e. amount of memory, number of virtual CPUs, and operating system). Once you've specified those details and created  your instance, it should appear under the Compute > Compute Engine tab in your project's sidebar. Once you've located the project you can SSH into the instance by clicking the SSH button under the ‘Connect' column.

SSH

To connect from your computer's local terminal (in this case I used a Mac running OSX), you'll need to install the Google SDK cloud computing tools, the instructions for which are linked to the window once you click the SSH button. Once you've run the specified SDK download commands in your local terminal, Google will prompt you to enter ‘gcloud auth login' which initiates the process of connecting your local terminal to your virtual machine. Once you've completed this process, which is as simple as following a link in your browser and copying down an identification code, you should be logged into your virtual machine.

Next log into your Logentries account and select ‘add a log' and following the Linux installation instructions.

Install Logentries in minutes

The simplest setup option is to use the Logentries Linux agent to forward logs to your Logentries account. The Linux agent installation is as easy as a one line command in the terminal. The agent will prompt you to input your Logentries account information and after a short installation should start sending logs to your account immediately (its always a good idea to refresh your Logentries Logs page). The installation should look something like this in your terminal:

Once you've checked that the host, and logs are up and running on your Logentries page, the set up is complete. You can explore other tutorials on the Logentries site to help you set up useful tags and alerts to make sure you get the most utility out of your logs.

Check out Logentries free 30-day trial and happy Google logging!

More Stories By Trevor Parsons

Trevor Parsons is Chief Scientist and Co-founder of Logentries. Trevor has over 10 years experience in enterprise software and, in particular, has specialized in developing enterprise monitoring and performance tools for distributed systems. He is also a research fellow at the Performance Engineering Lab Research Group and was formerly a Scientist at the IBM Center for Advanced Studies. Trevor holds a PhD from University College Dublin, Ireland.

Latest Stories
Information technology (IT) advances are transforming the way we innovate in business, thereby disrupting the old guard and their predictable status-quo. It’s creating global market turbulence. Industries are converging, and new opportunities and threats are emerging, like never before. So, how are savvy chief information officers (CIOs) leading this transition? Back in 2015, the IBM Institute for Business Value conducted a market study that included the findings from over 1,800 CIO interviews ...
IoT is at the core or many Digital Transformation initiatives with the goal of re-inventing a company's business model. We all agree that collecting relevant IoT data will result in massive amounts of data needing to be stored. However, with the rapid development of IoT devices and ongoing business model transformation, we are not able to predict the volume and growth of IoT data. And with the lack of IoT history, traditional methods of IT and infrastructure planning based on the past do not app...
All organizations that did not originate this moment have a pre-existing culture as well as legacy technology and processes that can be more or less amenable to DevOps implementation. That organizational culture is influenced by the personalities and management styles of Executive Management, the wider culture in which the organization is situated, and the personalities of key team members at all levels of the organization. This culture and entrenched interests usually throw a wrench in the work...
Niagara Networks exhibited at the 19th International Cloud Expo, which took place at the Santa Clara Convention Center in Santa Clara, CA, in November 2016. Niagara Networks offers the highest port-density systems, and the most complete Next-Generation Network Visibility systems including Network Packet Brokers, Bypass Switches, and Network TAPs.
WebRTC services have already permeated corporate communications in the form of videoconferencing solutions. However, WebRTC has the potential of going beyond and catalyzing a new class of services providing more than calls with capabilities such as mass-scale real-time media broadcasting, enriched and augmented video, person-to-machine and machine-to-machine communications. In his session at @ThingsExpo, Luis Lopez, CEO of Kurento, introduced the technologies required for implementing these idea...
Why do your mobile transformations need to happen today? Mobile is the strategy that enterprise transformation centers on to drive customer engagement. In his general session at @ThingsExpo, Roger Woods, Director, Mobile Product & Strategy – Adobe Marketing Cloud, covered key IoT and mobile trends that are forcing mobile transformation, key components of a solid mobile strategy and explored how brands are effectively driving mobile change throughout the enterprise.
Apache Hadoop is emerging as a distributed platform for handling large and fast incoming streams of data. Predictive maintenance, supply chain optimization, and Internet-of-Things analysis are examples where Hadoop provides the scalable storage, processing, and analytics platform to gain meaningful insights from granular data that is typically only valuable from a large-scale, aggregate view. One architecture useful for capturing and analyzing streaming data is the Lambda Architecture, represent...
SYS-CON Events announced today that delaPlex will exhibit at SYS-CON's @CloudExpo, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. delaPlex pioneered Software Development as a Service (SDaaS), which provides scalable resources to build, test, and deploy software. It’s a fast and more reliable way to develop a new product or expand your in-house team.
The explosion of new web/cloud/IoT-based applications and the data they generate are transforming our world right before our eyes. In this rush to adopt these new technologies, organizations are often ignoring fundamental questions concerning who owns the data and failing to ask for permission to conduct invasive surveillance of their customers. Organizations that are not transparent about how their systems gather data telemetry without offering shared data ownership risk product rejection, regu...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
Extreme Computing is the ability to leverage highly performant infrastructure and software to accelerate Big Data, machine learning, HPC, and Enterprise applications. High IOPS Storage, low-latency networks, in-memory databases, GPUs and other parallel accelerators are being used to achieve faster results and help businesses make better decisions. In his session at 18th Cloud Expo, Michael O'Neill, Strategic Business Development at NVIDIA, focused on some of the unique ways extreme computing is...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and sh...
FinTech is the sum of financial and technology, and it’s one of the fastest growing tech industries. Total global investments in FinTech almost reached $50 billion last year, but there is still a great deal of confusion over what it is and what it means – especially as it applies to retirement. Building financial startups is not simple, but with the right team, technology and an innovative approach it can be an extremely interesting domain to disrupt. FinTech heralds a financial revolution that...
SYS-CON Events announced today that IoT Now has been named “Media Sponsor” of SYS-CON's 20th International Cloud Expo, which will take place on June 6–8, 2017, at the Javits Center in New York City, NY. IoT Now explores the evolving opportunities and challenges facing CSPs, and it passes on some lessons learned from those who have taken the first steps in next-gen IoT services.
As organizations realize the scope of the Internet of Things, gaining key insights from Big Data, through the use of advanced analytics, becomes crucial. However, IoT also creates the need for petabyte scale storage of data from millions of devices. A new type of Storage is required which seamlessly integrates robust data analytics with massive scale. These storage systems will act as “smart systems” provide in-place analytics that speed discovery and enable businesses to quickly derive meaningf...