{"id":3578,"date":"2022-11-17T03:24:41","date_gmt":"2022-11-17T03:24:41","guid":{"rendered":"https:\/\/www.checkmateq.com\/blog\/?p=3578"},"modified":"2023-08-04T10:31:52","modified_gmt":"2023-08-04T10:31:52","slug":"logging-in-google-cloud-platform","status":"publish","type":"post","link":"https:\/\/www.checkmateq.com\/blog\/logging-in-google-cloud-platform","title":{"rendered":"How to Setup Logging in Google Cloud Platform?"},"content":{"rendered":"

Logging in Google Cloud Platform<\/h1>\n

Logging provides us information like what is the execution flow, what event is happening at what time and all the information of errors warnings if something goes, logs help us to debug the problem step by step, usually in common practice we will try to write logs related to that program flow or execution into a file or some other database so which would help us in trouble shooting , in the same way Google Cloud<\/a>\u00a0 Platform provides Logging<\/strong> as a managed service and it is part of Google Cloud Operations Suite<\/strong>.<\/p>\n

Cloud Logging in GCP<\/strong><\/h2>\n

It provides the log information related to any service available in the google cloud platform it’s not constrained to a particular group of services, so you can keep an eye on everything that’s happening in your organization GCP account and GCP also provides you with APIs to manage logs programmatically, so basically it just lets us to View<\/strong>, Query<\/strong> and Download<\/strong> the logs.<\/p>\n

Below is an example log provided for your understanding.<\/p>\n

{\r\nhttpRequest: {1}\r\ninsertId: \"6375e32e0002d2cd0d2df081\"\r\nlabels: {1}\r\nlogName: \"projects\/rock-partition-363003\/logs\/appengine.googleapis<\/strong>.com%2Frequest_log\"\r\noperation: {4}\r\nprotoPayload: {28}\r\nreceiveTimestamp: \"2022-11-17T07:30:54.185767503Z\"\r\nresource: {2}\r\nseverity: \"INFO\"\r\nspanId: \"8272484813176817280\"\r\ntimestamp: \"2022-11-17T07:30:53.051635Z\"<\/strong>\r\ntrace: \"projects\/rock-partition-363003\/traces\/a8909f84c4f1f49a014d3a804cf4b117\"\r\ntraceSampled: true\r\n}\r\n<\/pre>\n
The basic\u00a0 information inside this a log entry are Time Stamp<\/strong>\u00a0 gives details of event occurrence time and date like when the event is happened related to any particular service and\u00a0Resource<\/strong>\u00a0 from where that\u00a0 particular\u00a0 log information is generated for example let’s say if you are trying to access\u00a0 big query so that related\u00a0 information should have big query\u00a0 as a resource\u00a0 and detail information will be provided in\u00a0 Payload<\/strong>\u00a0 , payload is been removed from the above given log as a payload will have many line<\/p>\n
In Cloud<\/a> Logging logs are available in Json format, for a single log entry in order to analyze this Json file you need to manually go through the whole Json syntax, Noo, that’s a terrific task right, to help you with this GCP also allows you to export these logs to some other google cloud services like Big Query, Google Cloud Storage for further processing or analysis.<\/p>\n
Types of audit logs in Cloud Computing<\/h2>\n
Now let’s see what the different type of audit logs are we have<\/p>\n
Admin activity:<\/strong>\u00a0 \u00a0Operations like creating, modifying or deleting a resource comes under this admin related activity, so all these related activities are captured under admin activity logs. You can also look into AWS cloudtails to find out action related every API.<\/p>\n
Data access<\/strong>:\u00a0 \u00a0Logs generated from the activities made for accessing data are captured under Data access logs, logs are generated even when data is not accessed and captured.<\/p>\n
System event:<\/strong> system event means for example let’s say, you have scheduled something to happen in a specified time like a life cycle for objects stored in Cloud Storage, whenever the life cycle rules applied on the objects, logs will be generated, and these logs will be captured as System event logs. <\/strong>Such as Linux operating system logs would be available at \/var\/log\/messages about every system activity.<\/p>\n
 <\/p>\n
Now let’s explore how this logging interface looks like, on your GCP web console go to logging under operations,<\/p>\n
\"\"<\/p>\n
 <\/p>\n
You will be landing on Logs explorer<\/strong> page, here you can View and Query logs, and also apply various filters and severities, just expand a log to analyze it, you can also simply share the log link to your team member to discuss on it (he\/she can only see the log if the GCP account they are using has the required IAM privileges)<\/p>\n
IAM role required for viewing a log is log.viewer .<\/p>\n
\"\"<\/p>\n
 <\/p>\n
\"\"<\/p>\n
 <\/p>\n
 <\/p>\n
Now let’s apply some filters from the console itself and understand the auto generated queries, select a resource and the severity of the event to filter the logs. I am just selecting info logs of service Google App Engine<\/a> as I do not have any errors or warnings from it.<\/p>\n
\"\"<\/p>\n
 <\/p>\n
\"\"<\/p>\n
below is the auto generated query from the applied filters.<\/p>\n
severity=INFO\r\nresource.type=\"gae_app\"\r\n<\/pre>\n
\"\"<\/p>\n
 <\/p>\n
as mentioned, you can also save this query for future use by just clicking on the save button on the top right corner and you can also set the specific time frame to get the logs as shown below.<\/p>\n
\"\"<\/p>\n
Setting the time frame, you can set the time frame from the histogram tab or by ,<\/p>\n
\"\"<\/p>\n
This blog is written by Amit Kumar, Head of engineering at Checkmate Global Technologies<\/a>. You can lease reach to him to hire Google Cloud Engineer and learn about Cloud Monitoring<\/a> best practices.<\/p>\n","protected":false},"excerpt":{"rendered":"
Logging in Google Cloud Platform Logging provides us information like what is the execution flow, what event is happening at what time and all the information of errors warnings if something goes, logs help us to debug the problem step by step, usually in common practice we will try to write logs related to that … Continue reading “How to Setup Logging in Google Cloud Platform?”<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":3598,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[3,93,79,2,71,70,69,68,59,11,78,63,23,16,24,80,8],"_links":{"self":[{"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/posts\/3578"}],"collection":[{"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/comments?post=3578"}],"version-history":[{"count":18,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/posts\/3578\/revisions"}],"predecessor-version":[{"id":4210,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/posts\/3578\/revisions\/4210"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/media\/3598"}],"wp:attachment":[{"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/media?parent=3578"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/categories?post=3578"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/tags?post=3578"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}