# Copyright 2016 Google Inc. All rights reserved. # # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. require "google-cloud-logging" require "google/cloud/logging/project" module Google module Cloud ## # # Stackdriver Logging # # The Stackdriver Logging service collects and stores logs from applications # and services on the Google Cloud Platform, giving you fine-grained, # programmatic control over your projects' logs. You can use the Stackdriver # Logging API to: # # * [Read and filter log entries](#listing-log-entries) # * [Export your log entries](#exporting-log-entries) to Cloud Storage, # BigQuery, or Cloud Pub/Sub # * [Create logs-based metrics](#creating-logs-based-metrics) for use in # Cloud Monitoring # * [Write log entries](#writing-log-entries) # # For general information about Stackdriver Logging, read [Stackdriver # Logging Documentation](https://cloud.google.com/logging/docs/). # # The goal of google-cloud is to provide an API that is comfortable to # Rubyists. Authentication is handled by {Google::Cloud#logging}. You can # provide the project and credential information to connect to the # Stackdriver Logging service, or if you are running on Google Compute # Engine this configuration is taken care of for you. You can read more # about the options for connecting in the [Authentication # Guide](https://googlecloudplatform.github.io/google-cloud-ruby/#/docs/guides/authentication). # # If you just want to write your application's logs to the Stackdriver # Logging service, you may find it easiest to use the [Stackdriver Logging # Instrumentation](https://googlecloudplatform.github.io/google-cloud-ruby/#/docs/guides/instrumentation) # or the [Ruby Logger # implementation](#creating-a-ruby-logger-implementation) provided by this # library. Otherwise, read on to learn more about the Logging API. # # ## Listing log entries # # Stackdriver Logging gathers log entries from many services, including # Google App Engine and Google Compute Engine. (See the [List of Log # Types](https://cloud.google.com/logging/docs/view/logs_index).) In # addition, you can write your own log entries to the service. # # {Google::Cloud::Logging::Project#entries} returns the # {Google::Cloud::Logging::Entry} records belonging to your project: # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # entries = logging.entries # entries.each do |e| # puts "[#{e.timestamp}] #{e.log_name} #{e.payload.inspect}" # end # ``` # # You can narrow the results to a single log using an [advanced logs # filter](https://cloud.google.com/logging/docs/view/advanced_filters). A # log is a named collection of entries. Logs can be produced by Google Cloud # Platform services, by third-party services, or by your applications. For # example, the log `compute.googleapis.com/activity_log` is produced by # Google Compute Engine. Logs are simply referenced by name in google-cloud. # There is no `Log` type in google-cloud or `Log` resource in the # Stackdriver Logging API. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # entries = logging.entries filter: "log:syslog" # entries.each do |e| # puts "[#{e.timestamp}] #{e.payload.inspect}" # end # ``` # # You can also order the log entries by `timestamp`. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # entries = logging.entries order: "timestamp desc" # entries.each do |e| # puts "[#{e.timestamp}] #{e.log_name} #{e.payload.inspect}" # end # ``` # # ## Exporting log entries # # Stackdriver Logging lets you export log entries to destinations including # Google Cloud Storage buckets (for long term log storage), Google BigQuery # datasets (for log analysis), and Google Pub/Sub (for streaming to other # applications). # # ### Creating sinks # # A {Google::Cloud::Logging::Sink} is an object that lets you to specify a # set of log entries to export. # # In addition to the name of the sink and the export destination, # {Google::Cloud::Logging::Project#create_sink} accepts an [advanced logs # filter](https://cloud.google.com/logging/docs/view/advanced_filters) to # narrow the collection. # # Before creating the sink, ensure that you have granted # `cloud-logs@google.com` permission to write logs to the destination. See # [Permissions for writing exported # logs](https://cloud.google.com/logging/docs/export/configure_export#setting_product_name_short_permissions_for_writing_exported_logs). # # ```ruby # require "google/cloud/logging" # # storage = Google::Cloud::Storage.new # # bucket = storage.create_bucket "my-logs-bucket" # # # Grant owner permission to Stackdriver Logging service # email = "cloud-logs@google.com" # bucket.acl.add_owner "group-#{email}" # # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # # sink = logging.create_sink "my-sink", # "storage.googleapis.com/#{bucket.id}" # ``` # # When you create a sink, only new log entries are exported. Stackdriver # Logging does not send previously-ingested log entries to the sink's # destination. # # ### Listing sinks # # You can also list the sinks belonging to your project with # {Google::Cloud::Logging::Project#sinks}. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # sinks = logging.sinks # sinks.each do |s| # puts "#{s.name}: #{s.filter} -> #{s.destination}" # end # ``` # # ## Creating logs-based metrics # # You can use log entries in your project as the basis for [Google Cloud # Monitoring](https://cloud.google.com/monitoring/docs) metrics. These # metrics can then be used to produce Cloud Monitoring reports and alerts. # # ### Creating metrics # # A metric is a measured value that can be used to assess a system. Use # {Google::Cloud::Logging::Project#create_metric} to configure a # {Google::Cloud::Logging::Metric} based on a collection of log entries # matching an [advanced logs # filter](https://cloud.google.com/logging/docs/view/advanced_filters). # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # metric = logging.create_metric "errors", "severity>=ERROR" # ``` # # ### Listing metrics # # You can also list the metrics belonging to your project with # {Google::Cloud::Logging::Project#metrics}. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # metrics = logging.metrics # metrics.each do |m| # puts "#{m.name}: #{m.filter}" # end # ``` # # ## Writing log entries # # An {Google::Cloud::Logging::Entry} is composed of metadata and a payload. # The payload is traditionally a message string, but in Stackdriver Logging # it can also be a JSON or protocol buffer object. A single log can have # entries with different payload types. In addition to the payload, your # argument(s) to {Google::Cloud::Logging::Project#write_entries} must also # contain a log name and a resource. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # # entry = logging.entry # entry.payload = "Job started." # entry.log_name = "my_app_log" # entry.resource.type = "gae_app" # entry.resource.labels[:module_id] = "1" # entry.resource.labels[:version_id] = "20150925t173233" # # logging.write_entries entry # ``` # # If you write a collection of log entries, you can provide the log name, # resource, and/or labels hash to be used for all of the entries, and omit # these values from the individual entries. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # # entry1 = logging.entry # entry1.payload = "Job started." # entry2 = logging.entry # entry2.payload = "Job completed." # labels = { job_size: "large", job_code: "red" } # # resource = logging.resource "gae_app", # "module_id" => "1", # "version_id" => "20150925t173233" # # logging.write_entries [entry1, entry2], # log_name: "my_app_log", # resource: resource, # labels: labels # ``` # # Normally, writing log entries is done synchronously; the call to # {Google::Cloud::Logging::Project#write_entries} will block until it has # either completed transmitting the data or encountered an error. To "fire # and forget" without blocking, use {Google::Cloud::Logging::AsyncWriter}; # it spins up a background thread that writes log entries in batches. Calls # to {Google::Cloud::Logging::AsyncWriter#write_entries} simply add entries # to its work queue and return immediately. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # async = logging.async_writer # # entry1 = logging.entry # entry1.payload = "Job started." # entry2 = logging.entry # entry2.payload = "Job completed." # labels = { job_size: "large", job_code: "red" } # # resource = logging.resource "gae_app", # "module_id" => "1", # "version_id" => "20150925t173233" # # async.write_entries [entry1, entry2], # log_name: "my_app_log", # resource: resource, # labels: labels # ``` # # ### Creating a Ruby Logger implementation # # If your environment requires a logger instance that is API-compatible with # Ruby's standard library # [Logger](http://ruby-doc.org/stdlib/libdoc/logger/rdoc), you can use # {Google::Cloud::Logging::Project#logger} to create one. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # # resource = logging.resource "gae_app", # module_id: "1", # version_id: "20150925t173233" # # logger = logging.logger "my_app_log", resource, env: :production # logger.info "Job started." # ``` # # By default, the logger instance writes log entries asynchronously in a # background thread using an {Google::Cloud::Logging::AsyncWriter}. If you # want to customize or disable asynchronous writing, you may call the # Logger constructor directly. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # # resource = logging.resource "gae_app", # module_id: "1", # version_id: "20150925t173233" # # logger = Google::Cloud::Logging::Logger.new logging, # "my_app_log", # resource, # {env: :production} # logger.info "Log entry written synchronously." # ``` # # ## Configuring timeout # # You can configure the request `timeout` value in seconds. # # ```ruby # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new timeout: 120 # ``` # module Logging ## # Creates a new object for connecting to the Stackdriver Logging service. # Each call creates a new connection. # # For more information on connecting to Google Cloud see the # [Authentication # Guide](https://googlecloudplatform.github.io/google-cloud-ruby/#/docs/guides/authentication). # # @param [String] project Project identifier for the Stackdriver Logging # service. # @param [String, Hash] keyfile Keyfile downloaded from Google Cloud. If # file path the file must be readable. # @param [String, Array] scope The OAuth 2.0 scopes controlling # the set of resources and operations that the connection can access. # See [Using OAuth 2.0 to Access Google # APIs](https://developers.google.com/identity/protocols/OAuth2). # # The default scope is: # # * `https://www.googleapis.com/auth/logging.admin` # @param [Integer] timeout Default timeout to use in requests. Optional. # @param [Hash] client_config A hash of values to override the default # behavior of the API client. Optional. # # @return [Google::Cloud::Logging::Project] # # @example # require "google/cloud/logging" # # logging = Google::Cloud::Logging.new # # entries = logging.entries # entries.each do |e| # puts "[#{e.timestamp}] #{e.log_name} #{e.payload.inspect}" # end # def self.new project: nil, keyfile: nil, scope: nil, timeout: nil, client_config: nil project ||= Google::Cloud::Logging::Project.default_project project = project.to_s # Always cast to a string fail ArgumentError, "project is missing" if project.empty? credentials = Google::Cloud::Logging::Credentials.credentials_with_scope keyfile, scope Google::Cloud::Logging::Project.new( Google::Cloud::Logging::Service.new( project, credentials, timeout: timeout, client_config: client_config)) end end end end