

Specifically, this add-on runs a Splunk modular input that periodically pulls logs from a Pub/Sub topic that’s configured as a log sink export. Traditionally, Splunk users have the option to pull logs from Google Cloud using Splunk Add-on for Google Cloud Platform as a data collector. The step-by-step walkthrough covers the entire setup, from configuring the originating log sinks in Cloud Logging to the final Splunk destination-the Splunk HTTP Event Collector (HEC) endpoint. “Thanks to their efforts, we can leverage both Google's Pub/Sub model and Splunk's query capabilities to simplify the management of our detection and response infrastructure and process over eight million daily events.” “Google Cloud’s Pub/Sub to Splunk Dataflow template has been helpful for enabling Spotify Security to ingest highly variable log types into Splunk,” says Andy Gu, Security Engineer at Spotify. We hear that customers are using this template to meet the variety, velocity and volume of valuable data coming out of Google Cloud. That includes logs from Cloud Logging (formerly Stackdriver Logging), messages from IoT devices, or events such as security findings from Cloud Security Command Center. So, any message that can be delivered to a Pub/Sub topic can now be forwarded to Splunk.

Using this Dataflow template, you can export data from Pub/Sub to Splunk.

#Splunk enterprise free trial how to#
In this blog post, we’ll show you how to set up a streaming pipeline to natively push your Google Cloud data to your Splunk Cloud or Splunk Enterprise instance using the recently released Pub/Sub to Splunk Dataflow template. These use cases include IT ops, security, application development, and business analytics. Many of you use third-party monitoring solutions from Splunk to keep a tab on both on-prem and cloud environments. To learn about latest feature enhancements s ince this announcement blog below, see What’s new with Splunk Dataflow template.Īt Google Cloud, we’re focused on solving customer problems and meeting them where they are. Editor's Note: To get started, follow our tutorial on deploying production-ready log exports to Splunk using Dataflow, and take advantage of associated Terraform scripts to automate deployment.
