Setting up your first Dataflow on GCP

Photo by Lachlan Gowen on Unsplash
  1. Go to Bigquery and create a new dataset (again just go with the default parameters)
  2. Search for App Engine and activate it (it will help us to start our instances later)
  3. Search for Dataflow API and activate it
INFO:apache_beam.runners.dataflow.internal.apiclient:A template was just created at location gs://tutorial-bucket-dataflow/templates/traffic_beam

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Felix Ude

Felix Ude

Data Scientist and Economist — based in Hamburg