It is possible to re-run a job in Google Cloud Dataflow after succeded

Question

Maybe the question sounds stupid but I was wondering if once the job is successfully finished and having ID, is it possible to start the same job again? Or is it necessary to create another one? Because otherwise I would have the job with the same name throughout the list.

I just want to know if there is a way to restart it without recreating it again.

question from:https://stackoverflow.com/questions/66066046/it-is-possible-to-re-run-a-job-in-google-cloud-dataflow-after-succeded

Answer 1

It's not possible to run the exact same job again, but you can create a new job with the same name that runs the same code. It will just have a different job ID and show up as a separate entry in the job list.

If you want to make running repeated jobs easier, you can create a template. This will let you create jobs from that template via a gcloud command instead of having to run your pipeline code.