This might be a naive question, but I'm really not sure how to do it. I submit a spark job and I get the following output.
Run job succeeded. Submission id: driver-20170824224209-0001
I want to programmatically query the status of this job. How can I use the output in the console to extract the id to a variable using a bash script. Any help appreciated.