Running in GCE

After setting up Toil on Installation, Toil scripts can be run just by designating a job store location as shown in Running a basic workflow.

If you wish to use the Google Storage job store, install Toil with the google extra (Installing Toil with extra features). Add the following credentials and configuration to the .boto file in your home directory. Create this file if necessary.

gs_access_key_id = CLIENT_ID
gs_secret_access_key = CLIENT_SECRET

https_validate_certificates = True

content_language = en
default_api_version = 2

gs_access_key_id and gs_secret_access_key can be generated by navigating to your Google Cloud Storage console and clicking on APIs & services/Credentials. On this page you can now click Create credentials/OAuth client ID to generate an access key and a matching secret. Use the Other application type. Insert these into their respective places in the .boto file and you will be able to use a Google job store when invoking a Toil script, as in the following example:

$ python google:projectID:jobStore

The projectID component of the job store argument above refers your Google Cloud Project ID in the Google Cloud Console, and will be visible in the console’s banner at the top of the screen. The jobStore component is a name of your choosing that you will use to refer to this job store.