toil.test.provisioners.aws.awsProvisionerTest¶
Attributes¶
Classes¶
Tests for the AWS provisioner that don't actually provision anything. |
|
A common base class for Toil tests. |
|
A common base class for Toil tests. |
|
Runs the tests on a statically provisioned cluster with autoscaling enabled. |
|
Runs the tests on a self-scaling Kubernetes cluster. |
|
A common base class for Toil tests. |
|
This test insures autoscaling works on a restarted Toil run. |
|
A common base class for Toil tests. |
Module Contents¶
- toil.test.provisioners.aws.awsProvisionerTest.log¶
- class toil.test.provisioners.aws.awsProvisionerTest.AWSProvisionerBenchTest(methodName='runTest')¶
Bases:
toil.test.ToilTest
Tests for the AWS provisioner that don’t actually provision anything.
- test_AMI_finding()¶
- test_read_write_global_files()¶
Make sure the _write_file_to_cloud() and _read_file_from_cloud() functions of the AWS provisioner work as intended.
- class toil.test.provisioners.aws.awsProvisionerTest.AbstractAWSAutoscaleTest(methodName)¶
Bases:
toil.test.provisioners.clusterTest.AbstractClusterTest
A common base class for Toil tests.
Please have every test case directly or indirectly inherit this one.
When running tests you may optionally set the TOIL_TEST_TEMP environment variable to the path of a directory where you want temporary test files be placed. The directory will be created if it doesn’t exist. The path may be relative in which case it will be assumed to be relative to the project root. If TOIL_TEST_TEMP is not defined, temporary files and directories will be created in the system’s default location for such files and any temporary files or directories left over from tests will be removed automatically removed during tear down. Otherwise, left-over files will not be removed.
- instanceTypes = ['m5a.large']¶
- clusterName = 'aws-provisioner-test-'¶
- numWorkers = ['2']¶
- numSamples = 2¶
- spotBid = 0.15¶
- scriptDir = '/tmp/t'¶
- venvDir = '/tmp/venv'¶
- dataDir = '/tmp'¶
- scriptName = 'test_script.py'¶
- script()¶
Return the full path to the user script on the leader.
- data(filename)¶
Return the full path to the data file with the given name on the leader.
- rsyncUtil(src, dest)¶
- class toil.test.provisioners.aws.awsProvisionerTest.AWSAutoscaleTest(name)¶
Bases:
AbstractAWSAutoscaleTest
A common base class for Toil tests.
Please have every test case directly or indirectly inherit this one.
When running tests you may optionally set the TOIL_TEST_TEMP environment variable to the path of a directory where you want temporary test files be placed. The directory will be created if it doesn’t exist. The path may be relative in which case it will be assumed to be relative to the project root. If TOIL_TEST_TEMP is not defined, temporary files and directories will be created in the system’s default location for such files and any temporary files or directories left over from tests will be removed automatically removed during tear down. Otherwise, left-over files will not be removed.
- clusterName = 'provisioner-test-'¶
- requestedLeaderStorage = 80¶
- scriptName = 'sort.py'¶
- setUp()¶
Set up for the test. Must be overridden to call this method and set self.jobStore.
- launchCluster()¶
- getRootVolID()¶
Adds in test to check that EBS volume is build with adequate size. Otherwise is functionally equivalent to parent. :return: volumeID
- Return type:
- testAutoScale()¶
- testSpotAutoScale()¶
- testSpotAutoScaleBalancingTypes()¶
- class toil.test.provisioners.aws.awsProvisionerTest.AWSStaticAutoscaleTest(name)¶
Bases:
AWSAutoscaleTest
Runs the tests on a statically provisioned cluster with autoscaling enabled.
- requestedNodeStorage = 20¶
- launchCluster()¶
- class toil.test.provisioners.aws.awsProvisionerTest.AWSManagedAutoscaleTest(name)¶
Bases:
AWSAutoscaleTest
Runs the tests on a self-scaling Kubernetes cluster.
- requestedNodeStorage = 20¶
- launchCluster()¶
- class toil.test.provisioners.aws.awsProvisionerTest.AWSAutoscaleTestMultipleNodeTypes(name)¶
Bases:
AbstractAWSAutoscaleTest
A common base class for Toil tests.
Please have every test case directly or indirectly inherit this one.
When running tests you may optionally set the TOIL_TEST_TEMP environment variable to the path of a directory where you want temporary test files be placed. The directory will be created if it doesn’t exist. The path may be relative in which case it will be assumed to be relative to the project root. If TOIL_TEST_TEMP is not defined, temporary files and directories will be created in the system’s default location for such files and any temporary files or directories left over from tests will be removed automatically removed during tear down. Otherwise, left-over files will not be removed.
- clusterName = 'provisioner-test-'¶
- setUp()¶
Set up for the test. Must be overridden to call this method and set self.jobStore.
- testAutoScale()¶
- class toil.test.provisioners.aws.awsProvisionerTest.AWSRestartTest(name)¶
Bases:
AbstractAWSAutoscaleTest
This test insures autoscaling works on a restarted Toil run.
- clusterName = 'restart-test-'¶
- scriptName = 'restartScript.py'¶
- setUp()¶
Set up for the test. Must be overridden to call this method and set self.jobStore.
- testAutoScaledCluster()¶
- class toil.test.provisioners.aws.awsProvisionerTest.PreemptibleDeficitCompensationTest(name)¶
Bases:
AbstractAWSAutoscaleTest
A common base class for Toil tests.
Please have every test case directly or indirectly inherit this one.
When running tests you may optionally set the TOIL_TEST_TEMP environment variable to the path of a directory where you want temporary test files be placed. The directory will be created if it doesn’t exist. The path may be relative in which case it will be assumed to be relative to the project root. If TOIL_TEST_TEMP is not defined, temporary files and directories will be created in the system’s default location for such files and any temporary files or directories left over from tests will be removed automatically removed during tear down. Otherwise, left-over files will not be removed.
- clusterName = 'deficit-test-'¶
- scriptName = 'userScript.py'¶
- setUp()¶
Set up for the test. Must be overridden to call this method and set self.jobStore.
- test()¶