toil.test.server.serverTest
¶
Module Contents¶
Classes¶
Tests for the utility functions used by the Toil server. |
|
Test file-based state storage. |
|
Test file-based state storage using URLs instead of local paths. |
|
Base class for tests that need a bucket. |
|
Test AWS-based state storage. |
|
Class for server tests that provides a self.app in testing mode. |
|
Tests for Toil's Workflow Execution Service API that don't run workflows. |
|
Tests of the WES server running workflows. |
|
End-to-end workflow-running tests against Celery. |
|
Test the server with Celery and state stored in S3. |
Attributes¶
- toil.test.server.serverTest.logger¶
- class toil.test.server.serverTest.ToilServerUtilsTest(methodName='runTest')[source]¶
Bases:
digraph inheritanceeeacb90502 { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilServerUtilsTest" [URL="#toil.test.server.serverTest.ToilServerUtilsTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Tests for the utility functions used by the Toil server."]; "ToilTest" -> "ToilServerUtilsTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }toil.test.ToilTest
Tests for the utility functions used by the Toil server.
Bases:
digraph inheritance5060f800d4 { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AbstractStateStoreTest" [URL="#toil.test.server.serverTest.hidden.AbstractStateStoreTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Basic tests for state stores."]; "ToilTest" -> "AbstractStateStoreTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }toil.test.ToilTest
Basic tests for state stores.
Make a state store to test, on a single fixed URL.
- Return type:
Make sure that the state store under test can store and load keys.
- Return type:
None
- class toil.test.server.serverTest.FileStateStoreTest(methodName='runTest')[source]¶
Bases:
digraph inheritance53ef2783ed { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AbstractStateStoreTest" [URL="#toil.test.server.serverTest.hidden.AbstractStateStoreTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Basic tests for state stores."]; "ToilTest" -> "AbstractStateStoreTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "FileStateStoreTest" [URL="#toil.test.server.serverTest.FileStateStoreTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Test file-based state storage."]; "AbstractStateStoreTest" -> "FileStateStoreTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }hidden
Test file-based state storage.
- setUp()[source]¶
Hook method for setting up the test fixture before exercising it.
- Return type:
None
- class toil.test.server.serverTest.FileStateStoreURLTest(methodName='runTest')[source]¶
Bases:
digraph inheritance26f25b1a02 { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AbstractStateStoreTest" [URL="#toil.test.server.serverTest.hidden.AbstractStateStoreTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Basic tests for state stores."]; "ToilTest" -> "AbstractStateStoreTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "FileStateStoreURLTest" [URL="#toil.test.server.serverTest.FileStateStoreURLTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Test file-based state storage using URLs instead of local paths."]; "AbstractStateStoreTest" -> "FileStateStoreURLTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }hidden
Test file-based state storage using URLs instead of local paths.
- setUp()[source]¶
Hook method for setting up the test fixture before exercising it.
- Return type:
None
- class toil.test.server.serverTest.BucketUsingTest(methodName='runTest')[source]¶
Bases:
digraph inheritance61fd6478b6 { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "BucketUsingTest" [URL="#toil.test.server.serverTest.BucketUsingTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Base class for tests that need a bucket."]; "ToilTest" -> "BucketUsingTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }toil.test.ToilTest
Base class for tests that need a bucket.
- class toil.test.server.serverTest.AWSStateStoreTest(methodName='runTest')[source]¶
Bases:
digraph inheritancea11779b881 { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AWSStateStoreTest" [URL="#toil.test.server.serverTest.AWSStateStoreTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Test AWS-based state storage."]; "AbstractStateStoreTest" -> "AWSStateStoreTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "BucketUsingTest" -> "AWSStateStoreTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "AbstractStateStoreTest" [URL="#toil.test.server.serverTest.hidden.AbstractStateStoreTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Basic tests for state stores."]; "ToilTest" -> "AbstractStateStoreTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "BucketUsingTest" [URL="#toil.test.server.serverTest.BucketUsingTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Base class for tests that need a bucket."]; "ToilTest" -> "BucketUsingTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }hidden
,BucketUsingTest
Test AWS-based state storage.
- bucket_path = 'prefix/of/keys'¶
- class toil.test.server.serverTest.AbstractToilWESServerTest(*args, **kwargs)[source]¶
Bases:
digraph inheritance994295b50d { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AbstractToilWESServerTest" [URL="#toil.test.server.serverTest.AbstractToilWESServerTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Class for server tests that provides a self.app in testing mode."]; "ToilTest" -> "AbstractToilWESServerTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }toil.test.ToilTest
Class for server tests that provides a self.app in testing mode.
- class toil.test.server.serverTest.ToilWESServerBenchTest(*args, **kwargs)[source]¶
Bases:
digraph inheritance9a1150eb08 { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AbstractToilWESServerTest" [URL="#toil.test.server.serverTest.AbstractToilWESServerTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Class for server tests that provides a self.app in testing mode."]; "ToilTest" -> "AbstractToilWESServerTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "ToilWESServerBenchTest" [URL="#toil.test.server.serverTest.ToilWESServerBenchTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Tests for Toil's Workflow Execution Service API that don't run workflows."]; "AbstractToilWESServerTest" -> "ToilWESServerBenchTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }AbstractToilWESServerTest
Tests for Toil’s Workflow Execution Service API that don’t run workflows.
- class toil.test.server.serverTest.ToilWESServerWorkflowTest(*args, **kwargs)[source]¶
Bases:
digraph inheritance01c04fb999 { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AbstractToilWESServerTest" [URL="#toil.test.server.serverTest.AbstractToilWESServerTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Class for server tests that provides a self.app in testing mode."]; "ToilTest" -> "AbstractToilWESServerTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "ToilWESServerWorkflowTest" [URL="#toil.test.server.serverTest.ToilWESServerWorkflowTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Tests of the WES server running workflows."]; "AbstractToilWESServerTest" -> "ToilWESServerWorkflowTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }AbstractToilWESServerTest
Tests of the WES server running workflows.
- run_zip_workflow(zip_path, include_message=True, include_params=True)[source]¶
We have several zip file tests; this submits a zip file and makes sure it ran OK.
If include_message is set to False, don’t send a “message” argument in workflow_params. If include_params is also set to False, don’t send workflow_params at all.
- test_run_workflow_relative_url_no_attachments_fails()[source]¶
Test run example CWL workflow from relative workflow URL but with no attachments.
- Return type:
None
- test_run_workflow_relative_url()[source]¶
Test run example CWL workflow from relative workflow URL.
- Return type:
None
- test_run_workflow_https_url()[source]¶
Test run example CWL workflow from the Internet.
- Return type:
None
- test_run_workflow_single_file_zip()[source]¶
Test run example CWL workflow from single-file ZIP.
- Return type:
None
- test_run_workflow_multi_file_zip()[source]¶
Test run example CWL workflow from multi-file ZIP.
- Return type:
None
- test_run_workflow_manifest_zip()[source]¶
Test run example CWL workflow from ZIP with manifest.
- Return type:
None
- test_run_workflow_inputs_zip()[source]¶
Test run example CWL workflow from ZIP without manifest but with inputs.
- Return type:
None
- test_run_workflow_manifest_and_inputs_zip()[source]¶
Test run example CWL workflow from ZIP with manifest and inputs.
- Return type:
None
- class toil.test.server.serverTest.ToilWESServerCeleryWorkflowTest(*args, **kwargs)[source]¶
Bases:
digraph inheritance4f372cde29 { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AbstractToilWESServerTest" [URL="#toil.test.server.serverTest.AbstractToilWESServerTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Class for server tests that provides a self.app in testing mode."]; "ToilTest" -> "AbstractToilWESServerTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "ToilWESServerCeleryWorkflowTest" [URL="#toil.test.server.serverTest.ToilWESServerCeleryWorkflowTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="End-to-end workflow-running tests against Celery."]; "ToilWESServerWorkflowTest" -> "ToilWESServerCeleryWorkflowTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "ToilWESServerWorkflowTest" [URL="#toil.test.server.serverTest.ToilWESServerWorkflowTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Tests of the WES server running workflows."]; "AbstractToilWESServerTest" -> "ToilWESServerWorkflowTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }ToilWESServerWorkflowTest
End-to-end workflow-running tests against Celery.
- class toil.test.server.serverTest.ToilWESServerCeleryS3StateWorkflowTest(*args, **kwargs)[source]¶
Bases:
digraph inheritance49302f0fbd { bgcolor=transparent; rankdir=LR; size="8.0, 12.0"; "AbstractToilWESServerTest" [URL="#toil.test.server.serverTest.AbstractToilWESServerTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Class for server tests that provides a self.app in testing mode."]; "ToilTest" -> "AbstractToilWESServerTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "BucketUsingTest" [URL="#toil.test.server.serverTest.BucketUsingTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Base class for tests that need a bucket."]; "ToilTest" -> "BucketUsingTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "TestCase" [fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",tooltip="A class whose instances are single test cases."]; "ToilTest" [URL="../../index.html#toil.test.ToilTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="A common base class for Toil tests."]; "TestCase" -> "ToilTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "ToilWESServerCeleryS3StateWorkflowTest" [URL="#toil.test.server.serverTest.ToilWESServerCeleryS3StateWorkflowTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Test the server with Celery and state stored in S3."]; "ToilWESServerWorkflowTest" -> "ToilWESServerCeleryS3StateWorkflowTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "BucketUsingTest" -> "ToilWESServerCeleryS3StateWorkflowTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; "ToilWESServerWorkflowTest" [URL="#toil.test.server.serverTest.ToilWESServerWorkflowTest",fillcolor=white,fontname="Vera Sans, DejaVu Sans, Liberation Sans, Arial, Helvetica, sans",fontsize=10,height=0.25,shape=box,style="setlinewidth(0.5),filled",target="_top",tooltip="Tests of the WES server running workflows."]; "AbstractToilWESServerTest" -> "ToilWESServerWorkflowTest" [arrowsize=0.5,style="setlinewidth(0.5)"]; }ToilWESServerWorkflowTest
,BucketUsingTest
Test the server with Celery and state stored in S3.