inginious-autotest

Assistant to test automatically the content and the format of the task.yaml files of a courses and to check if the output of the submission.test files corresponding to submissions with the new test is consistent with the output of the test in the inginious instance.

The submission.test files for a task are situated in a test/ folder which is a sub directory of the task directory and which at the same level as the task.yaml.

inginious-autotest [-h] [--logging] [-f FILE] [--ptype PTYPE [PTYPE ...]] task_dir course_dir
-h, --help

Display the help message.

--logging

Activate the logging of the used inginious backend and docker agent

-f FILE

Write the output in a json format in the specified file in case of failure

--ptype PTYPE [PTYPE ...]

Specify additional problem types to be used.

task_dir

Path to the courses directory of inginious, corresponds to field task_directory in the configuration.yaml

course_dir

Path to the course directory to test