rasahq--rasa/.github/templates/README.md

gomplate templates for GitHub Actions

This document describes gomplate templates use for GitHub Actions.

Requirements

You have to have installed gomplate tool in order to render a template file.

gomplate is a template renderer which supports a growing list of datastores, such as: JSON (including EJSON - encrypted JSON), YAML, AWS EC2 metadata, BoltDB, Hashicorp Consul and Hashicorp Vault secrets.

Templates

Below you can find a list of templates with their description and the commands to render them.

configuration_variables.tmpl

The template maps dataset name and configuration name for the model regression tests into paths where files are located. As a result, the template returns two environment variables DATASET and CONFIG which contain paths to file/directory.

How to run locally

gomplate -d mapping=<path_to_json_file_with_mapping> -f .github/templates/configuration_variables.tmpl

model_regression_test_config_comment.tmpl

The template returns a comment message which is used as a help description in a PR. The template reads the .github/configs/mr-test-example.yaml file and include it as example content.

The help message is triggered by adding status:model-regression-tests label. Comment with a help message is added if a PR doesn't contain a comment with a configuration for the model regression tests.

How to run locally

gomplate -f .github/templates/model_regression_test_config_comment.tmpl

The template uses the GITHUB_ACTOR environment variable, you have to export the variable before executing the command.

model_regression_test_config_to_json.tmpl

The template reads an issue/a PR comment and transforms a YAML code block into JSON.

How to run locally

gomplate -d github=https://api.github.com/repos/${{ github.repository }}/issues/comments/${{ comment-id }} -H 'github=Authorization:token ${{ secrets.GITHUB_TOKEN }}' -f .github/templates/model_regression_test_config_to_json.tmpl

model_regression_test_results.tmpl

The template reads a file with a report (the report file is available as an artifact in the model regression tests workflow) and returns markdown table with a summary of tests.

How to run locally

gomplate -d data=report.json -d results_main=report_main.json -f .github/templates/model_regression_test_results.tmpl

In order to be able to use the .github/templates/model_regression_test_results.tmpl template you need the following files:

• report.json - the file with a report generated by the CI - Model Regression workflow run in a PR. The report is available to download as an artifact in the workflow related to the PR.
• report_main.json - the file with a report generated by the CI - Model Regression workflow that is triggered on schedule event. A list of the workflows that you can download an artifact from, can be found here.