This is the evaluation data for the experiment presented in the paper "Verifiable software
documentation in controlled natural language" by Tobias Kuhn and Alexandre Bergel.

1.png, 2.png, 3.png and 4.png are the diagrams shown to the participants during the experiment. The
first three were used during the testing phases (in different orders and for different languages).
4.png was used during the learning phases.

1.txt, 2.txt, 3.txt and 4.txt contain the corresponding statements in the different languages. Each
file contains two series, a and b, only one of which was used per participant. Statements that are
true according to the respective diagram are marked with "+"; those that are false are marked with
"-".

There were six different treatments:

ASPa: first ACE, then SOUL, then Prolog, using series a of the statements
APSb: ACE-Prolog-SOUL, series b
SAPb: SOUL-ACE-Prolog, series b
SPAa: SOUL-Prolog-ACE, series a
PASa: Prolog-ACE-SOUL, series a
PSAb: Prolog-SOUL-ACE, series b

The following pictures are screenshots of the experiment screen:

screen-instr.png:      The instructions shown at the very beginning
screen-learn-ace.png:  The learning phase for ACE
screen-test-ace.png:   The testing phase for ACE
screen-learn-soul.png: The learning phase for SOUL
screen-test-soul.png:  The testing phase for SOUL
screen-learn-pl.png:   The learning phase for Prolog
screen-test-pl.png:    The testing phase for Prolog
screen-quest.png:      The questionnaire at the very end

The details of the results can be found in the table results.ods (or results.xls).

tests.R is an R script to check the results for statistical significance. The output of this script
is in tests.lis.

