Analysis code for our paper "Towards a Proper Evaluation of Automated Conversational Systems"
We have provided the participant survey results for the human study described in the paper. To reproduce the analysis from the study:
- Install the requirements:
pip install -r requirements.txt
- Open the analysis.ipynb notebook and run all cells.