Seminar Abstract

SSP Group Meeting
May 6th, Wednesday, 11am-12pm,
Department of Artificial Intelligence, 80 South Bridge, Room F13

Experiment: Evaluating a Requirements Elicitation System

Renaud Lecoeuche

AIM
What am I trying to do? I have been developing a program that carries out a dialogue about WWW pages. Using it you (hopefully) can enter some requirements and generate pages. This program can use different dialogue management strategies. I need your help in order to evaluate how good (or bad) these strategies are.

EXPERIMENT
What will I do to you? I will just ask you to try entering the requirements for a particular site and then evaluate the dialogue (there is a small questionnaire to help you through that). Because the functionning system may sometimes be surprising (!), here is what I planned to help you use it:

I will do a quick demo of the program (so that you can see we can use it single-handed...) showing you all the tricks.
I will then ask you to carry out some dialogues with it (2-3) and evaluate them. I will be there to help you, should you have any problems (but I am sure you won't :-)).
If we have time, I propose to meet again and discuss the experiment.

There is no electric shocks involved but some of you may get very bad dialogues. This is done on purpose! Don't worry, try to get through as far as you can and give it a bad evaluation mark.

PREPARATION
There is no preparation needed. I will present everything you have to know on Wednesday. If you are curious and want to have a look at the progam, you are very welcome to look at ~renaudl/programs/thesis/req.txt. I have deleted the part on the task I will ask you to perform so that you will get the surprise on Wednesday.

Thank you for your help!