Authors:
(1) Dominic Petrak, UKP Lab, Department of Computer Science, Technical University of Darmstadt, Germany;
(2) Nafise Sadat Moosavi, Department of Computer Science, The University of Sheffield, United Kingdom;
(3) Ye Tian, Wluper, London, United Kingdom;
(4) Nikolai Rozanov, Wluper, London, United Kingdom;
(5) Iryna Gurevych, UKP Lab, Department of Computer Science, Technical University of Darmstadt, Germany.
Manual Error Type Analysis and Taxonomies
Automatic Filtering for Potentially Relevant Dialogs
Conclusion, Limitation, Acknowledgments, and References
A Integrated Error Taxonomy – Details
B Error-Indicating Sentences And Phrases
C Automatic Filtering – Implementation
D Automatic Filtering – Sentence-Level Analysis
E Task-Oriented Dialogs – Examples
F Effectiveness Of Automatic Filtering – A Detailed Analysis
G Inter-Annotator Agreement – Detailed Analysis
I Hyperparameters and Baseline Experiments
J Human-Human Dialogs – Examples
In this section, we present the collected error indicating sentences along with phrases.
Not really like fandoms, haha Just anything online that people make. (Phrase: not really like)
It is not saturday. (Phrase: it is not)
That doesn’t make sense. (Phrase: doesn’t make sense)
That makes no sense. (Phrase: makes no sense)
You should put some more things together." (Phrase: you should)
You shouldn’t be! (Phrase: you shouldn’t)
What do you mean by that?" (Phrase: what do you mean)
What are you talking about? (Phrase: what are you talking about)
It’s so important for young people to have diverse interest and develop a wide range of skills, don’t you think? (Phrase: don’t you think)
I don’t know what you’re talking about. (Phrase: don’t know)
What does that have to do with computer games? (Phrase: what does that have to do with)
12. Sorry I meant to say for the cat litter. (Phrase: sorry i meant to say)
13. That didn’t have anything to do with school. (Phrase: didn’t have anything to do with)
14. You do not make sense with your response. (Phrase: your response)
15. That’s not what I asked you. (Phrase: not what i asked)
16. I dont understand. (Phrase: don’t understand)
17. How do you mean? (Phrase: how do you mean)
18. I don’t care about price. (Phrase: i don’t care)
19. You’re not answering the questions. (Phrase: you’re not answering)
20. Like I said before I’m not one to read an actual newspaper but I do like reading opinion and political articles. (Phrase: like i said before)
21. You’re not very helpful Help Desk. (Phrase: not very helpful)
22. Are you sure that there are no hotels on the west side of town? (Phrase: are you sure)
23. I didn’t say anything was scary. (Phrase: i didn’t say)
24. I wouldn’t know this. (Phrase: i wouldn’t know this)
25. That sounds too low. (Phrase: too low)
26. I’m great, but thats off topic. (Phrase: that’s off topic)
27. No, I think when people shape their beards in different ways is really interesting as well! (Phrase: no, I think)
28. Your doing it wrong my friend. (Phrase: you’re doing it wrong)
29. What are you saying? (Phrase: what are you saying)
30. At least you have that then. (Phrase: at least you have)
31. That doesn’t answer my question. (Phrase: that doesn’t answer)
32. I am too old to hike I am in my seventies. (Phrase: i am too old)
33. You aren’t staying on topic at all. (Phrase: not staying on topic)
34. Off the subject, I am thinking of cutting my hair. (Phrase: off the subject)
35. I’m not ready to book just yet. (Phrase: i’m not ready)
36. That’s not what I asked you. (Phrase: i asked you)
37. Dude not cool. (Phrase: dude not cool)
38. I’d really like a 4 star. (Phrase: i’d really like)
39. Thats nonsense." (Phrase: thats nonsense)
40. Actually, I apologize no need to book, I was just gathering information." (Phrase: i apologize)
41. I never said I needed one. (Phrase: i never said i)
42. No I dont think so. (Phrase: no i dont think)
43. I didn’t mention anything about clowns. (Phrase: i didn’t mention)
44. That is odd for alaska. (Phrase: that is odd)
45. Not sure what that means? (Phrase: not sure what that means)
46. It can be what? (Phrase: it can be what)
47. You should learn! (Phrase: you should learn)
48. Umm, what? (Phrase: umm, what)
49. You think so? (Phrase: you think so)
50. No a park is a place and not a person, (Phrase: and not)
51. Why do you say that? (Phrase: why do you say that)
52. I guess I should have asked that first. (Phrase: i should have asked)
53. I said lets talk about sports. (Phrase: i said lets talk about)
54. You’re being annoying is whats happening. (Phrase: you’re being annoying)
55. You could have stated the goods. (Phrase: you could have stated)
56. Who was talking about color? (Phrase: who was talking about)
57. That doesn’t really matter. (Phrase: doesn’t really matter)
58. It’s actually a 1939 movie that was adapted from a novel written earlier. (Phrase: it’s actually)
59. I don’t believe a piano is a stringed instrument. (Phrase: i don’t believe)
60. That’s not relevant. (Phrase: that’s not relevant)
61. Check again. (Phrase: check again)
62. You’re wrong. (Phrase: you’re wrong)
63. That doesn’t have to do with track. (Phrase: that doesn’t have to do with)
64. Instead could it be in Madrid? (Phrase: instead could it)
65. I would prefer in Bombay. (Phrase: i would prefer)
66. No, I don’t like that. (Phrase: i don’t like that)
67. No, this does not work for me. (Phrase: this does not work)
This paper is available on arxiv under CC BY-NC-SA 4.0 DEED license.