Ron Artstein: “Error Return Plots”

June 18, 2011 | Portland, OR

Speaker: Ron Artstein
Host: The 12th annual SIGdial Meeting on Discourse and Dialogue

Error-return plots show the rate of error (misunderstanding) against the rate of non-return (non-understanding) for Natural Language Processing systems. They are a useful visual tool for judging system performance when other measures such as recall/precision and detection-error tradeoff are less informative, specifically when a system is judged on the correctness of its responses, but may elect to not return a response.