EPSRC Reference: |
GR/M03481/01 |
Title: |
A MANUALLY SENSE-TAGGED GOLD STANDARD CORPUS FOR EVALUATING WORD SENSE DISAMBIGUATION PROGRAMS |
Principal Investigator: |
Evans, Dr R |
Other Investigators: |
|
Researcher Co-Investigators: |
|
Project Partners: |
|
Department: |
Information Technology Research Inst |
Organisation: |
University of Brighton |
Scheme: |
Standard Research (Pre-FEC) |
Starts: |
01 July 1998 |
Ends: |
31 March 1999 |
Value (£): |
10,255
|
EPSRC Research Topic Classifications: |
Human Communication in ICT |
|
|
EPSRC Industrial Sector Classifications: |
No relevance to Underpinning Sectors |
|
|
Related Grants: |
|
Panel History: |
|
Summary on Grant Application Form |
There are now many systems which perform word sense disambiguation (WSD) but, as yet, no satisfactory means of assessing how good they are, or where their strengths and weaknesses lie. All WSD researchers are agreed on the pressing need for an evaluation framework. Under the auspices of the Association for Computational Linguistics Special Interest Group on the Lexicon (ACL SIGLEX), a pilo0t 'SENSEVAL' (sense evaluation) exercise is proceeding in 1997-98, with the work co-ordinated by the University of Brighton. Evaluation requires an authoritative set of correct answers against which systems may be judged. This gold standard forms the centrepiece of any quantitative evaluation exercise. For SENSEVAL, the gold standard corpus is created by human experts going through large quantities of text, saying which of their dictionary senses the words are being used in. The application is for support for the manual tagging, so that pilot SENSEVAL has a gold standard corpus to work with.
|
Key Findings |
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
Potential use in non-academic contexts |
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
Impacts |
Description |
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk |
Summary |
|
Date Materialised |
|
|
Sectors submitted by the Researcher |
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
Project URL: |
|
Further Information: |
|
Organisation Website: |
http://www.bton.ac.uk |