... database, and an automatically acquired on-tology made by clustering words in a large corpusof unannotated text.We have chosen to use hierarchical schemes forboth the automatic and manually ... con-ducted to determine inter-annotator consistency;in addition, annotator accuracy was measured on5,000 words of data. Both the agreement and ac-curacy were found to be approximately 97%, withall ... proportions as the training data, and labeledwith a set of up to 6 allowable tags for each word.During testing, only if the predicted tag fails to match any of the allowed tags is it considered anerror.4...