Published February 16, 2018 | Version 1.0.0

Improving Hypernymy Extraction with Distributional Semantic Classes

  • 1. University of Hamburg
  • 2. University of Mannheim

Description

In this paper, we show for the first time how distributionally-induced semantic classes can be helpful for extraction of hypernyms. We  present a method for (1) inducing sense-aware semantic classes using distributional semantics and (2) using these induced semantic classes for filtering noisy hypernymy relations. Denoising of hypernyms is performed by labeling each semantic class with its hypernyms. On one hand, this allows us to filter out wrong extractions using the global structure of the distributionally similar senses. On the other hand, we infer missing hypernyms via label propagation to cluster terms. We conduct a large-scale crowdsourcing study showing that processing of automatically extracted hypernyms using our approach improves the quality of the hypernymy extraction both in terms of precision and recall. Furthermore, we show the utility of our method in the domain taxonomy induction task, achieving the state-of-the-art results on a benchmarking dataset.

This particular page contains datasets related to the paper. Namely the input induced word senses, a database of hypernyms, and the output clusters of senses labeled with hypernyms -- the distributional semantic classes. The semantic classes are of two granularities, as described in the paper (coarse and fine grained). 

Files

ddt-mwe-45g-8m-thr-agressive2-cw-e0-N200-n200-minsize5-isas-cmb-313k-hyper-filter-closure.csv

Files (1.5 GB)

Name Size
md5:eeed2fd9419d4b576e13fcfa8bfb2e5e
341.9 MB Preview Download
md5:592871d4b1b626f1060154ff408e13d9
359.6 MB Preview Download
md5:05b90e8c11cdc1f03c93026b550f6198
809.9 MB Download
md5:79446c08aa0951199e2beddb05b437aa
1.2 MB Download
md5:914dbdc210b2fed9b6da260e2b3e0eac
5.8 MB Download
md5:65664292064159cf6288154504aeb86a
6.3 MB Download
md5:150f245f56e49180b5d5d75e709b357e
131.1 kB Download
md5:48be2a2ff177bfc42d5cbe75b55298ee
523.3 kB Download
md5:1c39165b41f0d60ca79fa170008c7a88
570.7 kB Download