Published April 27, 2020 | Version Accepted pre-print
Conference paper Open

WinoReg: A New Faster and More Accurate Metric of Hardness for Winograd Schemas

  • 1. Open University of Cyprus
  • 2. Open University of Cyprus & Research Center on Interactive Media, Smart Systems, and Emerging Technologies


The Winograd Schema Challenge (WSC), the task of resolving pronouns in certain carefully-structured sentences, has received considerable interest in the past few years as an alternative to the Turing Test. In our recent work we demonstrated the plausibility of
using commonsense knowledge, automatically acquired from raw text in English Wikipedia, towards computing a metric of hardness for a limited number of Winograd Schemas. In this work we present WinoReg, a new system to compute hardness of Winograd
Schemas, by training a Random Forest classier over a rich set of features identied in relevant WSC works in the literature. Our empirical study shows that this new system is considerably faster and more accurate compared to the system proposed in our earlier
work, making its use as part of other WSC-based systems feasible.


This work has received funding from the European Union's Horizon 2020 Research and Innovation Programme under Grant Agreement No 739578 and under Grant Agreement No 823783 and the Government of the Republic of Cyprus through the Directorate General for European Programmes, Coordination and Development.



Files (433.2 kB)

Name Size Download all
433.2 kB Preview Download

Additional details


WeNet – WeNet - The Internet of US 823783
European Commission
RISE – Research Center on Interactive Media, Smart System and Emerging Technologies 739578
European Commission