
Evaluate on a subset of the TPTP benchmarks on StarExec
=======================================================

1. Download the space xml of the space "TPTP-v7.0.0" using the StarExec web
  interface and save it as TPTP-v7.0.0.xml in this directory.

2. Use "filter_logic.py" to create a list of benchmarks to evaluate.
  Argument 1: the path to your local copy of the TPTP
  Argument 2: the type of benchmarks that you want,
    e.g. "tff", "thf", "tff-noarith", "thf-noarith-nolambdas"

  Example: ./filter_logic.py "../../../../TPTP-v7.0.0" "tff-noarith" > list1.txt

3. [OPTIONAL] Use "filter_fool.py" to remove the entries that require a first
  class boolean sort or contain ExistsConst/ForallConst.
  Argument 1: the list file created in the previous step
  Argument 2: the path to your local copy of the TPTP
  Argument 3: the path to zipperposition

  Example: ./filter_fool.sh list1.txt "../../../../TPTP-v7.0.0" "../../../../zipperposition" > list2.txt

4. Use "create_xml.py" create an xml file for StarExec.
  Argument 1: the list file created in the previous step
  Argument 2: the name of the new space in StarExec

  Example: ./create_xml.py list2.txt "my-new-space" > my_space.xml

5. Compress the created xml file and upload it as a new subspace to StarExec.





Short version:

./filter_logic.py "../../../../TPTP-v7.0.0" "tff-noarith" > list1_TFF.txt
./filter_logic.py "../../../../TPTP-v7.0.0" "thf-noarith-nolambdas" > list1_THF.txt
./filter_fool.sh list1_TFF.txt "../../../../TPTP-v7.0.0" "../../../../zipperposition" > list2_TFF.txt
./filter_fool.sh list1_THF.txt "../../../../TPTP-v7.0.0" "../../../../zipperposition" > list2_THF.txt
./create_xml.py list2_TFF.txt "TFF" > TFF.xml
./create_xml.py list2_THF.txt "THF" > THF.xml
tar -cf TFF.tar TFF.xml
tar -cf THF.tar THF.xml
