Download PDFOpen PDF in browser

Teaching Vampire New Tricks: An Experimental Study of Neural Clause Selection

19 pages•Published: October 23, 2026

Abstract

A neural clause-selection guidance approach in the Vampire theorem prover was recently shown to substantially improve the success rate of the prover's default strategy on the TPTP benchmark. We experimentally study the impact of the approach across several ITP-derived benchmark sets and its interaction with theorem proving strategies.
We find that while the neural guidance consistently improves performance within individual benchmark domains, cross-benchmark application of guiding models underperforms the plain default strategy. This can be remedied by training a single model on all datasets at once. Such a model, although more expensive to obtain, helps Vampire almost catch up in performance across all datasets. The picture when considering combined strategies is less clear-cut, indicating persisting value of neural guidance but under diminishing returns.

Keyphrases: itp hammers, neural clause selection guidance, proving strategies, saturation based theorem proving, vampire

In: Erika Ábrahám, Nikolaj Bjørner and Michael Rawson (editors). Proceedings of the 26th Conference on Logic for Programming, Artificial Intelligence, and Reasoning, vol 112, pages 42-60.

BibTeX entry
@inproceedings{LPAR-26:Teaching_Vampire_New_Tricks,
  author    = {Karel Chvalovský and Martin Suda and Josef Urban},
  title     = {Teaching Vampire New Tricks: An Experimental Study of Neural Clause Selection},
  booktitle = {Proceedings of the 26th Conference on Logic for Programming, Artificial Intelligence, and Reasoning},
  editor    = {Erika Ábrahám and Nikolaj Bjørner and Michael Rawson},
  series    = {EPiC Series in Computing},
  volume    = {112},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-7340},
  url       = {/publications/paper/vLFt},
  doi       = {10.29007/9dkc},
  pages     = {42-60},
  year      = {2026}}
Download PDFOpen PDF in browser