Kamyar Zeinalipour GitHub Hugging Face

Publications / 2024

ECWCA, Educational Crossword Clues Answering: A CALAMITA Challenge

Andrea Zugarini, Kamyar Zeinalipour, Achille Fusco, Asya Zanollo

Proceedings of the Tenth Italian Conference on Computational Linguistics (CLiC-it 2024), Pisa, Italy, CEUR Workshop Proceedings (CALAMITA challenge papers)
Presented on , 5 citations on Google Scholar

The idea of the paper in one short animation.

In short

The paper presents ECWCA, a CALAMITA challenge that tests the knowledge and reasoning of LLMs by asking them to solve Italian crossword clues, with and without hints about answer length. The clues were generated from Italian Wikipedia entities and facts and then hand-selected for correctness and clarity.

Linguistics and evaluation

Cite

@inproceedings{zugarini-etal-2024-ecwca,
    title = "{ECWCA} - Educational {C}ross{W}ord Clues Answering: A {CALAMITA} Challenge",
    author = "Zugarini, Andrea  and
      Zeinalipour, Kamyar  and
      Fusco, Achille  and
      Zanollo, Asya",
    editor = "Dell'Orletta, Felice  and
      Lenci, Alessandro  and
      Montemagni, Simonetta  and
      Sprugnoli, Rachele",
    booktitle = "Proceedings of the Tenth {I}talian Conference on Computational Linguistics ({CL}i{C}-it 2024)",
    month = dec,
    year = "2024",
    address = "Pisa, Italy",
    publisher = "CEUR Workshop Proceedings",
    url = "https://aclanthology.org/2024.clicit-1.138/",
    pages = "1239--1244",
    ISBN = "979-12-210-7060-6"
}

Related papers

All thirty-one papers