PharmaQA.IT: an Italian dataset for Q&A in the pharmaceutical domain
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 5: Industry Track), EACL 2026, Rabat, Morocco
Presented on
In short
The paper introduces PharmaQA.IT, an Italian extractive question-answering dataset of 861 expert-checked question-answer pairs built from official medicine leaflets (RCP) of the Italian Medicines Agency, using a semi-automatic pipeline with a multimodal LLM over 1,077 leaflets. Tests on open and proprietary LLMs show that open models come close to closed ones when combined with chunking and retrieval.
Cite
@inproceedings{zeinalipour-etal-2026-pharmaqa,
title = "{P}harma{QA}.{IT}: an {I}talian dataset for {Q}{\&}{A} in the pharmaceutical domain",
author = "Zeinalipour, Kamyar and
Zugarini, Andrea and
Zanollo, Asya and
Rigutini, Leonardo",
editor = {Matusevych, Yevgen and
Eryi{\u{g}}it, G{\"u}l{\c{s}}en and
Aletras, Nikolaos},
booktitle = "Proceedings of the 19th Conference of the {E}uropean Chapter of the {A}ssociation for {C}omputational {L}inguistics (Volume 5: Industry Track)",
month = mar,
year = "2026",
address = "Rabat, Morocco",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2026.eacl-industry.70/",
doi = "10.18653/v1/2026.eacl-industry.70",
pages = "937--947",
ISBN = "979-8-89176-384-5"
}