2026
|
Iranzo-Sánchez, Jorge ; Mas-Mollà, Gerard ; Gimenez, Adrià ; Civera Saiz, Jorge ; Sanchis, Albert ; Juan, Alfons MLLP-VRAIN UPV System for the IWSLT 2026 Simultaneous Speech Translation Task Inproceedings Proc. 23rd Intl. Conf. on Spoken Language Translation (IWSLT 2026), pp. 212–226, San Diego (USA), 2026. Abstract | Links | BibTeX | Tags: Cascade System, Context-Augmented SimulST, Simultaneous Speech Translation @inproceedings{Iranzo-Sánchez2026,
title = {MLLP-VRAIN UPV System for the IWSLT 2026 Simultaneous Speech Translation Task},
author = {Iranzo-Sánchez, Jorge AND Mas-Mollà, Gerard AND Gimenez, Adrià AND Civera Saiz, Jorge AND Sanchis, Albert AND Juan, Alfons},
doi = {10.18653/v1/2026.iwslt-1.24},
year = {2026},
date = {2026-01-01},
booktitle = {Proc. 23rd Intl. Conf. on Spoken Language Translation (IWSLT 2026)},
pages = {212--226},
address = {San Diego (USA)},
abstract = {This work describes the participation of the MLLP-VRAIN research group in the shared task of the IWSLT 2026 Simultaneous Speech Translation track. Our submission utilizes the recently released Parakeet and Qwen 3.5 models to create a robust, cascaded solution for long-form SimulST through the use of adaptive black-box policies. We explore relaxations of these policies to achieve better quality-latency trade-offs. Compared to last year, we participate on all language directions. In addition to this, for the En→De, It, Zh directions we also participate in this year’s new context track employing a combination of ASR word-boosting and a RAG mechanism of offline pre-translated exemplars to guide generation and enrich our system with domain-specific context. Finally, we provide a detailed latency analysis of our system. Compared to last year, results on the MCIF En→De test set shows a substantial quality improvement of +5.82 XCOMET-XL. Our context track processing further improves performance by +1.03.},
keywords = {Cascade System, Context-Augmented SimulST, Simultaneous Speech Translation},
pubstate = {published},
tppubtype = {inproceedings}
}
This work describes the participation of the MLLP-VRAIN research group in the shared task of the IWSLT 2026 Simultaneous Speech Translation track. Our submission utilizes the recently released Parakeet and Qwen 3.5 models to create a robust, cascaded solution for long-form SimulST through the use of adaptive black-box policies. We explore relaxations of these policies to achieve better quality-latency trade-offs. Compared to last year, we participate on all language directions. In addition to this, for the En→De, It, Zh directions we also participate in this year’s new context track employing a combination of ASR word-boosting and a RAG mechanism of offline pre-translated exemplars to guide generation and enrich our system with domain-specific context. Finally, we provide a detailed latency analysis of our system. Compared to last year, results on the MCIF En→De test set shows a substantial quality improvement of +5.82 XCOMET-XL. Our context track processing further improves performance by +1.03. |
2025
|
Iranzo-Sánchez, Jorge; Iranzo-Sánchez, Javier; Giménez, Adrià; Civera, Jorge Going Beyond Your Expectations in Latency Metrics for Simultaneous Speech Translation Inproceedings ACL (Findings) 2025, pp. 18205–18228, Vienna (Austria), 2025. Abstract | Links | BibTeX | Tags: latency metrics, Simultaneous Speech Translation @inproceedings{Iranzo-SánchezACL2025,
title = {Going Beyond Your Expectations in Latency Metrics for Simultaneous Speech Translation},
author = {Jorge Iranzo-Sánchez AND Javier Iranzo-Sánchez AND Adrià Giménez AND Jorge Civera},
url = {https://www.mllp.upv.es/wp-content/uploads/2025/08/poster.pdf
https://openreview.net/forum?id=mbNv6ne53X},
doi = {10.18653/v1/2025.findings-acl.937},
year = {2025},
date = {2025-01-01},
booktitle = {ACL (Findings) 2025},
pages = {18205--18228},
address = {Vienna (Austria)},
abstract = {Current evaluation practices in Simultaneous Speech Translation (SimulST) systems typically involve segmenting the input audio and corresponding translations, calculating quality and latency metrics for each segment, and averaging the results. Although this approach may provide a reliable estimation of translation quality, it can lead to misleading values of latency metrics due to an inherent assumption that average latency values are good enough estimators of SimulST systems' response time. However, our detailed analysis of latency evaluations for state-of-the-art SimulST systems demonstrates that latency distributions are often skewed and subject to extreme variations. As a result, the mean in latency metrics fails to capture these anomalies, potentially masking the lack of robustness in some systems and metrics. In this paper, a thorough analysis of the results of systems submitted to recent editions of the IWSLT simultaneous track is provided to support our hypothesis and alternative ways to report latency metrics are proposed in order to provide a better understanding of SimulST systems' latency.},
keywords = {latency metrics, Simultaneous Speech Translation},
pubstate = {published},
tppubtype = {inproceedings}
}
Current evaluation practices in Simultaneous Speech Translation (SimulST) systems typically involve segmenting the input audio and corresponding translations, calculating quality and latency metrics for each segment, and averaging the results. Although this approach may provide a reliable estimation of translation quality, it can lead to misleading values of latency metrics due to an inherent assumption that average latency values are good enough estimators of SimulST systems' response time. However, our detailed analysis of latency evaluations for state-of-the-art SimulST systems demonstrates that latency distributions are often skewed and subject to extreme variations. As a result, the mean in latency metrics fails to capture these anomalies, potentially masking the lack of robustness in some systems and metrics. In this paper, a thorough analysis of the results of systems submitted to recent editions of the IWSLT simultaneous track is provided to support our hypothesis and alternative ways to report latency metrics are proposed in order to provide a better understanding of SimulST systems' latency. |
2022
|
Iranzo-Sánchez, Javier; Jorge, Javier; Pérez-González-de-Martos, Alejandro; Giménez, Adrià; Garcés Díaz-Munío, Gonçal V; Baquero-Arnal, Pau; Silvestre-Cerdà, Joan Albert; Civera, Jorge; Sanchis, Albert; Juan, Alfons MLLP-VRAIN UPV systems for the IWSLT 2022 Simultaneous Speech Translation and Speech-to-Speech Translation tasks Inproceedings Proc. of 19th Intl. Conf. on Spoken Language Translation (IWSLT 2022), pp. 255–264, Dublin (Ireland), 2022. Abstract | Links | BibTeX | Tags: Simultaneous Speech Translation, speech-to-speech translation @inproceedings{Iranzo-Sánchez2022b,
title = {MLLP-VRAIN UPV systems for the IWSLT 2022 Simultaneous Speech Translation and Speech-to-Speech Translation tasks},
author = {Javier Iranzo-Sánchez and Javier Jorge and Alejandro Pérez-González-de-Martos and Adrià Giménez and Garcés Díaz-Munío, Gonçal V. and Pau Baquero-Arnal and Joan Albert Silvestre-Cerdà and Jorge Civera and Albert Sanchis and Alfons Juan},
doi = {10.18653/v1/2022.iwslt-1.22},
year = {2022},
date = {2022-01-01},
booktitle = {Proc. of 19th Intl. Conf. on Spoken Language Translation (IWSLT 2022)},
pages = {255--264},
address = {Dublin (Ireland)},
abstract = {This work describes the participation of the MLLP-VRAIN research group in the two shared tasks of the IWSLT 2022 conference: Simultaneous Speech Translation and Speech-to-Speech Translation. We present our streaming-ready ASR, MT and TTS systems for Speech Translation and Synthesis from English into German. Our submission combines these systems by means of a cascade approach paying special attention to data preparation and decoding for streaming inference.},
keywords = {Simultaneous Speech Translation, speech-to-speech translation},
pubstate = {published},
tppubtype = {inproceedings}
}
This work describes the participation of the MLLP-VRAIN research group in the two shared tasks of the IWSLT 2022 conference: Simultaneous Speech Translation and Speech-to-Speech Translation. We present our streaming-ready ASR, MT and TTS systems for Speech Translation and Synthesis from English into German. Our submission combines these systems by means of a cascade approach paying special attention to data preparation and decoding for streaming inference. |