Analysis of Transformer Model Applications

Comunicación en congreso 2023

Autores: M. Cabrera-Bermejo, M. Del Jesus, A. Rivera, D. Elizondo, F. Charte, M. Pérez-Godoy

Páginas 231-243

Cómo citar esta publicación

Cabrera-Bermejo, M. I., Del Jesus, M. J., Rivera, A. J., Elizondo, D., Charte, F., & Pérez-Godoy, M. D. (2023). Analysis of Transformer Model Applications (P. G. Bringas, H. P. García, F. J. M. de Pisón, F. M. Álvarez, A. T. Lora, álvaro Herrero, … E. Corchado, Eds.). Cham: Springer Nature Switzerland.
BibTeX

Resumen

Since the emergence of the Transformer, many variations of the original architecture have been created. Revisions and taxonomies have appeared that group these models from different points of view. However, no review studies the tasks faced according to the type of data used. In this paper, the modifications applied to Transformers to work with different input data (text, image, video, etc.) and to solve disparate problems are analysed. Building on the foundations of existing taxonomies, this work proposes a new one that relates input data types to applications. The study shows open challenges and can serve as a guideline for the development of Transformer networks for specific applications with different types of data by observing development trends.

Financiación

Detalles

Editorial
Springer Nature Switzerland
Lugar del congreso
Cham
ISBN
978-3-031-40725-3