VALENTINO MAIORCA

PhD Graduate

PhD program:: XXXVII


supervisor: Prof. Emanuele Rodolà
co-supervisor: Prof. Francesco Locatello

Thesis title: The Geometry of Meaning in Neural Manifolds

Just as different languages express the same concept through different words, neural networks express similar functions through incompatible coordinate systems. Different architectures, random initializations, and optimization trajectories produce incompatible parameterizations in extrinsic coordinates, obscuring functional relationships between independently trained models. A central question emerges: when models independently solve similar tasks on related data, do their learned representations share exploitable structure despite incompatible coordinates? This thesis establishes semantic correspondence as a fundamental primitive revealing shared geometric structure beneath incompatible parameterizations. By identifying which elements refer to the same semantic content, correspondence breaks the symmetry of arbitrary implementation choices, anchoring incompatible systems to a shared semantic frame and revealing the underlying intrinsic geometry that ultimately enables zero-shot transformation between independently trained models. Building on this principle, we walk through fifteen scientific contributions exploring correspondence-based alignment across diverse settings: zero-shot model stitching, cross-modal translation, policy transfer, activation steering, and neural decoding. These methods span domains (vision, language, reinforcement learning, neuroscience), architectures (CNNs, Transformers, ResNets, graph networks), and scales (from small supervised models to billion-parameter generative systems). Each exploits different geometric properties—angular, metric, spectral, sparse, or distributional—yet all instantiate the same underlying principle. Remarkably, correspondence-based alignment extends beyond artificial systems: fMRI data show that different human brains processing identical stimuli exhibit alignable geometric structure, suggesting a general principle of learning systems. From a practical standpoint, correspondence-based alignment enables model reuse without expensive joint training, knowledge transfer between independently developed systems, efficient transformation by exploiting low-dimensional semantic structure, and direct evaluation of representations in latent space without requiring downstream task deployment. The methods we developed have achieved top-tier recognition (oral and spotlight presentations) in ML conferences and widespread adoption, contributing to weakly supervised pretraining, out-of-domain detection, federated learning, and policy transfer in RL, and formed the conceptual foundation for the UniReps workshops at NeurIPS (2023–2025). By revealing intrinsic geometric structure beneath extrinsic parameterization, semantic correspondence transforms model isolation into interoperability.

Research products

11573/1759337 - 2026 - The role of low-complexity repeats in RNA–RNA interactions and a deep learning framework for duplex prediction
Setti, Adriano; Bini, Giorgio; Pellegrini, Flaminia; Maiorca, Valentino; Proietti, Gabriele; Vrachnos, Dimitrios-Miltiadis; D'angelo, Angelo; Armaos, Alexandros; Martone, Julie; Monti, Michele; Ruocco, Giancarlo; Rodolà, Emanuele; Bozzoni, Irene; Colantoni, Alessio; Tartaglia, Gian Gaetano - 01a Articolo in rivista
paper: NATURE COMMUNICATIONS (London: Nature Publishing Group-Springer Nature) pp. 1-70 - issn: 2041-1723 - wos: (0) - scopus: (0)

11573/1755558 - 2025 - ResiDual Transformer Alignment with Spectral Decomposition
Basile, Lorenzo; Maiorca, Valentino; Bortolussi, Luca; Rodola, Emanuele; Locatello, Francesco - 01a Articolo in rivista
paper: TRANSACTIONS ON MACHINE LEARNING RESEARCH (Amherst Massachusetts: OpenReview.net, 2022-) pp. - - issn: 2835-8856 - wos: (0) - scopus: (0)

11573/1755638 - 2025 - Head Pursuit: Probing Attention Specialization in Multimodal Transformers
Basile, Lorenzo; Maiorca, Valentino; Doimo, Diego; Locatello, Francesco; Cazzaniga, Alberto - 04b Atto di convegno in volume
conference: Advances in Neural Information Processing Systems (San Diego, California, USA)
book: Advances in Neural Information Processing Systems 38 (NeurIPS 2025) - ()

11573/1755636 - 2025 - LinEAS: End-to-end Learning of Activation Steering with a Distributional Loss
Rodriguez, Pau; Klein, Michal; Gualdoni, Eleonora; Maiorca, Valentino; Blaas, Arno; Zappella, Luca; Cuturi, Marco; Suau, Xavier - 04b Atto di convegno in volume
conference: Advances in Neural Information Processing Systems (San Diego, California, USA)
book: Advances in Neural Information Processing Systems 38 (NeurIPS 2025) - ()

11573/1712069 - 2024 - From Bricks to Bridges: Product of Invariances to Enhance Latent Space Communication
Cannistraci, Irene; Moschella, Luca; Fumero, Marco; Maiorca, Valentino; Rodolà, Emanuele - 04b Atto di convegno in volume
conference: The Twelfth International Conference on Learning Representations (Vienna, Austria)
book: International Conference on Learning Representations - ()

11573/1755641 - 2024 - Latent Functional Maps: a spectral framework for representation alignment
Fumero, Marco; Locatello, Francesco; Maiorca, Valentino; Pegoraro, Marco; Rodola, Emanuele - 04b Atto di convegno in volume
conference: Advances in Neural Information Processing Systems (New Orleans, Louisiana, USA)
book: Advances in Neural Information Processing Systems 37 (NeurIPS 2024) - ()

11573/1690633 - 2024 - Sparse Vicious Attacks on Graph Neural Networks
Trappolini, Giovanni; Maiorca, Valentino; Severino, Silvio; Rodola, Emanuele; Silvestri, Fabrizio; Tolomei, Gabriele - 01a Articolo in rivista
paper: IEEE TRANSACTIONS ON ARTIFICIAL INTELLIGENCE (Piscataway NJ: IEEE) pp. 2293-2303 - issn: 2691-4581 - wos: (0) - scopus: 2-s2.0-85173066368 (5)

11573/1713815 - 2023 - Bootstrapping Parallel Anchors for Relative Representations
Cannistraci, Irene; Moschella, Luca; Maiorca, Valentino; Fumero, Marco; Norelli, Antonio; Rodolà, Emanuele - 04b Atto di convegno in volume
conference: Tiny Papers Track at ICLR (Kigali, Rwanda)
book: The First Tiny Papers Track at ICLR 2023 - ()

11573/1698842 - 2023 - Latent Space Translation via Semantic Alignment
Maiorca, Valentino; Moschella, Luca; Norelli, Antonio; Fumero, Marco; Locatello, Francesco; Rodola', Emanuele - 04b Atto di convegno in volume
conference: Thirty-seventh Conference on Neural Information Processing Systems (New Orleans, Lousiana, United States of America)
book: Advances in Neural Information Processing Systems - ()

11573/1673206 - 2023 - Relative representations enable zero-shot latent space communication
Moschella, Luca; Maiorca, Valentino; Fumero, Marco; Norelli, Antonio; Locatello, Francesco; Rodola', Emanuele - 04b Atto di convegno in volume
conference: The Eleventh International Conference on Learning Representations (Kigali, Rwanda)
book: International Conference on Learning Representations - ()

11573/1724127 - 2023 - ASIF: Coupled Data Turns Unimodal Models to Multimodal without Training
Norelli, A.; Fumero, M.; Maiorca, V.; Moschella, L.; Rodola, E.; Locatello, F. - 04b Atto di convegno in volume
conference: NeurIPS (New Orleans)
book: Advances in Neural INformation Processing Systems - ()

11573/1696195 - 2023 - Attention-likelihood relationship in transformers
Ruscio, Valeria; Maiorca, Valentino; Silvestri, Fabrizio - 04b Atto di convegno in volume
conference: The Eleventh International Conference on Learning Representations (Kigali)
book: The First Tiny Papers Track at ICLR 2023 - ()

11573/1706544 - 2023 - Accelerating Transformer Inference for Translation via Parallel Decoding
Santilli, Andrea; Severino, Silvio; Postolache, Emilian; Maiorca, Valentino; Mancusi, Michele; Marin, Riccardo; Rodola, Emanuele - 04b Atto di convegno in volume
conference: The 61st Annual Meeting of the Association for Computational Linguistics (Toronto, Canada)
book: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) - ()

11573/1672156 - 2022 - Metric Based Few-Shot Graph Classification
Crisostomi, Donato; Antonelli, Simone; Maiorca, Valentino; Moschella, Luca; Marin, Riccardo; Rodola', Emanuele - 04b Atto di convegno in volume
conference: First Learning on Graphs Conference (Virtual Conference)
book: Proceedings of the First Learning on Graphs Conference - ()

11573/1599784 - 2021 - WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER
Tedeschi, Simone; Maiorca, Valentino; Campolungo, Niccolò; Cecconi, Francesco; Navigli, Roberto - 04b Atto di convegno in volume
conference: Empirical Methods in Natural Language Processing (Punta Cana, Dominican Republic)
book: Findings of the Association for Computational Linguistics: EMNLP 2021 - ()

© Università degli Studi di Roma "La Sapienza" - Piazzale Aldo Moro 5, 00185 Roma