LEV TELYATNIKOV

PhD Graduate

PhD program:: XXXVII


co-supervisor: Simone Scardapane

Thesis title: Deep Learning with Structured Data: Topology Inference and Higher-Order Modeling

Relational data --broadly defined as a set of data points and the relationships between them-- plays a foundational role across diverse real-world applications, from social networks and biological systems to recommendation engines. For decades, graph representation has been the dominant paradigm for describing relational data, providing a framework that captures pairwise interactions between entities. In recent years, Graph Neural Networks (GNNs) have emerged as a powerful tool that enables the learning of complex patterns and dependencies within relational data. GNNs have revolutionized relational data processing. However, traditional graph representation is inherently limited to encoding pairwise relations between entities. This is a fundamental constraint, as many real-world systems exhibit multi-way or higher-order interactions, where entities interact simultaneously in groups of three or more. These n-body interactions cannot be adequately captured by pairwise edges alone. Addressing this limitation requires moving beyond graphs to richer, more expressive frameworks. Recent advances in topological deep learning leverage concepts from algebraic topology—such as hypergraphs, simplicial complexes, and cell complexes—to enable higher-order network representation and modeling. The pairwise or higher-order relationships --also referred to as topology-- of relational data may present multiple challenges, such as missingness, redundancy, or even the absence of relations altogether. This last scenario, where the topology is entirely absent, opens up an intriguing possibility: any type of data may possess an underlying structure, even when it is not explicitly defined. Topology learning aims to infer underlying --in other words, latent-- topology from the data itself. This thesis contributes to methodological and practical aspects of relational data modeling, with a focus on the challenges of topology learning and higher-order network modeling. In this study, we address key challenges in these areas in multiple ways, including but not limited to: introducing novel methodologies for both graph and higher-order latent topology inference and demonstrating their effectiveness across various applications, including missing data imputation, network traffic compression, and goal-oriented semantic communication tasks. Introducing a novel conceptualization of homophily in higher-order networks; developing the MultiSet framework—capable of encompassing most current hypergraph neural network architectures—; creating the first benchmarking framework (TopoBenchmark); and proposing a new approach that combines sequence modeling with topological representations to enable efficient information propagation across different ranks.

Research products

11573/1722589 - 2024 - From latent graph to latent topology inference: differentiable cell complex module
Battiloro, C.; Spinelli, I.; Telyatnikov, L.; Bronstein, M.; Scardapane, S.; Di Lorenzo, P. - 04b Atto di convegno in volume
conference: 12th International Conference on Learning Representations (Vienna; Austria)
book: 12th International Conference on Learning Representations (ICLR 2024) - (9781713898658)

11573/1725227 - 2023 - Topological Network Traffic Compression
Bernardez, G.; Telyatnikov, L.; Alarcon, E.; Cabellos-Aparicio, A.; Barlet-Ros, P.; Lio, P. - 04b Atto di convegno in volume
conference: 2nd Graph Neural Networking Workshop, GNNet 2023 (Paris; fra)
book: GNNet 2023 - Proceedings of the 2nd Graph Neural Networking Workshop 2023 - ()

11573/1695410 - 2023 - ICML 2023 topological deep learning challenge. Design and results
Papillon, Mathilde; Hajij, Mustafa; Frantzen, Florian; Hoppe, Josef; Jenne, Helen; Mathe, Johan; Myers, Audun; Papamarkou, Theodore; Schaub, Michael T.; Zamzmi, Ghada; Birdal, Tolga; Dey, Tamal; Doster, Timothy; Emerson, Tegan H.; Gopalakrishnan, Gurusankar; Govil, D.; Grande, Vincent P.; Guzm'an-S'aenz, Aldo; Kvinge, Henry; Livesay, Neal; Meisner, Jan; Mukherjee, Soham; Samaga, Shreyas N.; Natesan Ramamurthy, Karthikeyan; Reddy Karri, Maneel; Rosen, Paul; Sanborn, Sophia; Scholkemper, Michael; Walters, Robin; Agerberg, Jens; Bokman, Georg; Barikbin, Sadrodin; Battiloro, Claudio; Bazhenov, Gleb; Bern('A)Rdez, Guillermo; Brent, Aiden; Escalera, Sergio; Fiorellino, Simone; Gavrilev, Dmitrii; Hassanin, Mohammed; Hausner, Paul; Hoff Gardaa, Odin; Khamis, Abdelwahed; Lecha, M; Magai, German; Malygina, Tatiana; Melnyk, Pavlo; Ballester, Rub('E)N; Varma Nadimpalli, Kalyan; Nikitin, Alexander; Rabinowitz, Abraham; Salatiello, Alessandro; Scardapane, Simone; Scofano, Luca; Singh, Suraj; Sjolund, Jens; Snopov, Paul; Spinelli, Indro; Telyatnikov, Lev; Testa, Lucia; Yang, Maosheng; Yue, Yixiao; Zaghen, Olga; Zia, Ali; Miolane, Nina - 04b Atto di convegno in volume
conference: International Conference on Machine Learning (Honolulu; Hawaii)
book: Proceedings of Machine Learning Research - ()

11573/1697348 - 2023 - EGG-GAE: scalable graph neural networks for tabular data imputation
Telyatnikov, L.; Scardapane, S. - 04b Atto di convegno in volume
conference: 26th International Conference on Artificial Intelligence and Statistics, AISTATS 2023 (Palau de Congressos, esp)
book: International Conference on Artificial Intelligence and Statistics, 25-27 April 2023, Palau de Congressos, Valencia, Spain - ()

© Università degli Studi di Roma "La Sapienza" - Piazzale Aldo Moro 5, 00185 Roma