LORENZO LASTILLA

PhD Graduate

PhD program:: XXXIV


supervisor: Silvia Ferrara

Thesis title: Digital Palaeography as a matter of sign representation: from the reconstruction of the objective shape of the inscriptions to their analysis through Deep Neural Networks

Digital palaeography can be synthetically defined as the combination of traditional palaeographic methods (aimed at studying historic writing systems and at analyzing, deciphering, and dating handwritten texts, based on very specific stylistic features) and techniques for digitizing inscriptions, tools and algorithms for data processing and (shared) analysis, and databases for data management. Included in the broader field of Digital Humanities, this discipline has benefited, in recent years, on the one hand from increasingly advanced digitization techniques (such as Reflectance Transformation Imaging, Multispectral Imaging, X-ray Computed Tomography, and 3D modelling), and, on the other, from the development of sophisticated algorithms for data analysis of the (already) digitized inscriptions, mainly including data-driven methodologies, and, more precisely, machine and deep learning solutions. This thesis is part of this relatively recent research field, with a focus on the fundamental problem of the high-quality and correct representation of signs, inscriptions, and handwritten texts in general. In particular, the concept of representation (that is, of re-elaboration through a simplifying model) of the signs is explored from two different perspectives. On the one hand, if we consider the problem of inscription digitization, a high-level representation of an inscription corresponds to a replica of the signs as accurate as possible from a metric and morphological point of view, so that a close inspection is possible even remotely, and that also the smallest details – including those not immediately visible to the naked eye – are highlighted. On the other hand, the same concept has been studied from the point of view of the automatic analysis of the inscriptions (given that they are already available in a digital format): in this case, by optimal representation we mean a transformation of the original data (for example, from an image of a sign to a feature vector) which maximizes the performance of an algorithm aimed at solving a task which involves that data. The first interpretation of this basic concept was deepened by considering the problem of the digitization of four undeciphered writing systems, three of which were in use in the second millennium BCE Aegean (Cretan Hieroglyphic, Linear A, and Cypro-Minoan), plus Rongorongo (of uncertain dating), used on Easter Island (this research direction was investigated within the ERC project INSCRIBE, with Prof. Silvia Ferrara as Principal Investigator). Since these writing systems are generally “three-dimensional”, typically carved on objects of very small dimensions (of the order of 1-5 cm), and characterized by signs a few tenths of a millimeter deep, their digitization was mainly carried out through accurate and high resolution 3D modelling techniques, such as macro-photogrammetry (combined with focus stacking) and structured light scanning, able to guarantee an accuracy in the order of 1-2 hundredths of a millimeter. During the Ph.D., a total of 166 3D models were acquired, on the basis of which accuracy, precision, texture quality, and legibility assessments were made. The results produced clearly demonstrate the high potential of the methodologies adopted (and refined with specific measures) compared to the need to produce representations as faithful as possible to the original inscriptions. If we move to the concept of representation from the point of view of the automatic analysis of the inscriptions, this second line of investigation was deepened by considering two different case studies. The first one involves the signs of the Cretan Hieroglyphic undeciphered writing system: in this case, the goal is to train an encoder (based on a deep residual network) of the signs to produce representations, or feature vectors, suitable for the task of sign classification (according to the Cretan Hieroglyphic sign repertoire). For the second case study, instead, a group of (digitized) medieval and modern manuscripts from the Vatican Apostolic Library was selected, with the aim of training an encoder, also here based on a deep residual network, to extract from the manuscript pages useful representations for the task of handwriting identification, or the subdivision of the manuscripts into parts belonging to distinct scribes, on the basis of the respective handwriting style. However, for both case studies a sufficient amount of annotated or labeled data was missing (a typical problem in the palaeographic domain and known as “data scarcity”). This problem made the direct use of supervised learning techniques impossible, although until recently they have been the most efficient strategy for extracting high-level representations from data. To cope with this, in both cases a self-supervised pretraining solution was tested (using a method available in the literature and based on the reconstruction of Bags of Visual Words), capable of leveraging large amounts of unlabeled data to learn high-level representations. For both case studies, it has been shown how the inclusion of a self-supervised pretraining phase has a beneficial effect on the performance in the task itself, and therefore on the extraction of useful representations from the data. In summary, therefore, this thesis has focused on the concept of optimal representation of inscriptions and handwritten texts in the context of digital palaeography. Among the main contributions, we can list the definition of 3D modelling techniques and practices for the accurate and high resolution reconstruction of inscriptions (plus some innovations in the processing and post-processing stages of the 3D models), and the identification of self-supervised learning as a powerful prompt to solve problems of interest in palaeography through data-driven approaches, although this research field is intrinsically affected (at least at present) by a lack of annotated data.

Research products

11573/1670826 - 2023 - CycleDRUMS: automatic drum arrangement for bass lines using CycleGAN
Barnabò, Giorgio; Trappolini, Giovanni; Lastilla, Lorenzo; Campagnano, Cesare; Fan, Angela; Petroni, Fabio; Silvestri, Fabrizio - 01a Articolo in rivista
paper: DISCOVER ARTIFICIAL INTELLIGENCE (Cham: Springer International Publishing) pp. - - issn: 2731-0809 - wos: (0) - scopus: 2-s2.0-85164904687 (3)

11573/1611118 - 2022 - Self-supervised learning for medieval handwriting identification. A case study from the Vatican Apostolic Library
Lastilla, L.; Ammirati, S.; Firmani, D.; Komodakis, N.; Merialdo, P.; Scardapane, S. - 01a Articolo in rivista
paper: INFORMATION PROCESSING & MANAGEMENT (Elsevier Science Limited:Oxford Fulfillment Center, PO Box 800, Kidlington Oxford OX5 1DX United Kingdom:011 44 1865 843000, 011 44 1865 843699, EMAIL: asianfo@elsevier.com, tcb@elsevier.co.UK, INTERNET: http://www.elsevier.com, http://www.elsevier.com/locate/shpsa/, Fax: 011 44 1865 843010) pp. 1-20 - issn: 0306-4573 - wos: WOS:000754709000001 (4) - scopus: 2-s2.0-85124193308 (8)

11573/1611110 - 2022 - A high-resolution photogrammetric workflow based on focus stacking for the 3D modeling of small Aegean inscriptions
Ravanelli, R.; Lastilla, L.; Ferrara, Silvia - 01a Articolo in rivista
paper: JOURNAL OF CULTURAL HERITAGE (Paris: Elsevier, cop. 1999-) pp. 130-145 - issn: 1296-2074 - wos: WOS:000778717900001 (7) - scopus: 2-s2.0-85124094465 (8)

11573/1696647 - 2022 - The Rongorongo tablet C. New technologies and conventional approaches to an undeciphered text
Valerio, Miguel; Lastilla, Lorenzo; Ravanelli, Roberta - 01a Articolo in rivista
paper: LINGUE E LINGUAGGIO (Bologna: il Mulino Società editrice) pp. 333-367 - issn: 1720-9331 - wos: WOS:000906789800007 (1) - scopus: 2-s2.0-85148507847 (2)

11573/1495932 - 2021 - DSM Generation from Single and Cross-Sensor Multi-View Satellite Images Using the New Agisoft Metashape: The Case Studies of Trento and Matera (Italy)
Lastilla, Lorenzo; Belloni, Valeria; Ravanelli, Roberta; Crespi, Mattia - 01a Articolo in rivista
paper: REMOTE SENSING (Basel : Molecular Diversity Preservation International) pp. - - issn: 2072-4292 - wos: WOS:000624428600001 (13) - scopus: 2-s2.0-85100760438 (17)

11573/1611101 - 2021 - Modelling the Rongorongo tablets. A new transcription of the Échancrée tablet and the foundation for decipherment attempts
Lastilla, Lorenzo; Ravanelli, Roberta; Valério, Miguel; Ferrara, Silvia - 01a Articolo in rivista
paper: DIGITAL SCHOLARSHIP IN THE HUMANITIES (Oxford : Oxford University Press) pp. - - issn: 2055-768X - wos: WOS:000763967500001 (5) - scopus: 2-s2.0-85124069880 (5)

11573/1552590 - 2021 - POSE-ID-on—A Novel Framework for Artwork Pose Clustering
Marsocci, V; Lastilla, L - 01a Articolo in rivista
paper: ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION (Basel : MDPI) pp. - - issn: 2220-9964 - wos: WOS:000643083800001 (1) - scopus: 2-s2.0-85106514204 (1)

11573/1581676 - 2021 - Sharing soil and building geophysical data for seismic characterization of cities using CLARA Webgis. A case study of Matera (southern Italy)
Tragni, N.; Calamita, G.; Lastilla, L.; Belloni, V.; Ravanelli, R.; Lupo, M.; Salvia, V.; Gallipoli, M. R. - 01a Articolo in rivista
paper: APPLIED SCIENCES (Basel: MDPI AG, 2011-) pp. - - issn: 2076-3417 - wos: WOS:000649954700001 (4) - scopus: 2-s2.0-85106653223 (6)

11573/1565846 - 2020 - First Test of Agisoft Metashape Satellite Image Processing for DSM Generation. A Case Study in Trento with Pléiades Imagery
Lastilla, L.; Ravanelli, R.; Crespi, M. - 04b Atto di convegno in volume
conference: 2020 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2020 (Waikoloa, HI, USA)
book: IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium - (978-1-7281-6374-1)

11573/1284553 - 2019 - Foss4g date for dsm generation: Sensitivity analysis of the semi-global block matching parameters
Lastilla, L.; Ravanelli, R.; Fratarcangeli, F.; Di Rita, M.; Nascetti, A.; Crespi, M. - 04c Atto di convegno in rivista
paper: INTERNATIONAL ARCHIVES OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES ([Göttingen] : Copernicus Publ.) pp. 67-72 - issn: 2194-9034 - wos: (0) - scopus: 2-s2.0-85067482451 (9)
conference: 4th ISPRS Geospatial Week 2019 (Enschede, The Netherlands)

11573/1290635 - 2019 - 3D high-quality modeling of small and complex archaeological inscribed objects: Relevant issues and proposed methodology
Lastilla, Lorenzo; Ravanelli, Roberta; Ferrara, Silvia - 04c Atto di convegno in rivista
paper: INTERNATIONAL ARCHIVES OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES ([Göttingen] : Copernicus Publ.) pp. 699-706 - issn: 2194-9034 - wos: WOS:000568508700096 (11) - scopus: 2-s2.0-85065638514 (13)
conference: 2nd International Conference of Geomatics and Restoration, GEORES 2019 (Milan, Italy)

11573/1490844 - 2019 - 3D modelling of the Mamari tablet from the Rongorongo corpus. Acquisition, processing issues, and outcomes
Lastilla, Lorenzo; Ravanelli, Roberta; Valério, Miguel; Ferrara, Silvia - 04c Atto di convegno in rivista
paper: INTERNATIONAL ARCHIVES OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES ([Göttingen] : Copernicus Publ.) pp. 85-89 - issn: 2194-9034 - wos: (0) - scopus: 2-s2.0-85076793690 (5)
conference: 2019 Optical 3D Metrology (Strasbourg, France)

11573/1345994 - 2019 - Orthoimage Generation by GÖKTÜRK-1: A Test Case in Rome
Ravanelli, R; Lastilla, L; Crespi, M - 04c Atto di convegno in rivista
paper: PROCEEDINGS OF THE IEEE ([New York, N.Y.] : Institute of Electrical and Electronics Engineers) pp. 839-843 - issn: 1558-2256 - wos: WOS:000492052500137 (1) - scopus: 2-s2.0-85073911208 (1)
conference: 9th International Conference on Recent Advances in Space Technologies, RAST 2019 (Istanbul, Turkey)

11573/1122667 - 2018 - 3D modelling of archaeological small finds by the structure sensor range camera: comparison of different scanning applications
Ravanelli, Roberta; Lastilla, Lorenzo; Nascetti, Andrea; Di Rita, Martina; Nigro, Lorenzo; Montanari, Daria; Spagnoli, Federica; Crespi, Mattia Giovanni - 01a Articolo in rivista
paper: APPLIED GEOMATICS (Heidelberg, Germany: Springer-Verlag) pp. 1-15 - issn: 1866-9298 - wos: WOS:000449933600009 (4) - scopus: 2-s2.0-85056353764 (4)

11573/1122691 - 2017 - 3D modelling by low-cost range camera: software evaluation and comparison
Ravanelli, Roberta; Lastilla, Lorenzo.; Crespi, Mattia - 04c Atto di convegno in rivista
paper: INTERNATIONAL ARCHIVES OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES ([Göttingen] : Copernicus Publ.) pp. 209-212 - issn: 2194-9034 - wos: (0) - scopus: 2-s2.0-85051464683 (1)
conference: Sensors, Algorithms, Applications. 5th International Workshop LowCost 3D, 28–29 November 2017, Hamburg, Germany (Hamburg, Germany)

© Università degli Studi di Roma "La Sapienza" - Piazzale Aldo Moro 5, 00185 Roma