EMANUELE ANTONIONI

Dottore di ricerca

ciclo: XXXV


supervisore: Daniele Nardi

Titolo della tesi: Tackling Sample Efficiency and Explainability in Reinforcement Learning through Integration with Planning

In modern robotics, the necessity for behaviors capable of generalizing and effectively managing complex situations has grown exponentially. Extensive research across various domains has addressed this challenge by exploring different decision-making techniques. While existing approaches to behavior generation and decision-making possess distinct strengths, they also exhibit certain drawbacks, such as computational complexity or the need for specialized problem-modeling expertise. Automated Planning approaches heavily rely on environment modeling, whereas Reinforcement Learning methods eliminate this requirement but necessitate a large number of samples to learn effective policies. This thesis endeavors to leverage the strengths of both methods to overcome the weaknesses of each. The ultimate objective is to enhance the robot's learning speed for task resolution while obtaining important, comprehensible insights into the agent's behavior. To assess the proposed methodologies, the research community advocates the utilization of diverse testbeds. In the context of this thesis, our focus lies on a range of demanding environments, with a notable emphasis on the RoboCup competition. This competition entails a fully autonomous five-on-five soccer game. The game has progressively evolved into a more dynamic and active scenario within these Soccer Robots competitions. The diversity of challenges presented in RoboCup provides an excellent opportunity for testing and benchmarking the performance of complex decision-making algorithms. Participants can evaluate their algorithms' efficacy in multi-agent coordination, strategic positioning, and tactical decision-making. Furthermore, the competitive aspect of RoboCup fosters innovation and drives the development of intelligent agents capable of sophisticated decision-making.

Produzione scientifica

  • 11573/1684405 - 2022 - Nothing About Us Without Us: a participatory design for an Inclusive Signing Tiago Robot (04d Abstract in atti di convegno)
    ANTONIONI, EMANUELE; DI RENZO, ALESSIO; BLOISI, DOMENICO DANIELE; WANG, LUN; BARTOLI, ERMANNO; DIACO, LORENZO; PRESUTTI, VALENTINA; NARDI, DANIELE
  • 11573/1673106 - 2022 - Adaptive Team Behavior Planning using Human Coach Commands (04b Atto di convegno in volume)
    MUSUMECI, EMANUELE; SURIANI, VINCENZO; ANTONIONI, EMANUELE; NARDI, DANIELE; BLOISI, DOMENICO DANIELE
  • 11573/1673120 - 2023 - European Robotics League: Benchmarking through Smart City Robot Competitions (02a Capitolo o Articolo)
    NARDI, DANIELE; WANG, LUN; ANTONIONI, EMANUELE; SURIANI, VINCENZO; IOCCHI, LUCA
  • 11573/1487660 - 2020 - Autonomous and Remote Controlled Humanoid Robot for Fitness Training (04b Atto di convegno in volume)
    ANTONIONI, EMANUELE; SURIANI, VINCENZO; MASSA, NICOLETTA; NARDI, DANIELE
  • 11573/1581213 - 2021 - Learning a Symbolic Planning Domain through the Interaction with Continuous Environments (04f Poster)
    UMILI, ELENA; ANTONIONI, EMANUELE; RICCIO, FRANCESCO; CAPOBIANCO, ROBERTO; NARDI, DANIELE; DE GIACOMO, GIUSEPPE
  • 11573/1583900 - 2021 - Questioning Items’ Link in Users’ Perception of a Training Robot for Elders (04b Atto di convegno in volume)
    ANTONIONI, EMANUELE; MASSA, NICOLETTA; NARDI, DANIELE; SURIANI, VINCENZO
  • 11573/1619623 - 2021 - Learning from the Crowd: Improving the Decision Making Process in Robot Soccer using the Audience Noise (02a Capitolo o Articolo)
    ANTONIONI, EMANUELE; SURIANI, VINCENZO; BLOISI, DOMENICO DANIELE; NARDI, DANIELE
  • 11573/1620604 - 2021 - Game Strategies for Physical Robot Soccer Players: A Survey (01a Articolo in rivista)
    ANTONIONI, EMANUELE; SURIANI, VINCENZO; RICCIO, FRANCESCO; NARDI, DANIELE
  • 11573/1621095 - 2021 - Improving Sample Efficiency in Behavior Learning by Using Sub-optimal Planners for Robots (04b Atto di convegno in volume)
    ANTONIONI, EMANUELE; NARDI, DANIELE; RICCIO, FRANCESCO
  • 11573/1619614 - 2021 - Coordination and Cooperation in Robot Soccer (02a Capitolo o Articolo)
    SURIANI, VINCENZO; ANTONIONI, EMANUELE; RICCIO, FRANCESCO; NARDI, DANIELE

© Università degli Studi di Roma "La Sapienza" - Piazzale Aldo Moro 5, 00185 Roma