KARL POPPER KOLLEG
About
The Faculty of Technical Sciences and the Faculty of Arts, Humanities & Education at the University of Klagenfurt (AAU) proposed an interdisciplinary Karl Popper Kolleg for the period from 2021-2024, organized by four professors (Security, Software Engineering, Psychology, and Ethics), which was approved by the AAU Rectorate in May 2020. Its title is “Responsible Safe and Secure Robotic Systems Engineering (SEEROSE)”.
Robot ethics demands programmers to write code that is not only functionally correct but also secure and safe to disallow any intended or accidental harm to humans. Hence, programmers bear a responsibility w.r.t. several instances (e.g., system customers, providers, end-users, etc.), for which awareness is required (likewise for questions of liability, which is a complex matter of contemporary research and legislation). SEEROSE aims at achieving usable robotic security by jointly addressing process ethical, psychological, and technical aspects of developing safe and secure robotics systems.
The following figure provides an overview of the four key areas and the main research questions addressed by SEEROSE.
SEEROSE features a Ph.D. project in each key area: The goal of the Ph.D. project DevSafe is to provide techniques and tools to support developers to responsibly develop and evolve safe and secure robotic systems. The goal of the Ph.D. project INBASE-GET is to provide mechanisms for incentivizing developers and robot collaborators to use and follow security precautions out of their own interests. The goal of the Ph.D. project SCoRE is to provide an instrument for the psychological assessment of the core qualifications relevant to robotics engineers. And finally, the goal of the Ph.D. project CERSE is to provide a guideline for the implementation of a process-ethical procedure for distributed assumption of responsibility in safe and secure robotic systems engineering.
The goals of SEEROSE are well aligned with the demands of the recent Vienna Manifesto on Digital Humanism. This initiative calls for “Practitioners everywhere ought to acknowledge their shared responsibility for the impact of information technologies”, and “A vision is needed for new educational curricula, combining knowledge from the humanities, the social sciences, and engineering studies”, and “Students should learn to combine information-technology skills with awareness of the ethical and societal issues at stake.” SEEROSE addresses these demands directly.
Members of the SEEROSE Kolleg
Core Group
Ao. Univ.-Prof. Mag. Dr. Rainer Alexandrowicz
Ao.Univ.-Prof. Mag. Dr. Larissa Krainer
Univ.-Prof. Dipl.-Ing.Dr. Martin Pinzger
Assoc. Prof. DDipl.Ing.Dr. Stefan Rass
PHD Students
Mag. Nicole van Geel
Project: Collective Ethical Responsibility for Robotic Systems Engineering with Security & Safety (CERSE)
Robotic systems increasingly take part in many practices within everyday life. Technological development and innovation transform fields like industrial robotics, medical technology, up to the exploration of space. However, new sets of possibilities come with new forms of responsibilities.
Engineering itself is a process that is (per)formed by many; individuals, teams, systems, norms, cultures and legislations, only to name a few. This PhD project engages with the ethical challenges that arise within safe and secure robotic systems engineering. It investigates the subjectively felt responsibility and explores the perception, governance and distribution of the networking processes of many hybrid actors in multiple heterogeneous fields. A mixed methods approach within the research design of Grounded Theory and Actor-Network Theory enables to identify and follow how responsibilities are organized and shared. The research aims to discuss which new ethical questions emerge and what competencies and strategies of safe and secure robotics engineering are required.
Supervisors:
- Larissa Krainer, Department of Media and Communications, University of Klagenfurt (AT)
- Joan Ramon Rodriguez-Amat, Culture and Creativity Research Institute, Communication and Computing Research Centre, Sheffield Hallam University (UK)
Sen. Scientist Christina Glasauer, BSc.MSc.
Project: Security Conscious Robotics Engineering (SCoRE)
Software development is a highly complex task demanding multiple competencies from engineers in order to provide functional, safe, and secure systems. Customers’ sophisticated requirements combined with software engineers’ notoriously limited resources (e.g. time pressure) may result in systems falling short in safety and security. The subproject SCoRE addresses this issue by pursuing a twofold target: On the organisational level, we identify factors fostering or hindering safe and secure development, and on the individual level, we identify robotic system engineers’ abilities, personality traits, and/or attitudes facilitating the development of safe and secure robotic systems. Thereupon, we develop standardized assessments of both organisational and individual factors. This instrument will allow for detecting structural deficits and evaluating engineers’ needs, thus forming the ground for providing adequate support and foster personal improvement of robotic systems engineers.
Supervisors:
- Rainer W. Alexandrowicz, Department of Psychology, University of Klagenfurt (AT)
- Larissa Krainer, Department of Media and Communications, University of Klagenfurt (AT)
Sen. Scientist Tareq Mohammed Nazir, MEng.
Project: Developing and Evolving Safe and Secure Robotic Systems (DevSafe)
Robotic systems are among the most complex systems that humans built. In fact, they consist of distributed multiple hardware and software components that depend on each other and often such components represent complex systems or subsystems themselves. Maintaining and evolving robotic systems is challenging and each modification poses the risk to introduce vulnerabilities in the implementation or configuration of the robotic system that allow others to attack the robotic system. In this PhD project, we will design techniques and tools to extract detailed information about code changes in robotic systems with a focus on changes that introduce security vulnerabilities. Based on this information, we will investigate algorithms and techniques to analyze and determine the impact of code changes on the safety and security of robotic systems. They will be integrated into recommender systems that guide engineers to detect and fix vulnerabilities, and help them develop safe and secure robotics systems in a responsible way.
Supervisors:
- Martin Pinzger, Department of Informatics Systems, University of Klagenfurt (AT)
- Stefan Rass, Department of Artificial Intelligence and Cybersecurity, University of Klagenfurt and LIT Secure and Correct Systems Lab, Johannes Kepler University Linz (AT)
Dipl.-Ing.Dr. Jasmin Wachter, BSc, BA
Project: Incentive-Based Security Engineering using Game Theory (INBASE-GET )
Safety requires Security in Robotic systems. Nontheless the latter is strongly neglected in robotic software engineering. Security is a costly, yet non-observable and non-functional part of software: it does not generate revenue – it „only“ prevents harm. Lacking economic incentives, security is neglected along the robotic systems supply chain. This caused a social dilemma, where the last link of the supply chain is left to secure most parts of system – despite limited knowledge on the components.
The key research questions are: How can the integration of (re)liable security be incentivized along the whole robotic supply chain to obtain a (socially) efficient outcome? And on a microscopic level: which mechanisms for developer teams install individual responsibility and (re)liability at a given point within the supply chain? The methodology to tackle these problems is the development of suitable (game theoretic) incentive mechanisms.
Supervisors:
- Wolfgang Faber, Department of Artificial Intelligence and Cybersecurity, University of Klagenfurt (AT)
- Stefan Rass, Department of Artificial Intelligence and Cybersecurity, University of Klagenfurt and LIT Secure and Correct Systems Lab, Johannes Kepler University Linz (AT)
- Paul Schweinzer, Department of Economics, University of Klagenfurt (AT)
Scientific Advisory Board
- Bram Adams, Polytechnique Montreal, Canada
- Tansu Alpcan, University of Melbourne, Australia
- Tamer Başar, University of Illinois, U.S.A.
- Ulrich Berger, Vienna University of Economics and Business, Austria
- Massimiliano Di Penta, University of Sannio, Italy
- Bernhard Dieber, Joanneum Research ROBOTICS, Austria
- Lisa-Marie Faller, Kärnten University of Applied Science
- Harald Gall, University of Zurich, Switzerland
- Endika Gil-Uriarte, Alias Robotics, Spain
- Armin Grunwald, Karlsruhe Institute of Technology, ITAS, Germany
- Jessica Heesen, Universität Tübingen, Germany
- Dietmar Jannach, Universität Klagenfurt, Austria
- Mathias Karmasin, Universität Klagenfurt, Austria
- Muhammad Taimoor Khan, University of Greenwich, UK
- Mateusz Maciaś, Industrial Research Institute for Automation and Measurements PIAP, Poland
- Manos Panaousis, University of Greenwich, UK
- Matthias Rath, Ludwigsburg Univ. of Education, Germany
- Peter Schartner, Universität Klagenfurt, Austria
- Paul Schweinzer, Universität Klagenfurt, Austria
- Further national and international collaboration partners t.b.a.
Lectures
- Duller, N. (2021a, Juni 10). Heteromatic Robots on Mars: Ethics of going Outer Space. Austrian Robotics Workshop 2021, Vienna.
- Duller, N. (2022, Juni 10). Robots are Actor-Networks. Awareness, Bottom-Up Ethics and Transforming Responsibility. 31st International Conference on Robotics in Alpe-Adria-Danube Region, Klagenfurt.
- Duller, N. (2023, March 17). Collective Ethical Responsibility for Robotic Systems Engineering with Safety and Security, CERSE. STS-Hub.de 2023, Aachen.
- Duller, N., Glasauer, Ch., Nazir, T.M. & Wachter, J. (2023, April 13). The Robotics Safety & Security Stakeholder Cycle (RobSS Stakeholder Cycle): Model for Responsible, Safe and Secure Robotic Systems Engineering. Austrian Robotics Workshop 2023, Linz.
- Glasauer, Ch. (2022). Safety & Security by Design: Individuale und Organisationale Faktoren in der Entwicklung sicherer Robotiksysteme. 14. Tagung der Österreichischen Gesellschaft für Psychologie, 4.-7. September 2022, Universität Klagenfurt.
- Nazir, T. M. and Pinzger, M. (2022, September 15). SymDefFix – Sound Automatic Repair Using Symbolic Execution. 3rd International KLEE Workshop on Symbolic Execution, London, UK.
Publications
- Duller, N. (2022). Robots are Actor-Networks: Awareness, Bottom-Up Ethics and Transforming Responsibility. In A. Müller & M. Brandstötter (Hrsg.), Advances in Service and Industrial Robotics (S. 605–612). Springer International Publishing. https://doi.org/10.1007/978-3-031-04870-8_71
- Duller, N., & Rodriguez-Amat, J. R. (2021). Heteromatic Robots on Mars. Ethics of Going Outer Space. In W. Kubinger, M. Brandstötter, C. Schöffmann, & M. Vincze (Hrsg.), Proceedings of the Austrian Robotics Workshop 2021 (S. 57–63).
- Duller, N. (in Druck). Robotik und Weltraum. In P. Grimm, O. Zöllner, & K. E. Trost (Hrsg.), Digitale Ethik. Handbuch für Wissenschaft und Praxis. Nomos.
- Duller, N., Glasauer, Ch., Nazir, T.M. & Wachter, J. (2023, in print). The Robotics Safety & Security Stakeholder Cycle (RobSS Stakeholder Cycle): A Model for Responsible, Safe and Secure Robotic Systems Engineering. Proceedings of the Austrian Robotics Workshop 2023.
- Glasauer, C. (2023). The Prevent-Model: Human and Organizational Factors Fostering Engineering of Safe and Secure Robotic Systems. In Journal of Systems and Software (Vol. 195, p. 111548). Elsevier BV. https://doi.org/10.1016/j.jss.2022.111548
- Mayoral Vilches, V., Glera-Picón, A., Carbajo, U. A:, Rass, S., Pinzger, M., Maggi, F. Gil Uriarte, E. (2022), „Hacking planned obsolescense in robotics, towards security-oriented robot teardown“, Electronic Communication of the European Association of Software Science and Technology, vol. 80.
- Nazir, T. M. and Pinzger, M. (2022, September 15). SymDefFix – Sound Automatic Repair Using Symbolic Execution. 3rd International KLEE Workshop on Symbolic Execution, London, UK.
- Rass, S. König: Synchronization in Security Games, In: Fang, F., Xu, H., Hayel, Y. (eds) Decision and Game Theory for Security. GameSec 2022. Lecture Notes in Computer Science, vol 13727. Springer, Cham. https://doi.org/10.1007/978-3-031-26369-9_7
- Rass, S., König, S., Wachter, J., Mayoral-Vilches, V. & Panaousis, E. (2023) „Game-Theoretic APT defense: An Experimental Study on Robotics“, Computers & Security. In: Computers & Security vol. 132, pp. 103328, Elsevier, doi: https://doi.org/10.1016/j.cose.2023.103328.
Awards
- Duller, N. (2023): Doktorand:innenpreis der Fachgruppe Kommunikations- und Medienethik der Deutschen Gesellschaft für Publizistik- und Kommunikationswissenschaft DGPuK.
- Wachter, J. (2023): Auslandsstipendium des Vereins Wirtschaft für Bildung.
Invited Talks
23.6.2022: Glenda Hannibal (Human Computer Interaction Group, Technical University of Vienna): Trusting Robots in a Privacy Scenario
9.6.2022: Larissa Krainer, Stefan Rass (University of Klagenfurt, Johannes Kepler University Linz): Everything goes!? Ethical reflections on the question of why security never makes us completely safe
2.6.2022: Rainer W. Alexandrowicz, Martin Pinzger (AAU): Automating software engineering: What developers should know
12.5.2022: Mathias Brandstötter (Joanneum Research Robotics): Safety Aspects of Human-Robot Systems
5.5.2022: Gabriele Lenzini (Interdisciplinary Centre for Security, Reliability and Trust (IRiSC), Université du Luxembourg): Overview of Software Vulnerability Disclosure Practices
28.4.2022: Lisa-Marie Faller (Robotics and Additive Fabrication, Carinthia University of Applied Science (FH Kärnten)): Digital Fabrication for Medical and Assistance Devices
7.4.2022: Gerhard Leitner (Institut für Informatik-Systeme, Universität Klagenfurt): From Human-Computer-Interaction (HCI) to Human-Robot-Interaction (HRI) – state of the art, challenges and potentials
31.3.2022: Oana Mitrea (Institut für Intelligente Systemtechnologien, Universität Klagenfurt): Autonomous driving in use: a closer look at the mobility of families
24.3.2022: Anita Thaler (Interdisciplinary Research Centre for Technology, Work and Culture (IFZ)): Techno-feminist issues of robotics and AI
17.3.2022: Armin Grunwald (Institute of Philosophy, KIT): „Mr. Robot Colleague …!“ On the humanisation of robots and their ethical pitfalls.
10.3.2022: Victor Mayoral-Vilches (RoboticsSystems Architect, Robotics, Xilinx): Robot Cybersecurity
22.4.2021: Lisa-Marie Faller (Professor for Robotics, FH Kärnten/University of Applied Sciences/Engineering & IT)
24.2.2021: Bernhard Dieber (Joanneum Research, Institute for Robotics and Mechatronics, Research Group Research Group Robot Systems Technologies)
