[en] An autonomous system is constructed by a manufacturer, operates in a society subject to norms and laws, and is interacting with end-users. We address the challenge of how the moral values and views of all stakeholders can be integrated and reflected in the moral behaviour of the autonomous system. We propose an artificial moral agent architecture that uses techniques from normative systems and formal argumentation to reach moral agreements among stakeholders. We show how our architecture can be used not only for ethical practical reasoning and collaborative decision-making, but also for the explanation of such moral behavior.
Disciplines :
Computer science
Author, co-author :
Liao, Beishui
Slavkovik, Marija
van der Torre, Leon ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)
External co-authors :
yes
Language :
English
Title :
Building Jiminy Cricket: An Architecture for Moral Agreements Among Stakeholders
Publication date :
2018
Event name :
AAAI/ACM Artificial Intelligence, Ethics and Society
Event date :
January 27-28 2019
Main work title :
AAAI/ACM Artificial Intelligence, Ethics and Society
C. E. Alchourron. 1991. Conflcits of norms and revision of normative systems. Law and Philosophy 10 (1991), 413-425.
M. Anderson and S. Leigh Anderson. 2014. GenEth: A General Ethical Dilemma Analyzer. In Proceedings of the 28th AAAI Conference on AI. 253-261. http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8308
R.C. Arkin, P. Ulam, and A. R. Wagner. 2012. Moral Decision Making in Autonomous Systems: Enforcement, Moral Emotions, Dignity, Trust, and Deception. Proc. of the IEEE 100, 3 (2012), 571-589. https://doi.org/10.1109/JPROC.2011. 2173265
P. Baroni, D. Gabbay, M. Giacomin, and L. van der Torre (Eds.). 2018. Handbook of Formal Argumentation. College Publications.
T. Bench-Capon, K. Atkinson, and A. Chorley. 2005. Persuasion and Value in Legal Argument. Journal of Logic and Computation Comput. 15, 6 (2005), 1075-1097. https://doi.org/10.1093/logcom/exi058
O. Biran and C. Cotton. 2017. Explanation and Justification in Machine Learning: A Survey. In Proceedings of the IJCAI Workshop on Explainable Artificial Intelligence (XAI 2017). 8-13.
R. Booth, M. Caminada, and B. Marshall. 2018. DISCO: A Web-Based Implementation of Discussion Games for Grounded and Preferred Semantics. In COMMA (Frontiers in Artificial Intelligence and Applications), Vol. 305. IOS Press, 453-454.
S. Bringsjord, K. Arkoudas, and P. Bello. 2008. Toward a general logicist methodology for engineering ethically correct robots. IEEE Intelligent Systems 21, 4 (2008), 38-44.
V. Charisi, L.A. Dennis, M. Fisher, R. Lieck, A. Matthias, M. Slavkovik, J. Sombetzki, A.F.T. Winfield, and R. Yampolskiy. 2017. Towards Moral Autonomous Systems. CoRR abs/1703.04741 (2017). http://arxiv.org/abs/1703.04741
A. Chopra, L. van der Torre, H. Verhagen, and S. Villata. 2018. Handbook of normative multiagent systems. College Publications.
O. Cocarascu, K. Čyras, and F. Toni. 2018. Explanatory Predictions with Artificial Neural Networks and Argumentation. In Proceedings of the IJCAI/ECAI Workshop on Explainable Artificial Intelligence (XAI 2018). 26-32.
L. A. Dennis, M. Fisher, M. Slavkovik, and M. P. Webster. 2016. Formal Verification of Ethical Choices in Autonomous Systems. Robotics and Autonomous Systems 77 (2016), 1-14. https://doi.org/10.1016/j.robot.2015.11.012
L. A. Dennis, M. Fisher, and A. F. T. Winfield. 2015. Towards Verifiably Ethical Robot Behaviour. In Proceedings of AAAI Workshop on AI and Ethics. http://aaai.org/ocs/index.php/WS/AAAIW15/paper/view/10119.
V. Dignum. 2017. Responsible Autonomy. In Proceedings of the 26th IIJCAI. 4698-4704. https://doi.org/10.24963/ijcai.2017/655
P. M. Dung. 1995. On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games. Artificial Intelligence 77, 2 (1995), 321-358.
S. Dyrkolbotn, T. Pedersen, and M. Slavkovik. 2018. On the distinction between implicit and explicit ethical agency. In AAAI/ACM AIES conference. New Orleans, USA.
A. Etzioni and O. Etzioni. 2017. Incorporating Ethics into Artificial Intelligence. The Journal of Ethics (2017), 1-16. https://doi.org/10.1007/s10892-017-9252-2
International Society of Automotive Engineers. 2016. September 2016, Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. http://standards.sae.org/j3016_201609/.
F. Lindner and M.M. Bentzen. 2017. The Hybrid Ethical Reasoning Agent IM-MANUEL. In Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, HRI 2017, Vienna, Austria, March 6-9, 2017. 187-188. https://doi.org/10.1145/3029798.3038404
B. F. Malle, M. Scheutz, T. Arnold, J. Voiklis, and C. Cusimano. 2015. Sacrifice One For the Good of Many?: People Apply Different Moral Norms to Human and Robot Agents. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI'15). ACM, 117-124. https://doi.org/10.1145/2696454.2696458
T. Miller. 2017. Explanation in Artificial Intelligence: Insights from the Social Sciences. CoRR abs/1706.07269 (2017). arXiv:1706.07269 http://arxiv.org/abs/1706.07269
S. Modgil and H. Prakken. 2013. A general account of argumentation with preferences. Artificial Intelligence 195 (2013), 361-397. https://doi.org/10.1016/j.artint.2012.10.008
J. H. Moor. 2006. The Nature, Importance, and Difficulty of Machine Ethics. IEEE Intelligent Systems 21, 4 (July 2006), 18-21. https://doi.org/10.1109/MIS.2006.80
E. Pires Bjørgen, S. Øvervatn Madsen, T. Skaar Bjørknes, F. Vonheim Heimsæter, R. Håvik, M. Linderud, P.N. Longberg, L.A. Dennis, and M. Slavkovik. 2018. Cake, death, and trolleys: dilemmas as benchmarks of ethical decision-making. In AAAI/ACM AIES Conference. New Orleans, USA.
A. Sergeant. 2013. Automatic Argumentation Extraction. In The Semantic Web: Semantics and Big Data, P. Cimiano, O. Corcho, V. Presutti, L. Hollink, and S. Rudolph (Eds.). Springer SS, Berlin, Heidelberg, 656-660.
D. Vanderelst and A. Winfield. 2017. An architecture for ethical robots inspired by the simulation theory of cognition. Cognitive Systems Research (2017). https://doi.org/10.1016/j.cogsys.2017.04.002
K. Čyras, K. Satoh, and F. Toni. 2016. Explanation for Case-Based Reasoning via Abstract Argumentation. In Computational Models of Argument - Proceedings of COMMA. 243-254. https://doi.org/10.3233/978-1-61499-686-6-243
G. Vreeswijk and H. Prakken. 2000. Credulous and Sceptical Argument Games for Preferred Semantics. In JELIA (LNCS), Vol. 1919. Springer, 239-253.
W. Wallach and C. Allen. 2008. Moral Machines: Teaching Robots Right from Wrong. Oxford University Press.
D. Walton. 2011. A dialogue system specification for explanation. Synthese 182, 3 (2011), 349-374.
D. Walton. 2012. Using Argumentation Schemes for Argument Extraction: A Bottom-Up Method. Internat. Journal of Cognitive Informatics and Natural Intelligence 3 (2012). https://doi.org/doi:10.4018/jcini.2012070103
P. Ziafati. 2015. Information Engineering in Autonomous Robot Software. Ph.D. Dissertation. University of Luxembourg.
