Bayesian networks; Fault diagnosis; Mobile robots; Sensors; Bayesia n networks; Bayesian; Condition; Fault detection and diagnosis; Faults diagnosis; Probabilistic inference; Real time performance; Real-time anomaly detections; Robotic systems; Sensory system; Control and Systems Engineering; Artificial Intelligence; Electrical and Electronic Engineering
Abstract :
[en] For mobile robots to operate in an autonomous and safe manner they must be able to adequately perceive their environment despite challenging or unpredictable conditions in their sensory apparatus. Usually, this is addressed through ad-hoc, not easily generalizable Fault Detection and Diagnosis (FDD) approaches. In this work, we leverage Bayesian Networks (BNs) to propose a novel probabilistic inference architecture that provides generality, rigorous inferences and real-time performance for the detection, diagnosis and recovery of diverse and multiple sensory failures in robotic systems. Our proposal achieves all these goals by structuring a BN in a multidimensional setting that up to our knowledge deals coherently and rigorously for the first time with the following issues: modeling of complex interactions among the components of the system, including sensors, anomaly detection and recovery; representation of sensory information and other kinds of knowledge at different levels of cognitive abstraction; and management of the temporal evolution of sensory behavior. Real-time performance is achieved through the compilation of these BNs into feedforward neural networks. Our proposal has been implemented and tested for mobile robot navigation in environments with human presence, a complex task that involves diverse sensor anomalies. The results obtained from both simulated and real experiments prove that our architecture enhances the safety and robustness of robotic operation: among others, the minimum distance to pedestrians, the tracking time and the navigation time all improve statistically in the presence of anomalies, with a diversity of changes in medians ranging from ≃20% to ≃500%.
Disciplines :
Computer science
Author, co-author :
Castellano-Quero, Manuel ; Systems Engineering and Automation Department, University of Málaga, Málaga, Spain
Castillo-López, Manuel; Automation and Robotics Research Group, Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg, Luxembourg
Fernández-Madrigal, Juan-Antonio; Systems Engineering and Automation Department, University of Málaga, Málaga, Spain
Arévalo-Espejo, Vicente; Systems Engineering and Automation Department, University of Málaga, Málaga, Spain
VOOS, Holger ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Automation
García-Cerezo, Alfonso; Systems Engineering and Automation Department, University of Málaga, Málaga, Spain
External co-authors :
yes
Language :
English
Title :
A multidimensional Bayesian architecture for real-time anomaly detection and recovery in mobile robot sensory systems
Publication date :
October 2023
Journal title :
Engineering Applications of Artificial Intelligence
This work has been supported by the Spanish government through the national grant FPU16/02243 , by the University of Málaga, Spain through its local research program and the International Excellence Campus Andalucía Tech, Spain , and by the Spanish national research project RTI2018-093421-B-100 . The authors would also like to thank the anonymous reviewers for their valuable comments and suggestions, which have greatly helped to improve the quality of the paper.
Abebe-Assefa, A., Tian, W., Nketia-Acheampong, K., Umar-Aftab, M., Ahmad, M., Small-scale and occluded pedestrian detection using multi mapping feature extraction function and modified soft-NMS. Comput. Intell. Neurosci., 2022, 2022, 11.
Abid, A., Khan, M.T., Iqbal, J., A review on fault detection and diagnosis techniques: Basics and beyond. Artif. Intell. Rev. 54:5 (2021), 3639–3664, 10.1007/s10462-020-09934-2.
Abid, A., Khan, M.T., Lang, H., de Silva, C.W., Adaptive system identification and severity index-based fault diagnosis in motors. IEEE/ASME Trans. Mechatronics 24:4 (2019), 1628–1639, 10.1109/TMECH.2019.2917749.
Adhikary, A., Vatsa, R., Burnwal, A., Samanta, J., Performance evaluation of low-cost RGB-depth camera and ultrasonic sensors. 2019.
Afrassa, K.W., Boz, A.Z., Amasyali, M.F., Tahar, S., 2019. Benchmarking BNT Inference Engines using an Early Warning System. In: 2019 Innovations in Intelligent Systems and Applications Conference. ASYU, pp. 1–5.
Aggarwal, C.C., Neural Networks and Deep Learning. A Textbook. 2018, Springer, 497.
Aguilar-Moreno, M., Cruz-Martín, A., Fernández-Madrigal, J.-A., 2018. Modelado cinematico y simulacion realista del manipulador movil Turtlebot-2 + Widow-X en ROS. In: XXXIX Jornadas de Automatica. Badajoz (Spain), pp. 262–269.
Alatise, M.B., Hancke, G.P., A review on challenges of autonomous mobile robot and sensor fusion methods. IEEE Access 8 (2020), 39830–39846, 10.1109/ACCESS.2020.2975643.
Arras, K.O., Mozos, O.M., Burgard, W., Using boosted features for the detection of people in 2D range data. Proceedings 2007 IEEE International Conference on Robotics and Automation, 2007, IEEE, 3402–3407.
Azzalini, D., Castellini, A., Luperto, M., Farinelli, A., Amigoni, F., 2020. HMMs for anomaly detection in autonomous robots. In: AAMAS ’20: Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems. pp. 105–113.
Bader, K., Lussier, B., Schön, W., A fault tolerant architecture for data fusion: A real application of Kalman filters for mobile robot localization. Robot. Auton. Syst. 88 (2017), 11–23, 10.1016/j.robot.2016.11.015.
Beck, F., Bader, M., Map based human motion prediction for people tracking. 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, 2019, IEEE, 1–7.
Bonci, A., Cen Cheng, P.D., Indri, M., Nabissi, G., Sibona, F., Human-robot perception in industrial environments: A survey. Sensors, 21(5), 2021, 1571, 10.3390/s21051571.
Brunetti, A., Buongiorno, D., Trotta, G.F., Bevilacqua, V., Computer vision and deep learning techniques for pedestrian detection and tracking: A survey. Neurocomputing 300 (2018), 17–33, 10.1016/j.neucom.2018.01.092.
Cai, B., Hao, K., Wang, Z., Yang, C., Kong, X., Liu, Z., Ji, R., Liu, Y., Data-driven early fault diagnostic methodology of permanent magnet synchronous motor. Expert Syst. Appl., 177, 2021, 115000, 10.1016/j.eswa.2021.115000.
Cai, B., Huang, L., Xie, M., Bayesian networks in fault diagnosis. IEEE Trans. Ind. Inform. 13:5 (2017), 2227–2240, 10.1109/TII.2017.2695583.
Castellano-Quero, M., Fernández-Madrigal, J.-A., García-Cerezo, A., Improving Bayesian inference efficiency for sensory anomaly detection and recovery in mobile robots. Expert Syst. Appl., 163, 2021, 113755, 10.1016/j.eswa.2020.113755.
Castillo-Lopez, M., Ludivig, P., Sajadi-Alamdari, S.A., Sanchez-Lopez, J.L., Olivares-Mendez, M.A., Voos, H., A real-time approach for chance-constrained motion planning with dynamic obstacles. IEEE Robot. Autom. Lett. 5:2 (2020), 3620–3625, 10.1109/LRA.2020.2975759.
Darwiche, A., A differential approach to inference in Bayesian networks. J. ACM 50:3 (2003), 280–305, 10.1145/765568.765570.
Darwiche, A., Modeling and Reasoning with Bayesian Networks, vol. 9780521884. 2009, Cambridge University Press, New York, 1–548.
Das, D., Banerjee, S., Chernova, S., Explainable AI for robot failures. Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, 2021, ACM, New York, NY, USA, 351–360.
Dezan, C., Zermani, S., Hireche, C., Embedded Bayesian network contribution for a safe mission planning of autonomous vehicles. Algorithms, 13, 2020, 155.
Dimitrievski, M., Veelaert, P., Philips, W., Behavioral pedestrian tracking using a camera and LiDAR sensors on a moving vehicle. Sensors, 19(2), 2019, 391, 10.3390/s19020391.
Doran, M., Sterritt, R., Wilkie, G., Autonomic architecture for fault handling in mobile robots. Innov. Syst. Software Eng. 16:3–4 (2020), 263–288, 10.1007/s11334-020-00361-8.
Fan, T., Long, P., Liu, W., Pan, J., Distributed multi-robot collision avoidance via deep reinforcement learning for navigation in complex scenarios. Int. J. Robot. Res. 39:7 (2020), 856–892, 10.1177/0278364920916531.
Fernández-Madrigal, J.-A., Cruz-Martín, A., The CRUMB Project website. 2020 URL https://babel.isa.uma.es/crumb/.
Ferrera, E., Capitán, J., Castaño, A.R., Marrón, P.J., Decentralized safe conflict resolution for multiple robots in dense scenarios. Robot. Auton. Syst. 91 (2017), 179–193, 10.1016/j.robot.2017.01.008.
Galar, D., Kumar, U., Seneviratne, D., Robots, Drones, UAVs and UGVs for Operation and Maintenance. 2020, CRC Press.
Gomes, I.P., Wolf, D.F., A health monitoring system with hybrid Bayesian network for autonomous vehicle. 2019 19th International Conference on Advanced Robotics, ICAR, 2019, IEEE, 260–265.
Gomes, I.P., Wolf, D.F., Health monitoring system for autonomous vehicles using dynamic Bayesian networks for diagnosis and prognosis. J. Intell. Robot. Syst., 101(1), 2021, 19, 10.1007/s10846-020-01293-y.
Graham Miller, O., Gandhi, V., A survey of modern exogenous fault detection and diagnosis methods for swarm robotics. J. King Saud Univ., Eng. Sci. 33:1 (2021), 43–53, 10.1016/j.jksues.2019.12.005.
Guo, Q., Zhang, X., Li, J., Li, G., Fault diagnosis of modular multilevel converter based on adaptive chirp mode decomposition and temporal convolutional network. Eng. Appl. Artif. Intell., 107, 2022, 104544, 10.1016/j.engappai.2021.104544.
He, Y., Yu, Z., Li, J., Ma, G., Xu, Y., Fault correction of algorithm implementation for intelligentized robotic multipass welding process based on finite state machines. Robot. Comput.-Integr. Manuf. 59 (2019), 28–35, 10.1016/j.rcim.2019.03.002.
Helbing, D., Molnár, P., Social force model for pedestrian dynamics. Phys. Rev. E 51:5 (1995), 4282–4286, 10.1103/PhysRevE.51.4282.
Hirakawa, R., Uchida, H., Nakano, A., Tominaga, K., Nakatoh, Y., Anomaly detection on software log based on temporal memory. Comput. Electr. Eng., 95, 2021, 107433, 10.1016/j.compeleceng.2021.107433.
Honig, S., Oron-Gilad, T., Understanding and resolving failures in human-robot interaction: Literature review and model development. Front. Psychol., 9, 2018, 10.3389/fpsyg.2018.00861.
Hossain, N.U.I., Amrani, S.E., Jaradat, R., Marufuzzaman, M., Buchanan, R., Rinaudo, C., Hamilton, M., Modeling and assessing interdependencies between critical infrastructures using Bayesian network: A case study of inland waterway port and surrounding supply chain network. Reliab. Eng. Syst. Saf., 198, 2020, 106898, 10.1016/j.ress.2020.106898.
IFR, N.U.I., International Federation of Robotics. 2022 URL https://ifr.org/.
Islam, M.M., Hu, G., Liu, Q., Dan, W., Lyu, C., Correlation filter based moving object tracking with scale adaptation and online re-detection. IEEE Access 6 (2018), 75244–75258.
Jia, J., Zhou, H., Li, Y., Using deep neural network approximate Bayesian network. 2017 arXiv:1801.00282.
Kadiyam, J., Parashar, A., Mohan, S., Deshmukh, D., Actuator fault-tolerant control study of an underwater robot with four rotatable thrusters. Ocean Eng., 197, 2020, 106929, 10.1016/j.oceaneng.2020.106929.
Kang, H., Joung, J., Kim, J., Kang, J., Cho, Y.S., Protect your sky: A survey of counter unmanned aerial vehicle systems. IEEE Access 8 (2020), 168671–168710, 10.1109/ACCESS.2020.3023473.
Katz, D.S., Hutchison, C., Zizyte, M., Goues, C.L., Detecting execution anomalies as an oracle for autonomy software robustness. 2020 IEEE International Conference on Robotics and Automation, ICRA, 2020, IEEE, 9366–9373.
Keipour, A., Mousaei, M., Scherer, S., Automatic Real-time anomaly detection for autonomous aerial vehicles. 2019 International Conference on Robotics and Automation, ICRA, 2019, IEEE, 5679–5685.
Keliris, C., Polycarpou, M., T., P., An adaptive approach to sensor bias fault diagnosis and accommodation for a class of input-output nonlinear systems. 2018 IEEE Conference on Decision and Control, CDC, 2018, 6334–6339, 10.1109/CDC.2018.8619307.
Khalastchi, E., Kalech, M., Fault detection and diagnosis in multi-robot systems: A survey. Sensors, 19(18), 2019, 4019, 10.3390/s19184019.
Khalastchi, E., Kalech, M., Fault detection and diagnosis in multi-robot systems: A survey. Sensors (Basel, Switzerland), 19, 2019.
Khalastchi, E., Kalech, M., On fault detection and diagnosis in robotic systems. ACM Comput. Surv. 51:1 (2019), 1–24, 10.1145/3146389.
Koller, D., Friedman, N., Probabilistic Graphical Models: Principles and Techniques. 2009, The MIT Press, Cambridge, Massachusetts, 1270.
Kong, X., Cai, B., Liu, Y., Zhu, H., Liu, Y., Shao, H., Yang, C., Li, H., Mo, T., Optimal sensor placement methodology of hydraulic control system for fault diagnosis. Mech. Syst. Signal Process., 174, 2022, 109069, 10.1016/j.ymssp.2022.109069.
Kong, X., Cai, B., Liu, Y., Zhu, H., Yang, C., Gao, C., Liu, Y., Liu, Z., Ji, R., Fault diagnosis methodology of redundant closed-loop feedback control systems: Subsea blowout preventer system as a case study. IEEE Trans. Syst., Man, Cybern.: Syst. 53:3 (2023), 1618–1629, 10.1109/TSMC.2022.3204777.
Kontogiorgos, D., Pereira, A., Sahindal, B., van Waveren, S., Gustafson, J., Behavioural responses to robot conversational failures. Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020, ACM, New York, NY, USA, 53–62.
Kyrarini, M., Lygerakis, F., Rajavenkatanarayanan, A., Sevastopoulos, C., Nambiappan, H.R., Chaitanya, K.K., Babu, A.R., Mathew, J., Makedon, F., A survey of robots in healthcare. Technologies, 9(1), 2021, 8, 10.3390/technologies9010008.
Lei, M., Song, Y., Zhao, J., Wang, X., Lyu, J., Xu, J., Yan, W., End-to-end network for pedestrian detection, tracking and re-identification in real-time surveillance system. Sensors, 22(22), 2022, 10.3390/s22228693.
Li, Y., Yang, H., 2022. Fault Localization of Industrial Robot System based on Knowledge Graph and Bayesian Network. In: 2022 China Automation Congress. CAC, pp. 2902–2907.
Li, T., Zhou, Y., Zhao, Y., Zhang, C., Zhang, X., A hierarchical object oriented Bayesian network-based fault diagnosis method for building energy systems. Appl. Energy, 306, 2022, 118088, 10.1016/j.apenergy.2021.118088.
Liao, Y., Yeaser, A., Yang, B., Tung, J., Hashemi, E., Unsupervised fault detection and recovery for intelligent robotic rollators. Robot. Auton. Syst., 146, 2021, 103876, 10.1016/j.robot.2021.103876.
Lin, Y., Zakwan, S., Jennions, I.K., A Bayesian approach to fault identification in the presence of multi-component degradation. 2020.
Linder, T., Arras, K.O., People detection, tracking and visualization using ROS on a mobile service robot. 2016, 187–213.
Liu, C., Sun, J., Wang, F., Ning, S., Xu, G., Bayesian network method for fault diagnosis of civil aircraft environment control system. Proc. Inst. Mech. Eng., Part I: J. Syst. Control Eng. 234 (2020), 662–674.
Long, J., Mou, J., Zhang, L., Zhang, S., Li, C., Attitude data-based deep hybrid learning architecture for intelligent fault diagnosis of multi-joint industrial robots. J. Manuf. Syst. 61 (2021), 736–745, 10.1016/j.jmsy.2020.08.010.
Löwe, M., Frellsen, J., Hansen, P.L., Risi, S., 2021. Rapid Risk Minimization with Bayesian Models Through Deep Learning Approximation. In: 2021 International Joint Conference on Neural Networks. IJCNN, pp. 1–8.
Luperto, M., Monroy, J., Ruiz-Sarmiento, J.R., Moreno, F.-A., Basilico, N., Gonzalez-Jimenez, J., Borghese, N.A., Towards long-term deployment of a mobile robot for at-home ambient assisted living of the elderly. 2019 European Conference on Mobile Robots, ECMR, 2019, IEEE, 1–6.
Marquardt, D.W., An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Ind. Appl. Math. 11:2 (1963), 431–441, 10.1137/0111030.
Matsuoka, S., Sawaragi, T., Recovery planning of industrial robots based on semantic information of failures and time-dependent utility. Adv. Eng. Inform., 51, 2022, 101507, 10.1016/j.aei.2021.101507.
Medina, G., Guiochet, J., Lesire, C., Manecy, A., 2022. A skill fault model for autonomous systems. In: 2022 IEEE/ACM 4th International Workshop on Robotics Software Engineering. RoSE, pp. 55–62.
Miklavcic, S.J., An Illustrative Guide To Multivariable and Vector Calculus. 2020, Springer, 325.
Mirnaghi, M.S., Haghighat, F., Fault detection and diagnosis of large-scale HVAC systems in buildings using data-driven methods: A comprehensive review. Energy Build., 229, 2020, 110492, 10.1016/j.enbuild.2020.110492.
Møller, M.F., A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw. 6:4 (1993), 525–533, 10.1016/S0893-6080(05)80056-5.
Mondal, P.P., Ferreira, P.M., Kapoor, S.G., Bless, P.N., Monitoring and diagnosis of multistage manufacturing processes using hierarchical Bayesian networks. Procedia Manuf. 53 (2021), 32–43, 10.1016/j.promfg.2021.06.007.
Murphy, K.P., Dynamic Bayesian Networks: Representation, Inference and Learning. (Ph.D. thesis), 2002, University of California, Berkeley, 225.
Newman, W., A Systematic Approach To Learning Robot Programming with ROS. 2017, Chapman and Hall/CRC, 502.
Open Source Robotics Foundation, W., Turtlebot website. 2020 URL https://www.turtlebot.com/turtlebot2/.
Pacini, D.H., Identification in parametric models: The minimum hellinger distance criterion. Econometrics, 2022.
Pardo, L., Statistical Inference Based on Divergence Measures. 2006, Chapman and Hall/CRC, New York, 512.
Pearl, J., 1985. Bayesian networks: A model of self-activated memory for evidential reasoning. In: Proceedings of the 7th Conference of the Cognitive Science Society. (ISSN: 1548-7091) pp. 329–334.
Rakesh, S.K., Shrivastava, M., Performance analysis of fault tolerance algorithm for pattern formation of swarm agents. Knowl.-Based Syst., 240, 2022, 108020, 10.1016/j.knosys.2021.108020.
Rodríguez, J.S., A comparison of an RGB-d cameras performance and a stereo camera in relation to object recognition and spatial position determination. Electron. Lett. Comput. Vis. Image Anal. 20 (2021), 16–27.
Russell, S., Norvig, P., Artificial Intelligence: A Modern Approach. 2020, Pearson, 1136.
Shakhatreh, H., Sawalmeh, A.H., Al-Fuqaha, A., Dou, Z., Almaita, E., Khalil, I., Othman, N.S., Khreishah, A., Guizani, M., Unmanned aerial vehicles (UAVs): A survey on civil applications and key research challenges. IEEE Access 7 (2019), 48572–48634, 10.1109/ACCESS.2019.2909530.
Shao, Y., Liu, B., Wang, S., Li, G., A novel software defect prediction based on atomic class-association rule mining. Expert Syst. Appl. 114 (2018), 237–254, 10.1016/j.eswa.2018.07.042.
Singh, A., Raj, K., Kumar, T., Verma, S., Roy, A.M., Deep learning-based cost-effective and responsive robot for autism treatment. Drones, 7(2), 2023, 10.3390/drones7020081.
SPENCER, A., Official web page of the EU FP7 research project 2013–2016: Social situation-aware perception and action for cognitive robots (SPENCER). 2016 URL http://spencer.eu/.
SPENCER, A., GitHub page of the EU FP7 spencer research project. 2023 URL https://github.com/spencer-project/spencer_people_tracking.
Sumi, A., Santha, T., Frame level difference (FLD) features to detect partially occluded pedestrian for ADAS. J. Sci. Ind. Res. 78 (2019), 831–836.
Tarapore, D., Timmis, J., Christensen, A.L., Fault detection in a swarm of physical robots based on behavioral outlier detection. IEEE Trans. Robot. 35:6 (2019), 1516–1522, 10.1109/TRO.2019.2929015.
Teh, H.Y., Kempa-Liehr, A., Wang, K.I.-K., Sensor data quality: A systematic review. J. Big Data 7 (2020), 1–49.
Tolmeijer, S., Weiss, A., Hanheide, M., Lindner, F., Powers, T.M., Dixon, C., Tielman, M.L., Taxonomy of Trust-Relevant Failures and Mitigation Strategies. Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020, ACM, New York, NY, USA, 3–12.
Vaish, R., Dwivedi, U., Tewari, S., Tripathi, S., Machine learning applications in power system fault diagnosis: Research advancements and perspectives. Eng. Appl. Artif. Intell., 106, 2021, 104504, 10.1016/j.engappai.2021.104504.
Wang, H., Kang, Y., Yao, L., Wang, H., Gao, Z., Fault diagnosis and fault tolerant control for T–S fuzzy stochastic distribution systems subject to sensor and actuator faults. IEEE Trans. Fuzzy Syst. 29:11 (2021), 3561–3569, 10.1109/TFUZZ.2020.3024659.
Yang, Z., Huang, Z., He, D., Zhang, T., Yang, F., Dynamic representation-based tracker for long-term pedestrian tracking with occlusion. J. Vis. Commun. Image Represent., 90, 2023, 103710, 10.1016/j.jvcir.2022.103710.
Yu, Y., Dong, Y., Global fault-tolerant control of underactuated aerial vehicles with redundant actuators. Int. J. Aerospace Eng., 2019.
Zahaf, A., Bououden, S., Chadli, M., Chemachema, M., Robust fault tolerant optimal predictive control of hybrid actuators with time-varying delay for industrial robot arm. Asian J. Control 24:1 (2022), 1–15, 10.1002/asjc.2444.
Zhang, D., Liu, Q., Yan, H., Xie, M., A matrix analytic approach for Bayesian network modeling and inference of a manufacturing system. J. Manuf. Syst. 60 (2021), 202–213, 10.1016/j.jmsy.2021.05.016.
Zhao, Y., Tong, J., Zhang, L., Wu, G., Diagnosis of operational failures and on-demand failures in nuclear power plants: An approach based on dynamic Bayesian networks. Ann. Nucl. Energy, 138, 2020, 107181, 10.1016/j.anucene.2019.107181.
Zhi, H., Yangi-Shang, J., Remote performance evaluation, life prediction and fault diagnosis of RV reducer for industrial robot. J. Phys. Conf. Ser., 1676, 2020.
Zhou, Y., Burg, S., Bringmann, O., Rosenstiel, W., 2018. A software reconfigurable assertion checking unit for run-time error detection. In: 2018 IEEE 23rd European Test Symposium. ETS, pp. 1–6.
Zou, T., Yang, S., Zhang, Y., Ye, M., Attention guided neural network models for occluded pedestrian detection. Pattern Recognit. Lett. 131 (2020), 91–97, 10.1016/j.patrec.2019.12.010.
Ahammad, T., Hasan, M.Z., Hassan, M.Z., 2020. A New Topological Sorting Algorithm with Reduced Time Complexity. In: ICO.
Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C., Introduction to Algorithms. 2022, The MIT Press, 1–1312.