[en] Blockchain technologies, also known as Distributed Ledger Technologies (DLT), are increasingly being explored in many applications, especially in the presence of (potential) dis-/mis-/un-trust among organizations and individuals. Today, there exists a plethora of DLT platforms on the market, which makes it challenging for system designers to decide what platform they should adopt and implement. Although a few DLT comparison frameworks have been proposed in the literature, they often fail in covering all performance and functional aspects, adding that they too rarely build upon standardized criteria and recommendations. Given this state of affairs, the present paper considers a recent and exhaustive set of assessment criteria recommended by the ITU (International Telecommunication Union). Those criteria (about fifty) are nonetheless mostly defined in a textual form, which may pose interpretation problems during the implementation process. To avoid this, a systematic literature review regarding each ITU criterion is conducted with a twofold objective: (i) to understand to what extent a given criterion is considered/evaluated by the literature; (ii) to come up with ‘formal’ metric definition (i.e., on a mathematical or experimental ground) based, whenever possible, on the current literature. Following this formalization stage, a decision support tool called CREDO-DLT, which stands for “multiCRiteria-basEd ranking Of Distributed Ledger Technology platforms”, is developed using AHP and TOPSIS, which is publicly made available to help decision-maker to select the most suitable DLT platform alternative (i.e., that best suits their needs and requirements). A use case scenario in the context of energy communities is proposed to show the practicality of CREDO-DLT. •Blockchain (DLT) standardization initiatives are reviewed.•To what extent ITU’s DLT assessment criteria are covered in literature is studied.•A mathematical formalizations of the ITU recommendations are proposed.•A decision support tool (CREDO-DLT) is designed for DLT platform selection.•An energy community use case is developed to show the practicality of CREDO-DLT.
Disciplines :
Sciences informatiques
Auteur, co-auteur :
KUBLER, Sylvain ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal
Renard, Matthieu
GHATPANDE, Sankalp ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal
Georges, Jean-Philippe; Université de Lorraine > Centre de Recherche en Automatique de Nancy > Prof.
LE TRAON, Yves ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal
Co-auteurs externes :
yes
Langue du document :
Anglais
Titre :
Decision support system for blockchain (DLT) platform selection based on ITU recommendations: A systematic literature review approach
Ar, I.M., Erol, I., Peker, I., Ozdemir, A.I., Medeni, T.D., Medeni, I.T., Evaluating the feasibility of blockchain in logistics operations: A decision framework. Expert Systems with Applications, 158, 2020, 113543.
Bai, C., Sarkis, J., A supply chain transparency and sustainability technology appraisal model for blockchain technology. International Journal of Productions Research 58:7 (2020), 2142–2162.
Balasch, J., Ege, B., Eisenbarth, T., Gérard, B., Gong, Z., Güneysu, T., Heyse, S., Kerckhof, S., Koeune, F., Plos, T., Pöppelmann, T., Regazzoni, F., Standaert, F.-X., Van Assche, G., Van Keer, R., van Oldeneel tot Oldenzeel, L., von Maurich, I., Compact implementation and performance evaluation of hash functions in attiny devices. International conference on smart card research and advanced applications, 2012, Springer, Berlin, Heidelberg, 158–172.
Baliga, A., Subhod, I., Kamat, P., Chatterjee, S., Performance evaluation of the quorum blockchain platform. 2018 arXiv preprint arXiv:1809.03421.
Bamakan, S.M.H., Motavali, A., Bondarti, A.B., A survey of blockchain consensus algorithms performance evaluation criteria. Expert Systems with Applications, 154, 2020, 113385.
Baqer, K., Huang, D.Y., McCoy, D., Weaver, N., Stressing out: Bitcoin stress testing. International conference on financial cryptography and data security, 2016, Springer, Berlin, Heidelberg, 3–18.
Belotti, M., Božić, N., Pujolle, G., Secci, S., A vademecum on blockchain technologies: When, which, and how. IEEE Communications Surveys & Tutorials 21:4 (2019), 3796–3838.
Bhatt, P.C., Kumar, V., Lu, T.-C., Daim, T., Technology convergence assessment: Case of blockchain within the IR 4.0 platform. Technology in Society, 67, 2019, 101709.
Böckel, A., Nuzum, A.-K., Weissbrod, I., Blockchain for the circular economy: analysis of the research-practice gap. Sustainable Production and Consumption 25 (2021), 525–539.
Bolze, R., Cappello, F., Caron, E., Daydé, M., Desprez, F., Jeannot, E., Jégou, Y., Lanteri, S., Leduc, J., Melab, N., Grid’5000: a large scale and highly reconfigurable experimental grid testbed. The International Journal of High Performance Computing Applications 20:4 (2006), 481–494.
Borkowski, M., Sigwart, M., Frauenthaler, P., Hukkinen, T., Schulte, S., DeXTT: Deterministic cross-blockchain token transfers. IEEE Access, 7, 2019, 111030-111042.
Bouraga, S., A taxonomy of blockchain consensus protocols: A survey and classification framework. Expert Systems with Applications, 168, 2021, 114384.
Brereton, P., Kitchenham, B.A., Budgen, D., Turner, M., Khalil, M., Lessons from applying the systematic literature review process within the software engineering domain. Journal of Systems and Software 80:4 (2007), 571–583.
Budak, A., Çoban, V., Evaluation of the impact of blockchain technology on supply chain using cognitive maps. Expert Systems with Applications, 184, 2021, 115455.
Büyüközkan, G., Tüfekçi, G., A decision-making framework for evaluating appropriate business blockchain platforms using multiple preference formats and VIKOR. Information Sciences 571 (2021), 337–357.
Chaudhry, N., Yousaf, M.M., Consensus algorithms in blockchain: comparative analysis, challenges and opportunities. 12th IEEE international conference on open source systems and technologies, 2018, 54–63.
Chu, M.T., Shyu, J., Tzeng, G.H., Khosla, R., Comparison among three analytical methods for knowledge communities group-decision analysis. Expert Systems with Applications 33:4 (2007), 1011–1024.
Cong, X., Zi, L., Blockchain applications, challenges and evaluation: A survey. Discrete Mathematics, Algorithms and Applications, 12(04), 2020, 2030001.
Daim, T., Lai, K.K., Yalcin, H., Alsoubie, F., Kumar, V., Forecasting technological positioning through technology knowledge redundancy: Patent citation analysis of IoT, cybersecurity, and blockchain. Technological Forecasting and Social Change, 161, 2020, 120329.
de São José, D., Faria, P., Vale, Z., Smart energy community: A systematic review with metanalysis. Energy Strategy Reviews, 36, 2021, 100678.
Delgado-Mohatar, O., Fierrez, J., Tolosana, R., & Vera-Rodriguez, R. (2019). Biometric template storage with blockchain: A first Look into cost and performance tradeoffs. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops.
Dinh, T.T.A., Liu, R., Zhang, M., Chen, G., Ooi, B.C., Wang, J., Untangling blockchain: A data processing view of blockchain systems. IEEE Transactions on Knowledge and Data Engineering 30:7 (2018), 1366–1385.
Dong, Z., Zheng, E., Choon, Y., Zomaya, A.Y., Dagbench: A performance evaluation framework for dag distributed ledgers. IEEE 12th international conference on cloud computing, 2019, 264–271.
Drljevic, N., Aranda, D.A., Stantchev, V., Weissbrod, I., Perspectives on risks and standards that affect the requirements engineering of blockchain technology. Computer Standards & Interfaces, 69, 2020, 103409.
Eskandari, S., Clark, J., Barrera, D., Stobert, E., A first look at the usability of bitcoin key management. 2018 arXiv preprint arXiv:1802.04351.
Faria, C., Correia, M., BlockSim: blockchain simulator. IEEE international conference on blockchain (blockchain), 2019, 439–446.
Frauenthaler, P., Sigwart, M., Spanring, C., Schulte, S., Advanced cross-chain token transfers. 2020, TU Wien.
Gervais, A., Karame, G. O., Wüst, K., Glykantzis, V., Ritzdorf, H., & Capkun, S. (2016). On the security and performance of proof of work blockchains. In Proceedings of the ACM SIGSAC conference on computer and communications security (pp. 3–16).
Gochhayat, S.P., Shetty, S., Mukkamala, R., Foytik, P., Kamhoua, G.A., Njilla, L., Measuring decentrality in blockchain based systems. IEEE Access, 8, 2020, 178372-178390.
Goffard, P.O., Fraud risk assessment within blockchain transactions. Advances in Applied Probability 51:2 (2019), 443–467.
Gopalan, A., Sankararaman, A., Walid, A., Vishwanath, S., Stability and scalability of blockchain systems. Proceedings of the ACM on Measurement and Analysis of Computing Systems 4:2 (2020), 1–35.
Gowat, R.C., Blockchain traceability for the counterfeit detection and avoidance program (CDAP) final report. 2020, Accenture Federal Services Arlington United States.
Gräbe, F., Kannengiesser, N., Lins, S., & Sunyaev, A. (2020). Do not be fooled: Toward a holistic comparison of Distributed Ledger Technology designs. In Proceedings of the 53rd Hawaii international conference on system sciences (pp. 6297-6306).
Gupta, A., Shankarananda, B.M., Fast interest recovery in content centric networking under lossy environment. 12th annual IEEE consumer communications and networking conference, 2015, 802–807.
Han, R., Shapiro, G., Gramoli, V., Xu, X., On the performance of distributed ledgers for internet of things. Internet of Things, 10, 2020, 100087.
Ho, G.T.S., Tang, Y.M., Tsang, K.Y., Tang, V., Chau, K.Y., A blockchain-based system to enhance aircraft parts traceability and trackability for inventory management. Expert Systems with Applications, 179, 2021, 115101.
Honig, J.J., Everts, M.H., Huisman, M., Practical mutation testing for smart contracts. Data privacy management, cryptocurrencies and blockchain technology, 2019, Springer, Cham, 289–303.
Huang, B., Jin, L., Lu, Z., Zhou, X., Wu, J., Tang, Q., Hung, P.C., Bor: Toward high-performance permissioned blockchain in rdma-enabled network. IEEE Transactions on Services Computing 13:2 (2019), 301–313.
Jain, R.K., Chiu, D.M.W., Hawe, W.R., A quantitative measure of fairness and discrimination. 1984, Eastern Research Laboratory, Digital Equipment Corporation, Hudson, MA.
James, A.T., Vaidya, D., Sodawala, M., Verma, S., Selection of bus chassis for large fleet operators in India: An AHP-TOPSIS approach. Expert Systems with Applications, 186, 2021, 115760.
Kabbinale, A.R., Dimogerontakis, E., Selimi, M., Ali, A., Navarro, L., Sathiaseelan, A., Crowcroft, J., Blockchain for economically sustainable wireless mesh networks. Concurrency Computations: Practice and Experience, 32(12), 2020, e5349.
Kalra, S., Goel, S., Dhawan, M., Sharma, S., Zeus: Analyzing safety of smart contracts. Ndss, 2018, 1–12.
Kaur, K., Singh, J., Ghumman, N.S., Mininet as software defined networking testing platform. International conference on communication, computing & systems, 2014, 139–142.
Kirillov, D., Iakushkin, O., Korkhov, V., Petrunin, V., Evaluation of tools for analyzing smart contracts in distributed ledger technologies. International conference on computational science and its applications, 2019, Springer, Cham, 522–536.
Kitchenham, B., Brereton, O.P., Budgen, D., Turner, M., Bailey, J., Linkman, S., Systematic literature reviews in software engineering–a systematic literature review. Information and Software Technology 51:1 (2009), 7–15.
Kobayashi, K., Ikegami, J., Knežević, M., Guo, E.X., Matsuo, S., Huang, S., Nazhandali, L., Kocabaş, U., Fan, J., Satoh, A., Prototyping platform for performance evaluation of SHA-3 candidates. IEEE international symposium on hardware-oriented security and trust, 2010, 60–63.
Kolbe, N., Kubler, S., Robert, J., Le Traon, Y., Zaslavsky, A., Linked vocabulary recommendation tools for internet of things: a survey. ACM Computing Surveys 51:6 (2019), 1–31.
Kshetri, N., Kshetri, N., 1 Blockchain's roles in meeting key supply chain management objectives. International Journal of Information Management 39 (2018), 80–89.
Kubler, S., Robert, J., Derigent, W., Voisin, A., Le Traon, Y., A state-of the-art survey & testbed of fuzzy AHP (FAHP) applications. Expert Systems with Applications 65 (2016), 398–422.
Kuznetsov, A., Oleshko, I., Tymchenko, V., Lisitsky, K., Rodinko, M., Kolhatin, A., Performance analysis of cryptographic hash functions suitable for use in blockchain. International Journal of Computer Network & Information Security, 13(2), 2021.
Labazova, O., Towards a framework for evaluation of blockchain implementations. International conference on information systems, 2019, 1–16.
Li, Y., Chen, X., Wang, X., Xu, Y., Chen, P.H., A review of studies on green building assessment methods by comparative analysis. Energy and Buildings 146 (2017), 152–159.
Lohachab, A., Garg, S., Kang, B.H., Amin, M.B., Performance evaluation of hyperledger fabric-enabled framework for pervasive peer-to-peer energy trading in smart cyber–physical systems. Future Generation Computer Systems 118 (2021), 392–416.
Luu, L., Chu, D. H., Olickel, H., Saxena, P., & Hobor, A. (2016). Making smart contracts smarter. In Proceedings of the ACM SIGSAC conference on computer and communications security (pp. 254–269).
Mackay, B., Evaluation of security in hardware and software cryptocurrency wallets. (Ph.D. thesis), 2019, Edinburgh Napier University.
Maesa, D.D.F., Mori, P., Blockchain 3.0 applications survey. Journal of Parallel and Distributed Computing 138 (2020), 99–114.
Maranhão, S., Seigneur, J.M., Hu, R., Towards a standard to assess blockchain & other DLT platforms. 2019, ITU, 1–7.
Mathew, S., Jacob, K.P., Performance evaluation of popular hash functions. World Academy of Science, Engineering and Technology 61 (2010), 449–452.
Miller, A., Jansen, R., Shadow-bitcoin: Scalable simulation via direct execution of multi-threaded applications. 8th workshop on cyber security experimentation and test, 2015.
Miyamae, T., Honda, T., Tamura, M., Kawaba, M., Performance improvement of the consortium blockchain for financial business applications. Journal of Digital Banking 2:4 (2018), 369–378.
Modrak, V., Radu, S.M., Modrak, J., Metrics in organizational centralization and decentralization. Polish Journal of Management Studies, 10, 2014.
Nanayakkara, S., Rodrigo, M.N.N., Perera, S., Weerasuriya, G.T., Hijazi, A.A., A methodology for selection of a Blockchain platform to develop an enterprise system. Journal of Industrial Information Integration, 23, 2021, 100215.
Oliveira, L., Zavolokina, L., Bauer, I., Schwabe, G., To token or not to token: Tools for understanding blockchain tokens. International conference of information systems, 2018.
Parizi, R.M., Dehghantanha, A., Choo, K.K.R., Singh, A., Empirical vulnerability analysis of automated smart contracts security testing on blockchains. 2018 arXiv preprint arXiv:1809.02702.
Park, S., Oh, S., Kim, H., Performance analysis of DAG-based cryptocurrency. IEEE international conference on communications workshops, 2019, 1–6.
Pisa, M., Reassessing expectations for blockchain and development. Innovations: Technology, Governance, Globalization 12:1–2 (2018), 80–88.
Polge, J., Robert, J., Le Traon, Y., Permissioned blockchain frameworks in the industry: A comparison. ICT Express 7:2 (2021), 229–233.
Prechtel, D., Gross, T., Müller, T., Evaluating spread of ‘gasless send'in Ethereum smart contracts. 2019 10th IFIP international conference on new technologies, mobility and security, 2019, 1–6.
Qing, S., Liu, X., & Zheng, H. (2020). An assessment framework for distributed ledger technology in financial application. In Proceedings of the 2nd ACM international symposium on blockchain and secure critical infrastructure (pp. 161–170).
Saad, M., Kim, J., Nyang, D., Mohaisen, D., Contra-*: Mechanisms for countering spam attacks on blockchain's memory pools. Journal of Network and Computer Applications, 179, 2021, 102971.
Saaty, T.L., Saaty, T.L., A scaling method for priorities in hierarchical structures. Journal of Mathematical Psychology 15:3 (1977), 234–281.
Sagirlar, G., Carminati, B., Ferrari, E., Sheehan, J.D., Ragnoli, E., Hybrid-iot: Hybrid blockchain architecture for internet of things-pow sub-blockchains. IEEE international conference on internet of things and IEEE green computing and communications and IEEE cyber, physical and social computing and IEEE smart data, 2018, 1007–1016.
Sayadi, S., Rejeb, S.B., Choukair, Z., Anomaly detection model over blockchain electronic transactions. 15th international wireless communications & mobile computing conference, 2019, 895–900.
Schmitz, P.-E., Cacciaguerra Ranghieri, G., Joinup licensing assistant: White paper v1.01., 2018, European Commission - DG DIGIT Unit.D2 (Interoperability Unit).
Selimi, M., Kabbinale, A. R., Ali, A., Navarro, L., & Sathiaseelan, A. (2018). Towards blockchain-enabled wireless mesh networks. In Proceedings of the 1st workshop on cryptocurrencies and blockchains for distributed systems (pp. 13–18).
Sharma, M., Sehrawat, R., Daim, T., Shaygan, A., Technology assessment: Enabling blockchain in hospitality and tourism sectors. Technological Forecasting and Social Change, 169, 2021, 120810.
Shaw, M.R., A Blockchain testbed for DoD applications. 2018, Naval Postgraduate School.
Simpson, L., Do decision makers know what they prefer?: MAVT and ELECTRE II. Journal of the Operational Research Society 47:7 (1996), 919–929.
Six, N., Herbaut, N., Salinesi, C., Which Blockchain to choose? A decision support tool to guide the choice of a Blockchain technology. 2020 arXiv preprint arXiv:2004.06080.
Smetanin, S., Ometov, A., Komarov, M., Masek, P., Koucheryavy, Y., Blockchain evaluation approaches: State-of-the-art and future perspective. Sensors, 20(12), 2020, 3358.
Srivastav, R.K., Agrawal, D., Shrivastava, A., A survey on vulnerabilities and performance evaluation criteria in Blockchain technology. Advances in Distributed Computing and Artificial Intelligence Journal 9 (2020), 91–105.
Stoykov, L., Zhang, K., Stoykov, L., Zhang, K., & Jacobsen, H. A. (2017). VIBES: fast blockchain simulations for large-scale peer-to-peer networks. In Proceedings of the 18th ACM/IFIP/USENIX middleware conference: Posters and demos (pp. 19–20).
StudyGroup16/22, F.751.1 assessment criteria for distributed ledger technology platforms. 2020, International Telecommunication Union (ITU).
Suankaewmanee, K., Hoang, D.T., Niyato, D., Sawadsitang, S., Wang, P., Han, Z., Performance analysis and application of mobile blockchain. 2018 international conference on computing, networking and communications, 2018, 642–646.
Sukhwani, H., Wang, N., Trivedi, K.S., Rindos, A., Performance modeling of hyperledger fabric (permissioned blockchain network). IEEE 17th international symposium on network computing and applications, 2018, 1–8.
Suratkar, S., Shirole, M., Bhirud, S., Cryptocurrency wallet: A review. 4th IEEE international conference on computer, communication and signal processing, 2020, 1–7.
Szczerbowski, J.J., Transaction costs of blockchain smart contracts. Law and Forensic Science, 16(2), 2018.
Tang, H., Shi, Y., Dong, P., Public blockchain evaluation using entropy and TOPSIS. Expert Systems with Applications 117 (2019), 204–210.
Tolk, A., Diallo, S.Y., Turnitsa, C.D., Applying the levels of conceptual interoperability model in support of integratability, interoperability, and composability for system-of-systems engineering. Journal of Systems, Cybernetics, and Informatics, 5(5), 2007.
Computer science handbook. 2004, CRC Press.
Uesugi, T., Shijo, Y., Murata, M., Short paper: Design and evaluation of privacy-preserved supply chain system based on public blockchain. 2020 arXiv preprint arXiv:2004.07606.
Vafaei, N., Ribeiro, R.A., Camarinha-Matos, L.M., Normalization techniques for multi-criteria decision making: Analytical Hierarchy Process case study. Doctoral conference on computing, electrical and industrial systems, 2016, Springer, Cham, 261–269.
Wan, L., Eyers, D., Zhang, H., Evaluating the impact of network latency on the safety of blockchain transactions. IEEE international conference on Blockchain, 2019, 194–201.
Wang, X., Zha, X., Ni, W., Liu, R.P., Guo, Y.J., Niu, X., Zheng, K., Survey on blockchain for Internet of Things. Computer Communications 136 (2019), 10–29.
Wang, B., Zhao, S., Li, Y., Wu, C., Tan, J., Li, H., Yukita, K., Design of a privacy-preserving decentralized energy trading scheme in blockchain network environment. International Journal of Electrical Power & Energy Systems, 125, 2021, 106465.
Wöhrer, M., Zdun, U., Design patterns for smart contracts in the ethereum ecosystem. IEEE international conference on internet of things (iThings) and IEEE green computing and communications (GreenCom) and IEEE cyber, physical and social computing (CPSCom) and IEEE smart data (SmartData), 2018, 1513–1520.
Xiao, Y., Zhang, N., Lou, W., Hou, Y.T., A survey of distributed consensus protocols for blockchain networks. IEEE Communications Surveys & Tutorials 22:2 (2020), 1432–1465.
Xie, J., Tang, H., Huang, T., Yu, F.R., Xie, R., Liu, J., Liu, Y., A survey of blockchain technology applied to smart cities: Research issues and challenges. IEEE Communications Surveys & Tutorials 21:3 (2019), 2794–2830.
Yalcin, H., Daim, T., Mining research and invention activity for innovation trends: case of blockchain technology. Scientometrics 126:5 (2021), 3775–3806.
Yang, W., Garg, S., Huang, Z., Kang, B., A decision model for blockchain applicability into knowledge-based conversation system. Knowledge-Based Systems, 220, 2021, 106791.
Zhang, H., Daim, T., Zhang, Y.P., Integrating patent analysis into technology roadmapping: A latent dirichlet allocation based technology assessment and roadmapping in the field of Blockchain. Technological Forecasting and Social Change, 167, 2021, 120729.
Zhang, R., Preneel, B., Publish or perish: A backward-compatible defense against selfish mining in bitcoin. Cryptographers’ track at the RSA conference, 2017, Springer, Cham, 277–292.
Zhong, Q.T., Cole, Z., Analyzing the effects of network latency on blockchain performance and security using the whiteblock testing platform. Blockchain Performance and Security, 2018.
