A Three-Phase Evaluation Approach for new Information and Data Models in the Smart Grid Domain

The ongoing digitalisation of the smart grid is resulting in an increase in automated information exchanges across distributed energy systems. This process has led to the development of new information and data models when the existing ones fall short. To prevent potential disruptions caused by flaws in the newly designed information and data models, it is essential to evaluate them during the design process before they are implemented in operation.
Currently, general explicit evaluation approaches outside the smart grid domain stay at a high level without defining clear steps. Meanwhile, implicit evaluation approaches in the smart grid domain focus on testing systems that utilise information and data models already in use for functionality in terms of conformance and interoperability. Notably, no combination of explicit and implicit evaluation approaches for newly designed information and data models offers a clearly defined set of steps during their design process in the smart grid context.
Consequently, we design a three-phase evaluation approach using design science research to address this gap. Our evaluation approach combines explicit and implicit evaluation methods and is applicable when developing new information and data models. We use the development of an information model and data model focused on industrial flexibility descriptions to refine our evaluation approach. Additionally, we provide lessons learned from our experience.