In fact, a DT can be either highly or poorly integrated to its physical counterpart, generating three possible levels of digital replicas [8]: • Digital Model DM: a digital representatio
Trang 1TRƯỜNG ĐẠI HỌC BÁCH KHOA HÀ NỘI
TRƯỜNG CƠ KHÍ KHOA CƠ ĐI쨃⌀N TỬ
ACADEMIC WRITING MES-integrated digital twin frameworks
MSSV: 20205238 Email: an.tt205238@sis.hust.edu.vn
CHU THIÊN HOÀNG
MSSV: 20205488 Email: hoang.ct205488@sis.hust.edu.vn
Chuyên ngành Cơ Điện Tử
Giảng viên hướng dẫn: TS Nguyễn Thành Đông
HÀ NỘI, 1/2024
Chữ ký của GVHD
Trang 2Nhi ệm vụ của các thành viên:
Trang 3MES-integrated digital twin frameworks
1 Abstract
The integration of Manufacturing Execution Systems (MES) with Digital Twin technology has emerged as a cutting-edge approach to enhance the efficiency, agility, and overall performance of manufacturing processes In this paradigm, Digital Twins (DT) are defined as simulation models that are both getting data from the field and triggering actions
on the physical equipment However, most of the claimed DT in literature are only replicating the real system in a synchronized fashion, without feeding back actions on the control system of the equipment In literature, these are referred to as Digital Shadows (DS) The paper proposes a way to integrate a DS simulation model with the Manufacturing Execution System (MES) in this way creating a DT The MESintegrated DT is used for decision making thanks to the presence of an intelligence layer that hosts the rules and the knowledge to choose among alternatives The paper proposes two frameworks based on the MES-integrated DT: one for managing error states and one for triggering disassembly processes as a consequence of low assembly quality The DT simulation is developed and integrated with the MES of the Industry 4.0 Laboratory at the School of Management of Politecnico di Milano, where the proposed frameworks have been tested and validated
2 Introduction
During the last decade, a rampant process of digital transformation of production plants has taken place, referred to as Industry 4.0 [1,2] The Fourth Industrial Revolution (Industry 4.0) has ushered in a new era of intelligent manufacturing, characterized by the seamless integration of digital technologies into various aspects of production
Under the Industry 4.0 paradigm many enabling technologies can be included These can be used to aid manufacturing companies in many levels, from the corporate aspect to the shop-floor [3,4] The frameworks proposed in this work are designed for production systems based on Cyber Physical Systems (CPS), that are defined as physical and engineered systems whose operations are monitored, coordinated, controlled and integrated by a computing communication core [5] CPS are also featured by several characteristics like: real-time capability to detect any change in the physical process, and
to react to them; intelligence meant as the capability to identify and sense relevant events
Trang 4[6] The “cyber” side of the CPS are typically the hosting environment of the so-called Digital Twin (DT), that is defined as a digital copy of a physical asset, being conceived as
a system that can replicate, plan, control and directly interact with its physical side [7] Overall, a DT typically leverages on the bridging between the digital and real worlds inside the CPS and “exploits sensed data, mathematical models and real-time data elaboration in order to forecast and optimise the behaviour of the production system at each life cycle phase, in real time” [9,10] In alignment to the Industry 4.0 paradigm, it transforms data into a business advantage and added value for the enterprise; all of this in real-time [11] Another crucial aspect to be discussed lies in the magnitude of integration and connectivity of a DT in the physical world [12,13] According to Kritzinger et al., a new perspective based on integration level permits to fully understand how a DT should be defined [8] In fact, a DT can be either highly or poorly integrated to its physical counterpart, generating three possible levels of digital replicas [8]:
• Digital Model (DM): a digital representation of an existing physical object that does not use any form of automated data exchange between the physical object and the digital one;
• Digital Shadow (DS): it is a DM with an additional automated oneway flow between the state of an existing physical object and a digital one; therefore, if the state of the physical object changes, then the state of the digital object automatically changes as well, but not vice versa;
• Digital Twin (DT): if the data flow between an existing physical object and a digital one
is fully integrated in both directions – from physical to digital and vice versa – the object can be referred to as DT; accordingly, the digital object might also act as a controlling instance of the physical object; therefore, a change of state of the physical object leads to
a change in state of the digital object and vice versa
The proposed work aims at contributing to this understanding, by constructing a DT according to the definition of Kritzinger [8], using communication protocols in order to connect the digital to the physical side of a given equipment in a manufacturing environment in a full bilateral communication Specifically, the work proposes two general DT-based communication frameworks that are applicable in multiple production facilities
As expected benefits, the application of such a DT-based tool to a production system, if properly designed, helps streamlining production by exploiting the reactive nature that a MES integration functionality provides to feedback actions on the control system of the equipment
Trang 53 Methodology
Proposed DT-MES bilateral communication frameworks
This part of the work aims at defining two reactive DT-MES bilateral communication frameworks that work combining the physical and digital level of a certain asset, with the aim of streamlining the production within the manufacturing facility it is placed in The models are based on CPS capabilities of bilateral communication between the physical and digital sides, thus leading to exploit a full DT in Kritzinger’s view [8]: this means a DT which forces actions to the MES according to what the intelligence layer defines
The following features can be pointed out for the intelligence layer:
• it is built to be able to communicate densely and to be integrated with the DT model;
• it is enabling a decision-making ability that is conceptually detached from the DT;
• it is designed with the purpose to make decisions on whether to apply the aforementioned frameworks
The intelligence layer, and its role with respect to the DT model, are in line with the proposed reference architecture by Valckenaers [18,19]
Framework 1: Error states management
The first proposed framework deals with error states management (see Fig.1) The overall objective for this framework is to deal with error states that stop the production flow by solving them either with a fully automated method or with the help of an operator
As it is shown in the figure, there are many levels on which the framework can operate, that are named differently according to their specific nature and their structural function in the framework functioning However, the overall structure is inspired by the classical CPS structure [14]
The main macro-areas of the framework are the Physical World that stands for the actual physical infrastructure, and the Cyber World The latter is made of different and more detailed levels and sub-levels (called layers) that work as follows:
• there is a Decision Making Level, composed of:
• a DT layer where the simulation model is used for detection purposes; as a matter of fact, sensor reading/overwriting takes place in this level;
• an intelligence layer that makes decisions based on the nature of the error states identified
in real-time [19];
Trang 6• the MES integration Level, which takes as inputs the decisions made by the intelligence layer and practically represents the bridge between the DT simulation and the MES; the MES integration level is hosted in the same simulation environment as the DT;
• in the end, the MES Level represents the MES and its functions that are automatically called thanks to the MES integration level
The flow starts in the physical level with the arrival of the order at a workstation, and a check on whether it is processable or not If it is not processable, an error state that blocks the production flow arises at physical level At this point the DT, by reading the sensors embedded in the facility in real time, is aware of what is happening and replicates it in a synchronized simulation model (i.e the actual DT) At this point the intelligence layer, by receiving the values of a combination of sensors provided by the DT layer, identifies them
as a specific error state that is getting the production blocked, according to their specific nature and to embedded rules in this level The error states can be classified by the intelligence layer according to the necessity of human intervention to solve them (type A: human is necessary; type B: human is not necessary) The actions of the intelligence layer are diversified according to the type of error state:
• for type A error states, the intelligence layer communicates with the MES software
through the MES integration level, making it follow a series of actions aimed at helping operators in solving the error (as an example: alert messages on the Human Machine Interface screen – HMI – or automated movement of materials); it is lastly responsibility
of the operator to solve the error;
• for type B, the error state can be automatically solved by instantly communicating from the DT to the MES – passing through intelligent and MES integration levels – the action
to be performed to solve the issue
In both cases, the DT makes the intelligent layer recognise the type of error that, in turn, triggers the MES to perform the required actions (either as support to human or physical action on field) through the MES integration Besides, in terms of helping humans in the solving process, this framework proposes a practical translation of the HCPS view [15,16] Downstream of the error solution, the DT gathers sensors values in order for the intelligent layer to both verify if the processing conditions are met and eventually trigger the MES to resume the production process
Trang 7Fig.1 Error states management framework
Framework 2: reactive disassembly
The second proposed framework deals with reactive disassembly during assembly of products that do not respect specified quality standards As it is shown in the graphical representation of the framework (see Fig.2), the same four-level structure of the framework
is again exploited
In order to be applied, this framework needs the presence of processing steps that are carried out by physical resources in the plant:
• an assembly step, made by assembly machines or equipment (e.g.robotic arms);
• a quality check step, made by a resource able to check pieces’ quality (e.g.visually, via proper sensors) that are being assembled;
• a disassembly step made by a disassembly machine or equipment that could in certain cases also coincide with the assembly one (e.g.flexible robot arm able both to assemble and disassemble)
As in Fig.2, the DT runs a synchronized simulation in parallel to the physical assembly
of products and is continuously updated according to sensors that detect assembled product quality According to the sensor readings provided by the DT layer, the intelligence layer
Trang 8understands – through its embedded rules – whether the quality standards are met or not
In the first case, the assembly process can proceed, while in the second case the subsequent set of actions are automatically triggered by the intelligence layer Specifically, the DT must collect information about the order in question, for instance it understands which is the wrongly assembled component Then, the MES is automatically triggered to abort the current assembly order, and automatically schedules a customised disassembly order on the aborted product
Fig.2 Reactive disassembly framework
Simulation models for digital twins
Both aforementioned frameworks can lead back to an architecture that shows how the
DS and the DT interact with other levels including also the computational models that have been developed in order to work properly The idea is represented by a block-like schema (see Fig.3), where the functions at the basis of the model are shown In Fig.3, like the legend suggests, the colour of the blocks describes their nature Blue blocks refer to computational and digital entities; the orange block stands for physical resources By grouping the elementary blocks/functions differently, a DS or a DT can be generated The following list describes the blocks in the Fig.3
• DM–Digital Model, that is at the basis of the DS itself This is a simulation model
designed to read and overwrite in real time sensors values that are embedded in the
production facility (i.e the field devices)
Trang 9• When the DM is linked to the physical resources, like in Fig.3, a DS–Digital Shadow is built This is characterized by a real-time reading of what is taking place and therefore an automated and realtime synchronization of the simulation with respect to the physical status changes (one-sided communication)
• The DS communicates to an intelligence layer, that is the place where higher-level
decisions are made, about the actions to be taken in order to react to physical events The intelligence layer takes as an input a combination of sensors values readings coming from the DS This allows the identification of a set of states that automatically trigger a set of solving techniques that were previously studied, modelled and embedded in the code This kind of decision making is the core of the intelligence layer and can be reckoned as its output
• The DS communicates with the MES through the MES integration level By integrating this connection with the DS, a DT–Digital Twin is created In particular, the MES
integration function is used in both the error states management framework and the reactive disassembly one
The chosen simulation software to implement the DT is Simulink, following the methodology by Fumagalli et al [20], that allows to exploit the MATLAB coding embedded capabilities in order to model the system and to mimic the behaviour of the manufacturing assets as physical resources in question
Communication with the field
According to Fig 3, the first step for the development of a DT is the creation of the DS, which implies communication between the field level of a production facility and a simulation model (which is the simple DM)
This model can be created by exploiting a communication methodology that essentially extracts in real-time the values of the sensors that are embedded in a certain facility The connection between the two levels presented in Fig 4 may be done with communication protocols like Open Platform Communication (OPC) Unified Architecture (UA), or with other machine-to-machine (M2M) protocols such as Robot Operating System (ROS), Message Queue Telemetry Transport (MQTT), Data Distribution Service for Real Time Systems (DDS), Transmission Control Protocol (TCP)-based [21,22] The choice of a protocol depends on the features of the physical equipment that the DS mirrors [23] These protocols enable the real-time reading of values, thanks to the use of specific Simulink MATLAB functions Specifically, in Simulink, the choice falls in the use of Level-2 MATLAB S-Functions This specific function allows to use the MATLAB language to create custom blocks with multiple input and output ports, which can process
Trang 10any type of signal produced by a Simulink model The function itself comprises a set of callback methods that the Simulink engine invokes when updating or simulating the model
In this specific case, the Level-2 MATLAB S-Functions are used in the simulation environment to read, use and overwrite the values of the sensors of interest also in terms
of identification of machine states, such as idle, working, error etc [17] The function, thanks to the use of OPC UA protocol, is able to create inside the simulation environment,
a client/ server connection, allowing the model to know the value of a certain sensor at a given time Inside Simulink environment, the Level-2 MATLAB S-Function is represented
on the left-hand side of Fig 4 The code inside the block function is built as on the hand side of the Figure As the graphical part of Fig 4 suggests, the output sensors values (i.e the names of the sensors are ‘CarrierID’, ‘xBG1’, ‘xQA1_A1’…) are linked, combined and then exploited for subsequent scopes in the remainder of the simulation tool
right-Fig 4 Level-2 MATLAB S-Function (left-hand side); Related code (right-hand side)
The MES integration level of the Digital Twin
By integrating the DS to the MES, it is possible to talk about DT since communication becomes bilateral between physical and digital sides, [8], allowing the latter to take corrective actions when the physical side is in need
This additional capability can be given to the DT always by exploiting M2M communication protocols that, in turn, are based on certain languages, that may either be
Trang 11proprietary or open source (i.e XML) These protocols allow external sources to communicate with software tools; in this peculiar case, MES software tools
The Digital Twin simulation model with the MES integration
The proposed DT may read sensors values and eventually overwrite them (i.e via OPC UA) and communicate autonomously with the MES software when needed (i.e via TCP/IP)
Based on these channels, Simulink function blocks can be properly designed to tackle technical issues on the shop-floor In fact, real-time synchronized simulated sensors can be used to identify “trigger states” that, in turn, – according to the rules dictated by the intelligence layer – activate the MES communication channel by creating communication ports to send commands to take the desired measures In other words, these trigger states basically enable the intelligence layer in a computational way, in order for it to decide the solving measure to be applied; this becomes then an actionable information to be sent through communication ports to an external software tool as MES, in order to finally take the measure in the physical world
In Simulink environment, the modelling of the MES-integrated DS, that is now referred
to as DT, is graphically represented like in Fig 5 The left-hand side of the Figure is featured with the Level-2 MATLAB SFunction, typical of the DS functions previously described (in section 4.1) On the right-hand side, instead, the MES integration functionality stands for the computational link between the digital model and the MES software Specifically, the inputs to the MES integration functionality block are the sensors that are needed to detect a specific error state (in case of Error states management framework) or a specific non-compliance with quality standards (in case of Reactive Disassembly framework), while the outputs are specific commands to be sent to the MES server As it can be seen in the Figure, a dense web of branches between the simulation blocks related to the sensor values determine the aforementioned set of “trigger states” This whole proposed model has been in fact validated in the application case that is showcased in the next section, together with the reached results coming from the application of the reactive DT-MES bilateral communication frameworks
Trang 12Fig 5 DT model in Simulink environment
Application case
A proof of concept of the proposed DT model has been developed at the Industry 4.0 Laboratory of the School of Management of Politecnico di Milano The laboratory is endowed with a prototypical assembly line, used for research and didactic activities [25] The assembly line in question is configured and installed with a mix of modular resources and machinery by Festo, Mitsubishi Electric, and Siemens The line assembles a simplified mobile phone, that can be tracked in every processing step thanks to RFID-tagged carriers that follow a standard conveyor path The production line is embedded with
a set of sensors, for each module of the line, that can be reached and read in real-time via OPC UA protocol
The production is integrated with two servers that connect the line to a MES software and to an energy monitoring platform The MES in question is called MES4 and it is provided by Festo; this makes it a proprietary software Besides, its server can be reached from external software tools using a string-based communication protocol that runs on TCP/IP channels [26]