As part of research into the energy transition, Dr Matthias Wenthe was interviewed by Birgit Schneider, science journalist at Project Management Jülich. In the interview, Wenthe explains how the market-ready AR-Explorer Bau app emerged from the energyTWIN project funded by the Federal Ministry for Economic Affairs and Climate Protection (BMWK).
‘We couldn't have afforded the development effort’
Dr. Matthias Wenthe | Mission Transfer, Mission Wärmewende 2045
Together with scientific partners, Dr Matthias Wenthe's company has developed a cloud solution for the on-site visualisation of building technology. In this interview, he describes how the BMWK-funded energyTWIN project has evolved into a marketable app.
Mr Wenthe, construction sites can now also be planned and inspected digitally. Where do you see the advantages here?
Wenthe: Digital planning and site inspections enable more efficient coordination of all parties involved, improve the exchange of information and reduce errors and costs. By visualising BIM data in the correct position using augmented reality, tradespeople can already see virtual models of future installations in the early construction phases. This avoids collisions with other trades. This precise visualisation improves coordination on the construction site, reduces errors and increases efficiency in the construction process.
What about older buildings: do their owners also benefit from digitalisation?
The focus here is on the installed technical building equipment. A digital twin of the system on the tablet reflects the current operation virtually live on site: What is the current flow temperature? Are all pumps working correctly? Malfunctions are recognised at an early stage and can be rectified. The integration of artificial intelligence into the 3D model also makes maintenance and repairs easier. This makes system operation more efficient and saves energy.
How is real plant technology depicted as a digital 3D model?
In the project, we used 3D laser scanners to create detailed point clouds of the MEP. Together with the planning model, these point clouds serve as the basis for a digital twin of the entire building. The digital twin integrates topological relationships. This makes it possible, for example, to recognise which pipe belongs to which circuit. The twin also continuously stores real-time sensor data in the cloud. The current status of the building services can then be visualised using corresponding applications.
This generates large amounts of data. What happens to it?
That was precisely our part in the BMWK-funded research project energyTWIN. We developed a cloud server in which all project-related data flows together. Some of this data is stored directly on the server, while some is also accessible and aggregated via the participating companies' interfaces. The important thing here is that there is one server on which all relevant data is centrally available to all participants.
The app was developed after the project was completed. What was the prerequisite for this?
For our further development, it was essential that all objects recorded on site could be displayed in the correct size and correctly positioned as 3D models in the web and app view. Individual systems such as ventilation or heating technology can be viewed separately. The result is the AR-Explorer Bau app. It can be used to overlay virtual objects in reality. This is of interest to architects, planning offices or trade businesses, for example.
How did the collaboration with the researchers go?
The dialogue and close collaboration with the project partners was definitely helpful. Each team contributed its expertise. The experts at RWTH Aachen University created the georeferenced as-built model and correctly mapped the topological relationships between the various system components. aedifion GmbH supplied the sensor technology and the marketing company TEMA integrated the 3D objects into the view of XR glasses.
You have a company with 12 employees. How have you benefited from the project funding?
In an agency, in-house developments often get lost in the day-to-day business, as customer orders usually take priority. Developing complex new software on the side is hardly possible for a company of our size. The issue of correctly positioning augmented reality content in three-dimensional space is not trivial.
‘Without funding, it would have remained a good idea.’
Dr. Matthias Wenthe (Internet Marketing Services GmbH)
This easily requires two and a half years of development work. We would not have been able to afford this. Without the funding, it would have remained a good idea. By connecting the academic world with the partner companies, we were also able to acquire industry expertise in the construction industry and establish contacts. This enabled us to adapt the general topic of ‘augmented reality in space’ to the specific needs of the construction sector.
