NEC Corporation has announced the development of a pioneering technology that utilizes proprietary artificial intelligence to rapidly create highly detailed 3D models from video footage captured by general-purpose cameras, such as those found on smartphones. This innovation, developed in collaboration with the Keio AI Research Center, can generate 3D models in as little as one minute, even in dynamic environments like construction sites and electric power infrastructure facilities.
The technology aims to facilitate remote facility inspections and expedite decision-making during anomalies by allowing users to view 3D models on standard computers or tablets. This advancement is expected to promote the adoption of digital twin technology among infrastructure operators and the construction industry, addressing labor shortages and enhancing facility safety. NEC plans to commercialize this technology within the fiscal year 2027.
Infrastructure operators and the construction industry have increasingly faced labor shortages and rising travel costs for facility inspections, driving efforts to enable remote decision-making through shared on-site footage. However, traditional video feeds often fail to provide the specific scenes or viewpoints needed for accurate assessments. Digital twins, which replicate real-world conditions in virtual spaces, are seen as a solution, but adoption has been hindered by the need for expensive equipment, operational disruptions during filming, and lengthy model generation times.
NEC's new technology addresses these challenges by integrating Gaussian Splatting—a technique gaining traction in movie and animation background generation—with its AI capabilities. This combination allows for the rapid creation of detailed 3D models without the need for costly equipment or operational interruptions. The models can be generated in as little as one minute, offering a 90% reduction in generation time compared to conventional methods.
The technology automatically analyzes the visual complexity of on-site footage to optimize the placement of points forming the 3D model. In complex areas, points are densely clustered, while in uniform areas, they are more spaced out, ensuring high detail with minimal points. Additionally, the technology automatically removes temporary subjects from the footage, inferring and filling in backgrounds to produce accurate 3D models of on-site conditions.
NEC remains committed to advancing digital twin technology adoption, aiming to alleviate personnel shortages and transform business operations across various industries. The company believes this technology will support more efficient and advanced on-site operations by enabling optimal allocation of limited personnel resources.
Comments are closed.