The aerospace, automotive and medical industries in particular are abandoning traditional stylus-based contact methods for controlling their processes and performing dimensional quality control on their products, and are instead choosing to use non-contact optical 3D measurement techniques. Different measurement systems work better with different types of materials, and in a paper entitled “Artificial intelligence-enhanced multi-material form measurement for additive materials,” a group of researchers used an artificial intelligence approach to “recognise the material of a measured object and to fuse the measurements taken from three optical form measurement techniques to improve system performance compared to using each technique individually.”
Non-contact optical measurement has several benefits: it is non-destructive, has improved speed, increases the area of acquisition per measurement cycle and reduces cost.
“For non-contact optical camera-based techniques especially, the ability to leverage the benefits of readily available AI-based image recognition algorithms to enhance the measurement even further provides an additional benefit over stylus-based contact techniques,” the researchers state. “Non-contact optical techniques, however, are not a panacea, and for some measurement scenarios, contact stylus-based techniques still need to be used, as optical techniques suffer from lower accuracy, material sensitivity and much higher requirements for data handling and storage.”
In the study, the researchers performed data function by using a common reference camera to employ three different camera-based measurement techniques:
- Fringe projection: a structured light technique that uses a projector and a camera to create a 3D point cloud of a scene observed by a camera either by triangulation or phase-stepping. It is used mainly for measuring diffusely reflecting objects.
- Deflectometry: a structured light technique similar to fringe projection but instead of projecting the fringe pattern, it is displayed on a TFT screen. It works best for reflective objects, as a bundle of rays from each pixel will reflect from the object into the camera via direct reflection.
- Photogrammetry: a technique that creates a 3D point cloud by taking advantage of unique surface features that exist in two or more images of the object taken from different points of view. Multiple camera views are used in order to reconstruct the 3D surface of an object by searching for pixel correspondences in the images taken.
Combining the three techniques allows 3D surface point clouds to be taken for reflective and diffuse objects that are featureless or have multiple features on their surface. To combine the data from all three techniques, the researchers used the same reference camera for all three systems and a spatial-temporal data collection scheme to collect data from different parts of the image at different times. The collection scheme had two parts: an image segmentation strategy and a temporal synchronization strategy.
The image segmentation strategy employed deep learning through a segmentation network or SegNet, and was trained to identify different materials in an image of the scene taken by the reference camera. The temporal synchronization scheme cycled all three measurement subsystems in the time domain by activating the required modules used by each technique at the appropriate time and taking measurements of the scene.
“As all three point clouds are taken by the same reference camera, they are automatically placed in the same frame of reference,” the researchers state. “The partial 3D data can, therefore, be automatically fused together to form an optimised 3D point cloud of the scene containing all three objects. This temporal synchronisation strategy allows for both optimised data fusion, minimisation of measurement data and reduction of noise, as each measurement technique works best for a specific material.”
A few challenges occurred during the image segmentation strategy, mainly related to spurious reflections and ambient light changes.
“In particular, reflections from other objects, reflections from ambient light sources and the significant change in lighting create errors in the segmentation of the images by labelling a large proportion of pixels erroneously,” the researchers explain. “Future work will include controlling the lighting and reflections used when creating the images by shielding the samples from ambient lighting as well as training the network by including more illumination conditions in order to improve robustness and finally customizing the selection of network parameters to enable more accurate segmentation of the images.”
Authors of the paper include P. Stavroulakis, O. Davies, G. Tzimiropoulos, and R. K. Leach.
Discuss this and other 3D printing topics at 3DPrintBoard.com or share your thoughts below.
You May Also Like
3DP AIPerfecter Offers Part Analysis to 3D Printing Service Bureaus
Service bureaus offer the ability to have prototypes and parts fabricated on professional equipment (especially important as some designers may not have access to any 3D printing resources) and in...
Objectify and 3DPrint.com Partner to Launch Advanced Additive Manufacturing Webinar Series
Under the Objectify AddMics (derived: Additive Academics) initiative—from India’s largest additive manufacturing bureau—Objectify Technologies joins hand with one of the most followed 3D printing media houses in the world, 3DPrint.com,...
3D Printing News Briefs, June 24, 2020: Intech Additive, Titomic, PrintLab, LEHVOSS Group
We’re talking about business, education, and materials in today’s 3D Printing News Briefs. Intech Additive Solutions is introducing a new executive, while Titomic says goodbye to its chairman and hello...
3D Printed Food: Extruding Nutritious, Fiber-Rich Snacks from Composite Flour
Researchers from the Computational Modeling and Nanoscale Processing Unit, Indian Institute of Food Processing Technology (IIFPT), Ministry of Food Processing Industries, Govt. of India, Thanjavur, Tamil Nadu, India, have released...
View our broad assortment of in house and third party products.