DeepWelding: A Deep Learning Enhanced Approach to GTAW Using Multisource Sensing Images

  title={DeepWelding: A Deep Learning Enhanced Approach to GTAW Using Multisource Sensing Images},
  author={Yunhe Feng and Zongyao Chen and Dali Wang and Jian Chen and Zhili Feng},
  journal={IEEE Transactions on Industrial Informatics},
Deep learning has great potential to reshape manufacturing industries. In this article, we present DeepWelding, a novel framework that applies deep learning techniques to improve gas tungsten arc welding process monitoring and penetration detection using multisource sensing images. The framework is capable of analyzing multiple types of optical sensing images synchronously and consists of three deep learning enhanced consecutive phases: image preprocessing, image selection, and weld penetration… 

Figures and Tables from this paper

Multi-Output Monitoring of High-Speed Laser Welding State Based on Deep Learning
A multi-output model based on a lightweight convolutional neural network (CNN) architecture is proposed and the particle swarm optimization (PSO) technique is introduced to optimize the loss function of the model, to simultaneously monitor multiple state properties of high-speed laser welding of AISI 304 austenitic stainless steel.
Bi-Directional Convolutional Recurrent Reconstructive Network for Welding Defect Detection
Bidirectional Convolutional Recurrent Reconstructive Network (bi-CRRN) is proposed for welding defect detection and localization based on welding video and demonstrates that the proposed bi- CRRN outperforms the other segmentation network models in welding defects detection.
Visual-Acoustic Penetration Recognition in Variable Polarity Plasma Arc Welding Process Using Hybrid Deep Learning Approach
An end-to-end visual-acoustic penetration recognition (VAPR) framework based on a hybrid convolutional neural network (CNN) and extreme learning machine (ELM) and employed the ELM model as a strong tool to classify penetration status.
Development of Defect Detection AI Model for Wire + Arc Additive Manufacturing Using High Dynamic Range Images
Wire + arc additive manufacturing (WAAM) utilizes a welding arc as a heat source and a metal wire as a feedstock. In recent years, WAAM has attracted significant attention in the manufacturing
Applications of Molten Pool Visual Sensing and Machine Learning in Welding Quality Monitoring
On-line monitoring of welding quality is very important to the realization of intelligent welding technology and has become a research hotspot in the field of welding technology. This article reviews


Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
This work proposes a Parametric Rectified Linear Unit (PReLU) that generalizes the traditional rectified unit and derives a robust initialization method that particularly considers the rectifier nonlinearities.
Automatic Detection of Welding Defects using Deep Neural Network
An automatic detection schema including three stages for weld defects in x-ray images including three steps based on deep neural network is proposed to detect welded joints quality.
ImageNet classification with deep convolutional neural networks
A large, deep convolutional neural network was trained to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes and employed a recently developed regularization method called "dropout" that proved to be very effective.
Deep Residual Learning for Image Recognition
This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth.
Image-to-Image Translation with Conditional Adversarial Networks
Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Very Deep Convolutional Networks for Large-Scale Image Recognition
This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
Welding penetration prediction with passive vision system
Densely Connected Convolutional Networks
The Dense Convolutional Network (DenseNet), which connects each layer to every other layer in a feed-forward fashion, and has several compelling advantages: they alleviate the vanishing-gradient problem, strengthen feature propagation, encourage feature reuse, and substantially reduce the number of parameters.
A prediction model for keyhole geometry and acoustic signatures during variable polarity plasma arc welding based on extreme learning machine
Purpose The purpose of this paper is to investigate the relationship between the keyhole geometry and acoustic signatures from the backside of a workpiece. It lays a solid foundation for