Parallel Machine Learning Algorithm Using Fine-Grained-Mode Spark on a Mesos Big Data Cloud Computing Software Framework for Mobile Robotic Intelligent Fault Recognition

  title={Parallel Machine Learning Algorithm Using Fine-Grained-Mode Spark on a Mesos Big Data Cloud Computing Software Framework for Mobile Robotic Intelligent Fault Recognition},
  author={Guang-ming Xian},
  journal={IEEE Access},
An accurate and efficient intelligent fault diagnosis of mobile robotic roller bearings can significantly enhance the reliability and safety of mechanical systems. To improve the efficiency of intelligent fault classification of mobile robotic roller bearings, this paper proposes a parallel machine learning algorithm using fine-grained-mode Spark on a Mesos big data cloud computing software framework. Through the segmentation of datasets and the support of a parallel framework, the parallel… 

Rolling Bearing Fault Diagnosis Method Based on Parallel QPSO-BPNN Under Spark-GPU Platform

The proposed rolling bearing fault diagnosis method based on parallel QPSO-BPNN under Spark-GPU platform can quickly perform model training and fault diagnosis for large-scale rolling bearing vibration data, and the fault diagnosis accuracy reaches 98.73%.

A Method for Constructing Automatic Rolling Bearing Fault Identification Model Based on Refined Composite Multi-Scale Dispersion Entropy

The results indicate that the model proposed shows good fault identification, demonstrates good generalization performance, and has beneficial industrial application prospect.

Parallel Algorithm of Improved FunkSVD Based on Spark

The SP-FD algorithm improves the accuracy and parallel computing capability of the algorithm, which is better than the traditional FunkSVD algorithm, and shows good parallel performance in a cluster environment with multiple nodes.

Surface Roughness Prediction Method of Titanium Alloy Milling based on CDH Platform

A prediction method based on Cloudera's Distribution Including Apache Hadoop (CDH) platform is proposed, and an improved hybrid optimization (IHHO) method is proposed accordingly to optimize the SVM algorithm and predict the surface roughness in the CDH platform.

Research on Public Management Application Innovation Based on Spark Big Data Framework

  • Zhi Liu
  • Computer Science
    Mathematical Problems in Engineering
  • 2022
An analysis method and model is proposed that takes resident income, happiness index, urban planning, and ecological environment as the indicators of Spark big data and can improve the public management level of the city and help to build an intelligent city.

Tactile Perception Object Recognition Based on an Improved Support Vector Machine

This work improved the differential evolution (DE) algorithm and then used the DE algorithm to optimize the important parameter of the Gaussian kernel function of the support vector machine (SVM) to improve the accuracy of pure tactile target recognition.



Research on SVM environment performance of parallel computing based on large data set of machine learning

This paper starts with constructing multiple classifiers, combines the Spark framework of big data programming model and the classification characteristics of support vector machine to realize a parallel one-to-many SVM optimization algorithm based on large data sets and compares them through UCI data sets.

A Machine Learning Method with Threshold Based Parallel Feature Fusion and Feature Selection for Automated Gait Recognition

A new method is implemented for human gait recognition based on accurate segmentation and multi-level features extraction and it is shown that this approach reduces error rate and increases the CCR.

Bearing Health Monitoring Based on Hilbert–Huang Transform, Support Vector Machine, and Regression

The experimental results show that the use of the HHT, the SVM, and the SVR is a suitable strategy to improve the detection, diagnostic, and prognostic of bearing degradation.

Support vector machine with adaptive parameters in financial time series forecasting

  • L. CaoF. Tay
  • Computer Science
    IEEE Trans. Neural Networks
  • 2003
SVM with adaptive parameters can both achieve higher generalization performance and use fewer support vectors than the standard SVM in financial forecasting.

A self-organizing learning array system for power quality classification based on wavelet transform

  • H. HeJ. Starzyk
  • Engineering, Computer Science
    IEEE Transactions on Power Delivery
  • 2006
It is shown that there is no statistically significant difference in performance of the proposed method for PQ classification when different wavelets are chosen, which means one can choose the wavelet with short wavelet filter length to achieve good classification results as well as small computational cost.

Dynamic memory-aware scheduling in spark computing environment