Corpus ID: 1745976

PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space

@inproceedings{Qi2017PointNetDH,
  title={PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space},
  author={C. Qi and L. Yi and Hao Su and L. Guibas},
  booktitle={NIPS},
  year={2017}
}
Few prior works study deep learning on point sets. [...] Key Method With further observation that point sets are usually sampled with varying densities, which results in greatly decreased performance for networks trained on uniform densities, we propose novel set learning layers to adaptively combine features from multiple scales. Experiments show that our network called PointNet++ is able to learn deep point set features efficiently and robustly. In particular, results significantly better than state-of-the…Expand
Local Spectral Graph Convolution for Point Set Feature Learning
TLDR
This article replaces the standard max pooling step with a recursive clustering and pooling strategy, devised to aggregate information from within clusters of nodes that are close to one another in their spectral coordinates, leading to richer overall feature descriptors. Expand
PointWise: An Unsupervised Point-wise Feature Learning Network
TLDR
A deep learning framework to learn point-wise description from a set of shapes without supervision that leverages self-supervision to define a relevant loss function to learn rich per-point features and demonstrates the ability of the method to capture meaningful point- Wise features through three applications. Expand
PointCNN
TLDR
This work proposes to learn a X-transformation from the input points, which is used for simultaneously weighting the input features associated with the points and permuting them into latent potentially canonical order, and calls it PointCNN. Expand
Deep Cascade Generation on Point Sets
TLDR
This paper proposes a deep cascade network to generate 3D geometry of an object on a point cloud, consisting of a set of permutation-insensitive points, and develops a dynamically-weighted loss function for jointly penalizing the generation output of cascade levels at different training stages in a coarse-to-fine manner. Expand
MetaSets: Meta-Learning on Point Sets for Generalizable Representations
Deep learning techniques for point clouds have achieved strong performance on a range of 3D vision tasks. However, it is costly to annotate large-scale point sets, making it critical to learnExpand
Neighbors Do Help: Deeply Exploiting Local Structures of Point Clouds
TLDR
Two new operations to improve PointNet with more efficient exploitation of local structures are presented, one focuses on local 3D geometric structures and the other exploits local feature structures by recursive feature aggregation on a nearest-neighbor-graph computed from 3D positions. Expand
LSANet: Feature Learning on Point Sets by Local Spatial Attention
TLDR
This work designs a novel Local Spatial Attention (LSA) module to adaptively generate attention maps according to the spatial distribution of local regions and proposes the Spatial Feature Extractor (SFE), which constructs a branch architecture, to aggregate the spatial information with associated features in each layer of the network better. Expand
Point Discriminative Learning for Unsupervised Representation Learning on 3D Point Clouds
TLDR
This work proposes a point discriminative learning method for unsupervised representation learning on 3D point clouds, which can learn local and global geometry features and achieves new state-of-the-art performance. Expand
SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters
TLDR
This work proposes a novel convolutional architecture, termed SpiderCNN, to efficiently extract geometric features from point clouds, which inherits the multi-scale hierarchical architecture from the classical CNNs, which allows it to extract semantic deep features. Expand
DeepPoint3D: Learning Discriminative Local Descriptors using Deep Metric Learning on 3D Point Clouds
TLDR
This paper proposes to learn 3D local descriptors by directly processing unstructured 3D point clouds without needing any intermediate representation, and uses a multi-margin contrastive loss which discriminates between similar and dissimilar points on a surface while also leveraging the extent of dissimilarity among the negative samples at the time of training. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 35 REFERENCES
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
TLDR
This paper designs a novel type of neural network that directly consumes point clouds, which well respects the permutation invariance of points in the input and provides a unified architecture for applications ranging from object classification, part segmentation, to scene semantic parsing. Expand
Very Deep Convolutional Networks for Large-Scale Image Recognition
TLDR
This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers. Expand
Deep Residual Learning for Image Recognition
TLDR
This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth. Expand
3D ShapeNets: A deep representation for volumetric shapes
TLDR
This work proposes to represent a geometric 3D shape as a probability distribution of binary variables on a 3D voxel grid, using a Convolutional Deep Belief Network, and shows that this 3D deep representation enables significant performance improvement over the-state-of-the-arts in a variety of tasks. Expand
Deep learning with geodesic moments for 3D shape classification
TLDR
The proposed algorithm uses a two-layer stacked sparse autoencoder to learn deep features from geodesic moments by training the hidden layers individually in an unsupervised fashion, followed by a softmax classifier. Expand
Spectral Networks and Locally Connected Networks on Graphs
TLDR
This paper considers possible generalizations of CNNs to signals defined on more general domains without the action of a translation group, and proposes two constructions, one based upon a hierarchical clustering of the domain, and another based on the spectrum of the graph Laplacian. Expand
Network In Network
TLDR
With enhanced local modeling via the micro network, the proposed deep network structure NIN is able to utilize global average pooling over feature maps in the classification layer, which is easier to interpret and less prone to overfitting than traditional fully connected layers. Expand
ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes
TLDR
This work introduces ScanNet, an RGB-D video dataset containing 2.5M views in 1513 scenes annotated with 3D camera poses, surface reconstructions, and semantic segmentations, and shows that using this data helps achieve state-of-the-art performance on several 3D scene understanding tasks. Expand
SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation
TLDR
This paper introduces a spectral parametrization of dilated convolutional kernels and a spectral transformer network that enables weight sharing by parametrizing kernels in the spectral domain spanned by graph Laplacian eigenbases and strives to overcome two key challenges: how to share coefficients and conduct multi-scale analysis in different parts of the graph for a single shape. Expand
OctNet: Learning Deep 3D Representations at High Resolutions
TLDR
The utility of the OctNet representation is demonstrated by analyzing the impact of resolution on several 3D tasks including 3D object classification, orientation estimation and point cloud labeling. Expand
...
1
2
3
4
...