Efficient Pairwise Neuroimage Analysis using the Soft Jaccard Index and 3D Keypoint Sets

  title={Efficient Pairwise Neuroimage Analysis using the Soft Jaccard Index and 3D Keypoint Sets},
  author={Laurent Chauvin and Kuldeep Kumar and Christian Desrosiers and William M. Wells and Matthew Toews},
  journal={IEEE transactions on medical imaging},
We propose a novel pairwise distance measure between image keypoint sets, for the purpose of large-scale medical image indexing. Our measure generalizes the Jaccard index to account for soft set equivalence (SSE) between keypoint elements, via an adaptive kernel framework modeling uncertainty in keypoint appearance and geometry. A new kernel is proposed to quantify the variability of keypoint geometry in location and scale. Our distance measure may be estimated between O(N2) image pairs in O(N… Expand

Figures and Tables from this paper


The WU-Minn Human Connectome Project: An overview
Progress made during the first half of the Human Connectome Project project in refining the methods for data acquisition and analysis provides grounds for optimism that the HCP datasets and associated methods and software will become increasingly valuable resources for characterizing human brain connectivity and function, their relationship to behavior, and their heritability and genetic underpinnings. Expand
PCA-SIFT: a more distinctive representation for local image descriptors
  • Yan Ke, R. Sukthankar
  • Computer Science
  • Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.
  • 2004
This paper examines (and improves upon) the local image descriptor used by SIFT, and demonstrates that the PCA-based local descriptors are more distinctive, more robust to image deformations, and more compact than the standard SIFT representation. Expand
SuperPoint: Self-Supervised Interest Point Detection and Description
This paper presents a self-supervised framework for training interest point detectors and descriptors suitable for a large number of multiple-view geometry problems in computer vision and introduces Homographic Adaptation, a multi-scale, multi-homography approach for boosting interest point detection repeatability and performing cross-domain adaptation. Expand
The heritability of multi-modal connectivity in human brain activity
It appears that genes, rather than the developmental environment, have the dominant role in determining the coupling of neuronal activity. Expand
LIFT: Learned Invariant Feature Transform
This work introduces a novel Deep Network architecture that implements the full feature point handling pipeline, that is, detection, orientation estimation, and feature description, and shows how to learn to do all three in a unified manner while preserving end-to-end differentiability. Expand
BrainPrint: A discriminative characterization of brain morphology
We introduce BrainPrint, a compact and discriminative representation of brain morphology. BrainPrint captures shape information of an ensemble of cortical and subcortical structures by solving theExpand
Distance between Sets
DISTANCE functions expressing the degree of dissimilarity of sets have found use in physical anthropology1, psychology2, numerical taxonomy3, ecology3 and elsewhere. During an ecological study by oneExpand
Neuroimage signature from salient keypoints is highly specific to individuals and shared by close relatives
All same-subject image pairs are identified by a similarity threshold despite confounds including aging and neurodegenerative disease progression, demonstrating the usefulness of the keypoint signature as a computational tool for curating large neuroimage datasets. Expand
Efficient and robust model-to-image alignment using 3D scale-invariant features
This paper presents feature-based alignment (FBA), a general method for efficient and robust model-to-image alignment. Volumetric images, e.g. CT scans of the human body, are modeledExpand
Multi-modal brain fingerprinting: A manifold approximation based framework
The robustness of the proposed framework to factors like image alignment and scan resolution, as well as the reproducibility of results on retest scans, suggest the potential of multi‐modal brain fingerprinting for characterizing individuals in a large cohort analysis. Expand