Cross and Learn: Cross-Modal Self-Supervision

  title={Cross and Learn: Cross-Modal Self-Supervision},
  author={Nawid Sayed and Biagio Brattoli and Bjorn Ommer},
In this paper we present a self-supervised method for representation learning utilizing two different modalities. Based on the observation that cross-modal information has a high semantic meaning we propose a method to effectively exploit this signal. For our approach we utilize video data since it is available on a large scale and provides easily accessible modalities given by RGB and optical flow. We demonstrate state-of-the-art performance on highly contested action recognition datasets in… CONTINUE READING


Publications referenced by this paper.
Showing 1-10 of 41 references

Similar Papers

Loading similar papers…