Cross and Learn: Cross-Modal Self-Supervision

@article{Sayed2018CrossAL,
  title={Cross and Learn: Cross-Modal Self-Supervision},
  author={Nawid Sayed and Biagio Brattoli and Bjorn Ommer},
  journal={CoRR},
  year={2018},
  volume={abs/1811.03879}
}
In this paper we present a self-supervised method for representation learning utilizing two different modalities. Based on the observation that cross-modal information has a high semantic meaning we propose a method to effectively exploit this signal. For our approach we utilize video data since it is available on a large scale and provides easily accessible modalities given by RGB and optical flow. We demonstrate state-of-the-art performance on highly contested action recognition datasets in… CONTINUE READING

References

Publications referenced by this paper.
Showing 1-10 of 41 references

Similar Papers

Loading similar papers…