Cross and Learn: Cross-Modal Self-supervision

@inproceedings{Sayed2018CrossAL,
  title={Cross and Learn: Cross-Modal Self-supervision},
  author={Nawid Sayed and Biagio Brattoli and Bj{\"o}rn Ommer},
  booktitle={GCPR},
  year={2018}
}
In this paper we present a self-supervised method for representation learning utilizing two different modalities. Based on the observation that cross-modal information has a high semantic meaning we propose a method to effectively exploit this signal. For our approach we utilize video data since it is available on a large scale and provides easily accessible modalities given by RGB and optical flow. We demonstrate state-of-the-art performance on highly contested action recognition datasets in… CONTINUE READING
Tweets
This paper has been referenced on Twitter 11 times. VIEW TWEETS

Figures and Tables from this paper.

References

Publications referenced by this paper.
SHOWING 1-10 OF 41 REFERENCES

Similar Papers

Loading similar papers…