Right Whales can be recognized by the callosities pattern on their heads. They are an endangered species with an estimated 450 whales remaining. Marine biologists regularly perform manual recognition of the whales while monitoring the population but the process is slow and time consuming. Deep learning methods achieved state-of-the-art results on several visual recognition tasks. However, training deep learning models on this task is very difficult because the number of training images is low. We propose a wide localization network which can be used to localize the region of interest in image. Once the region of interest is localized, a deep learning model can be used to classify the whales. The solution we describe in this paper achieves an accuracy score of 78.7% and ranks as one of the best 3 solutions on this dataset.