Let Your Loss Be Your Lesson