Learning to Fail and Failing to Learn