Mind What You Have Learned