Study of 23-year-olds found the exams were even more important for those from disadvantaged backgrounds