Agent says Goodman, who was a judge on the show from 2004 until 2016, died peacefully