The 51-year-old actor told a media outlet that "Sometimes things just don't work out and this is one of them".