"'I know you are drinking,' she said," the 53-year-old wrote in his memoir. "'How can you tell?' I said. I never worked