Prince Harry told to lay low for the sake of King Charles popularity