The chair of the Horniman Museum said it was "moral" to return items taken by "force" years ago.