The failure of a U.N. nuclear disarmament review conference to adopt a joint declaration dealt a major blow to Prime Min