The embattled DA was silent as he arrived at his downtown Manhattan office first thing Monday, brusquely walking inside