Stocks drifted mostly lower on Wall Street, extending the market's losses into a holiday-shortened week