Former Union minister calls it a conspiracy, says party a sinking ship