The collection’s CEO left after just three months and its average price is down 96% from its all-time high—despite signing with Hollywood mega-agency CAA.