Silvergate shares were down 2.7% following a downgrade by KBW analysts to market perform from outperform.