The J Smith decision took some wind out of the fanbase