Exchange rates are typically related to established currency. I think that many, myself included, are hesitant to simply accept that cryptocurrency is real currency. It is hard to put a lot of trust in something backed by literally nothing but a computer algorithm, even if it is distributed. The other fundamental difference that I think I see is that it gets pumped up as an "investment". I realize that some folks pump gold up as an investment, and it has some intrinsic value, however, I don't invest in gold.
While I finally conceded and bought some IBIT, I honestly expect to regret it. Finally, the fact that around every corner, someone is barking about bitcoin and trying hard to get others to invest, just further strengthens my skepticism. It's weird in a "yeah I get it you do CrossFit" kind of way...