Black people take offense to it and it’s a legitimate gripe.
If you really have to guard your language around ANYONE you probably need to change the way you talk. That stated, the soft bigotry (I am being nice) of stating Black people or any group takes offense to something stated is really dumbing down the group. How in the heck can you state that not knowing ALL Black people. What you stated is wholly more racist.
You could state "This black man finds it offensive." I can believe that. May be a good idea to quit grouping people in a race or color first before instructing others on how "groups" think. Your outlook will change.
Take this from a white dude that grew up in the slums of Detroit and thought he was black until I got my drivers license.
One black dude would cut you, another would kill you, yet another would feed you and yet another black dude would hug you. The white guys.......about the same....(Am I racist? I called all white people about the same.)