As a woman of color who travels alone, is it a waste of money to visit places with zero diversity?

“I don’t want to spend a bunch of money and have a bad time.”