Why are some people more obligated to care about a person's civil rights than others?

Isn't it weird how it seems like I'm obligated to care about other people's human rights and yet there you are still acting like you're not feeling obligated to care about that kind of stuff at all?