I helped a homeless man today & suddenly I realized he didn't care an ounce about me at all

Why should we care about those don't care about us at all ? He wouldn't bother to bend down and help us out if we fell down. sometimes I wonder if we should help such persons.