Anyway, yeah, I think it should be
totally anonymous- i.e. please remove the "ratings received" section in the quick access thing, and ratings from users' profile pages. I've seen (and been the recipient of, a couple of times) a whole bunch of times someone counter-downvoting someone else just out of anger, and "why did you downvote me??" accusations aren't infrequent. I think being able to see that stuff cements grudges and takes away people's willingness to disagree with some people, and adds pretty much nothing.
For that matter, I can't be the only person who impulsively checks their ratings received section every time they make a mildly contentious post right? I should probably just restrain myself from doing that out of my own willpower, but it'd be nice to not be given the option in the first place.