It’s clearly psychological. It’s not that it quantitatively “matters.” I suspect very few people are going around using the downvote button with the intent of statistically decreasing the view count of a particular comment. On these politically charged posts, it’s used as a litmus test for whether or not you are part of the ‘right side’ or ‘the other side.’