Except if you live in Saudi and you voted in support of gay rights. Or HK and voted something negative of China, or if you were a republican and voted something supportive of trans. Voting behaviour can be published to bring detriment to their users.
In the UK, the Labour party suspended members who voted for content from other parties (such as that they had recovered from covid) etc or for voting for content from groups that were proscribed later and they were excluded from the party for this sort of stuff. They had previously hired someone who previously worked for a company linked to the Israeli state and potentially Mossad and they were using this knowledge to crack down on left wingers with in the party. (https://www.theguardian.com/...)
What people upvote is increasingly being highlighted and used as discreditation by association.
As the world becomes more digitalised, and this is used more and more, it becomes more and more critical. Maybe not for you personally, but for many.