

TL/DR: Archival instances might, but most (even Lemvotes) won’t hold onto that.
Anything you post or do is shared out to a much wider audience. You might be using a Lemmy account, but interactions are shared with Twitter-like instances (Mastodon) as much as they are shared with other Reddit-like (Threadiverse) instances such as PieFed or Mbin, as well as other kinds of instances that interact with the Fediverse.
Even Meta has a presence here on the Fediverse with Threads. You just don’t see a lot of Threads users toggling their account over to interact with the rest of the Fediverse, but there are a few who do. Granted, upvotes and downvotes aren’t displayed for most Twitter-like instances. So, I would say it’s unlikely that they are recording that.
If you accidentally downvote a post or a comment that information will be sent out to every other instance which is connected (federated) with yours. As I mentioned before, you could set up an account to limit how votes are shared which would mitigate that. Some instances might even have a feature to delay voting for a very short time to allow for cancellations.
So, would it stay in your public voting history? For any other instances that are set up for archiving and registering the history of the Fediverse, yes. But in almost every other case, no. Most fediverse instances will honor when you have cancelled an upvote or a downvote.













Viva La Dirt League had a funny video about something similar to this:
https://www.youtube.com/watch?v=VUHFXnOn7mI