That is a great question. I prefer to finish my polishing using the white buffing side of my Sally’s Miracle buffing block. This leaves a mirror finish without any residue. I do use something else that may work for you though? It is a sonic cleaner and steam pressure cleaner. I think the sonic cleaning may help loosen the residue and then the high pressure steam could then remove it? Here is a link:

I use this machine to remove grime and grit in between stones and their settings at a microscopic level. I think this would work well. Be sure to read the instructions when refilling the distilled water tank. It is a little counter intuitive.
Hope this helps.