RecentX remembers the exact location of the file when tagging.
The tags do not go with the document and are not saved inside the document. So after moving the files, you would need to re-tag them.
Not renaming and moving the files is the only way to not lose them.