I also had this issue:
Just close your open project and switch off the “Enable no-modal Welcome screen” checkbox on the bottom. Exit PyCharm and open it. You should now be on the good old projects menu window, remove the PyCharmMiscProject from the list and the directory shouldn’t appear again! (This worked for me on Fedora 43 Workstation with GNOME)