Idk if this is a good idea, but should we delete it as a tidy up or something ? just delete everything in it, not the folder. It just keep adding and adding stuff in and right now, it's about 11 GB in my computer now

yes, it's safe to delete everything inside the folder.

your toribash client will redownload peoples custom folders as you encounter them ingame, though.