afreytes, 👁️🗨️
of🇵🇷
@afreytes@mastodon.gamedev.place
Suppose you have 100k thousand files. With somewhat descriptive pathnames like:
Assets/Audio/MysticTownBeep.wav
Assets/Music/Mystic-Town-Theme.mp3
Assets/3D/FBX/Mystic_Sword.fbx
Assets/2D/UI/Mystic Button.png
If you tokenize every pathname you could search those tokens. Search for "mystic" and get all 4, search for "town" get 2.
Assuming the files are correctly named and such, then almost every token in the path is useful to categorize the whole 100k files.
[1/2]
afreytes, 👁️🗨️of🇵🇷@afreytes@mastodon.gamedev.place
If you had a text file with the list of all 100K pathnames...
How would you go about tokenizing or not, searching, storing, processing such a list? Database? Python? Excel? Something else?
I have a good idea of how I would go about it. But I would like to know how YOU would do it (and why).
No wrong answers, except using "AI" anywhere.
[2/2]