At least for MAME4Droid, when you specify a path it adds within the folder all the MAME's folders. Say you want to create /sdcard/MAME/roms the program will look for the games in the folder /sdcard/MAME/roms/MAME4Droid/roms (or something similar).