The current pre-release of the client ("pioneer" in the version) is only compatible to itself. So you can only play with other testers. Please be aware!
I used dashes in the name of the directory with the mod, which apparently causes the problem. Names of files, on the other hand, can contain dashes, it would seem.
Problem solved.