Remove empty directories after r339776.
git svn won't remove empty directories without --rmdir which I forgot in r339776.