Move arm- and aarch64-specific manpages into arch-specific directories.

This removes a bit of the .if/.endif clutter from man4/Makefile by using
the existing machinery that supports per-arch manpages.