When diffing files and directories, don't follow symbolic links, instead
compare where they link to.

I am really hoping that someone will point me to a more elegant way to hand the
lstat vs stat usage here, but I couldn't see a way through.