[NEW PORT] sysutils/mpifileutils: MPI parallel file utilities for high scalability on large filesystems.
Needs ReviewPublic
Actions

Authored by rikka.goering_outlook.de on Mon, Dec 15, 4:56 AM.

Details

Reviewers

None

Group Reviewers

Contributor Reviewers (ports)
Ports Committers

Summary

FileUtils provides a library (libmfu) and a suite of MPI-parallel file
utilities such as dcp (parallel copy), dcmp (compare), ddup (duplicate finder),
dfind, dtar/dbz2, dchmod, and more. Designed for high scalability on large
filesystems.

PR: 291679
Dependency Tree: https://bugs.freebsd.org/bugzilla/showdependencytree.cgi?id=291679&hide_resolved=1

Signed off-by: GenericRikka (rikka.goering@outlook.de)

Test Plan

make stage-qa [ok]
make check-plist [ok]
portfmt -D Makefile [ok]
portlint -AC [ok]
portclippy Makefile [ok]
poudriere testport [ok]

Diff Detail

Repository

R11 FreeBSD ports repository

Lint

No Lint Coverage

Unit

No Test Coverage

Build Status

Buildable 69260
Build 66143: arc lint + arc unit

Event Timeline

rikka.goering_outlook.de requested review of this revision.Mon, Dec 15, 4:56 AM

rikka.goering_outlook.de created this revision.

Harbormaster completed remote builds in B69260: Diff 168033.Mon, Dec 15, 4:56 AM

rikka.goering_outlook.de edited the summary of this revision. (Show Details)Mon, Dec 15, 4:59 AM

rikka.goering_outlook.de edited the test plan for this revision. (Show Details)

rikka.goering_outlook.de added reviewers: Contributor Reviewers (ports), Ports Committers.

removed DISTNAME from Makefile because of redundancy.

Harbormaster completed remote builds in B69262: Diff 168035.Mon, Dec 15, 6:33 AM

A quick question: most of the patches seem good to be submitted to the upstream. Is there a plan to do so?

In D54230#1238960, @lwhsu wrote:

A quick question: most of the patches seem good to be submitted to the upstream. Is there a plan to do so?

Yes — upstreaming is definitely the goal, and thank you for pointing that out.

Several of the patches in this series are already clean portability fixes (headers, API usage, format issues) and should be good upstream candidates as-is. A few others are more FreeBSD-oriented stopgaps for now (e.g. stubs or feature reductions where Linux-only APIs were used), and I’d like to refine those further before proposing them upstream so they’re acceptable and maintainable on all platforms.

This is the same approach I’ve been taking with sysutils/slurm-wlm: first get things building and usable on FreeBSD, then iterate and push the cleaned-up patches upstream once they’re in a good shape.

I do plan to submit the relevant patches upstream, and I’m very happy to adjust or split them further if that makes upstreaming easier.

Upstream PR opened: hpc/mpifileutils#664 (https://github.com/hpc/mpifileutils/pull/664)
It contains the portability patchset (xattr/fiemap/sysinfo guards + getdents fallback), keeping Linux behavior unchanged and using the static bz2 path on non-Linux.