Page MenuHomeFreeBSD

Upgrade net/ceph to version 12.2.2
ClosedPublic

Authored by wjw_digiware.nl on Dec 30 2017, 11:02 PM.
Tags
None
Referenced Files
Unknown Object (File)
Sun, Mar 3, 11:00 PM
Unknown Object (File)
Feb 25 2024, 8:08 AM
Unknown Object (File)
Feb 23 2024, 5:14 PM
Unknown Object (File)
Feb 22 2024, 4:35 AM
Unknown Object (File)
Feb 7 2024, 9:49 AM
Unknown Object (File)
Feb 1 2024, 1:47 AM
Unknown Object (File)
Jan 28 2024, 3:10 PM
Unknown Object (File)
Jan 25 2024, 1:05 AM

Details

Summary

In order to support Boost 1.66 this is in preparation for the upgrade
port will build with both Boost 1.65 and 1.66
But the Boost 1.66 libraries will only recognised correctly IFF when
the CMake port is patched to actually recognised this Boost version in
Modules.

Test Plan

Ceph has its onw testset included, and is correctly executed on this
version.

Diff Detail

Repository
rP FreeBSD ports repository
Lint
No Lint Coverage
Unit
No Test Coverage
Build Status
Buildable 13961
Build 14155: arc lint + arc unit

Event Timeline

Since my port was change in between by ports-managers
there were some unneeded changes.
So reduce the difference between version.

Accidently include the Boost 1.66 updates.
Try to remove them from this PR

Reduce diffs on white spaces and trivia

jbeich added inline comments.
net/ceph/Makefile
71

Why do you need LLD? If it's just to fix build maybe try the following:

.if ${/usr/bin/ld:L:tA} != "/usr/bin/ld.lld"
# <describe rationale or error message briefly>
USE_BINUTILS=		yes
LDFLAGS+=		-B${LOCALBASE}/bin
.endif
  • LLD before 5.0.1 (e.g., on FreeBSD 11.1) maybe unstable
  • -fuse-ld=lld would be a shorter way to use it
  • Did you check CMAKE_*_LINK_FLAGS doesn't override LDFLAGS from make.conf?
net/ceph/Makefile
21

Convert to USE_PYTHON=cython, see rP455210.

@jbeich

  1. I need LLD because otherwise one off the executables does not link. Seems to be a size limitation in the regular ld And after discussion with Ed Maste this was the solution that worked. Not sure how that impacts on 11.x. But my Ceph testruns do seem to work.
  2. I tried all kinds of incantations to get LLD to work, and this was the one that actually worked. It was painfull since it needs a poudriere rerun for every attempt. And even with ccache Ceph is big to build.
  3. Not really sure on how to verify that. But I would expect LDFLAGS to end up in LINK_FLAGS
net/ceph/Makefile
21

Ah, I did add that line from the online version but did
not remove this line.

Sort of a pitty that changes by others to the port I maintain
are not reported to me. So I'm notified automatically.
And can update my own kept files.

Will change

Remove verbose output during linking
leftover from getting lld to work

net/ceph/Makefile
71

@jbeich
This .if-.endif construct prevents misery on 11.1?
Because it seems to work for me on 12-CURRENT.

Is it OK to land before Boost 1.66.0 for 2018Q1 users given Ceph 12.2.2 builds fine against Boost 1.65.1? Or did you disable some features (e.g., WITH_RADOSGW_BEAST_FRONTEND) for the sake of Boost 1.66?

net/ceph/Makefile
71

I haven't tested in net/ceph yet but the conditional is based on rP457430 which itself is based on rP448576 and relies on ld.lld being a symlink (unlike ld.bfd). -B${LOCALBASE}/bin doesn't force LLD, so is less likely to break custom LDFLAGS in make.conf or on architectures still stuck with GCC (powerpc*).

This revision is now accepted and ready to land.Dec 31 2017, 12:36 AM

Is it OK to land before Boost 1.66.0 for 2018Q1 users given Ceph 12.2.2 builds fine against Boost 1.65.1? Or did you disable some features (e.g., WITH_RADOSGW_BEAST_FRONTEND) for the sake of Boost 1.66?

Exactly,
There is a small issue in Beast, and that is with a command for which there is an alternative.
But it can land before Boost 1.66 lands, giving you the option to pull the trigger on Boost whenever you have also fixed the Cmake FindBoost module.
And net/Ceph should build on both sides of the barrier.

net/ceph/Makefile
71

Would not be able to help with PPC stuff if it broke. :)
Running it now in my 11.1 poudriere jail, but it is a large build, and all kinds of dependancies need to be upgraded as well.

ultima added inline comments.
net/ceph/Makefile
5

DISTVERSIONPREFIX= v

net/ceph/Makefile
5

@ultima
Looks like a sensible one, will test once poudriere is done running the 11.1 version

Cleanup of versionstring in package.
And remove the v from v12.2.2

This revision now requires review to proceed.Dec 31 2017, 2:03 AM

@jbeich
Could you approve once again, fixed the way the versioning was done.
This makes more sense IMHO

This revision is now accepted and ready to land.Dec 31 2017, 2:27 AM
net/ceph/Makefile
71

ceph-12.2.2 built fine on 11.1 against boost 1.65.1 with the above workaround instead of -fuse-ld=.

  1. I need LLD because otherwise one off the executables does not link. Seems to be a size limitation in the regular ld And after discussion with Ed Maste this was the solution that worked. Not sure how that impacts on 11.x. But my Ceph testruns do seem to work.

I can't reproduce. Even without -fuse-ld= and -B${LOCALBASE}/bin ceph-12.2.2 builds fine: boost-libs-1.65.1_1 (11.1 amd64, 12.0 amd64), boost-libs-1.66.0 (11.1 amd64, 12.0 amd64). Can you provide more details e.g., poudriere log?

  1. I tried all kinds of incantations to get LLD to work, and this was the one that actually worked. It was painfull since it needs a poudriere rerun for every attempt. And even with ccache Ceph is big to build.

Have you tried disabling ccache?

  1. I need LLD because otherwise one off the executables does not link. Seems to be a size limitation in the regular ld And after discussion with Ed Maste this was the solution that worked. Not sure how that impacts on 11.x. But my Ceph testruns do seem to work.

I can't reproduce. Even without -fuse-ld= and -B${LOCALBASE}/bin ceph-12.2.2 builds fine: boost-libs-1.65.1_1 (11.1 amd64, 12.0 amd64), boost-libs-1.66.0 (11.1 amd64, 12.0 amd64). Can you provide more details e.g., poudriere log?

Oke, interesting since it has been bothering me for quite some time.
And I spent plenty of poudriere runs to find out what to use here.

I'll see if I can get a poudriere run going today with regular ld.bfd as it is.

  1. I tried all kinds of incantations to get LLD to work, and this was the one that actually worked. It was painfull since it needs a poudriere rerun for every attempt. And even with ccache Ceph is big to build.

Have you tried disabling ccache?

On and off, but not systematically. But (test)building ceph without ccache is a long
process on the limited hardware I have.

I'll run some more tests, but it seems that you are no longer held back by ceph
in your migration?

net/ceph/Makefile
71

Yup, this is what I found in my poudriere this morning.
So there is no problem there for 11.1

This revision was automatically updated to reflect the committed changes.