Upgrade devel/ccache to v4.1

[khng]

Summary

This version introduces Zstd compression for the compiler cache.
Besides, the code is also rewritten in C++. C++11 is required to compile
ccache with version greater than or equal to 4.0.

ccache(1) is generated from adoc now.

Some related PRs upstream:

• https://github.com/ccache/ccache/pull/750

[khng]

• Comment on "WARN: Makefile: "PATCH_SITES" has to appear earlier."

[khng]

• Fix a typo PATCH_SITE in comments

[bdrewery]

Thanks for working on this. I'll review+test soon.

[khng]

• Use upstream patches to replace PR #730

[rozhuk.im-gmail.com]

Do you try build ccache without installed ccache, cmake but with WITH_CCACHE_BUILD ?

[khng]

I found an issue that libzstd wasn't statically linked. Now I am working on it.

[khng]

• Add ZSTD_SYSTEM_STATIC=On option to link against zstd static library
• Add dependencies on perl5 when both DOCS and MEMCACHED options are on

[khng]

• Fix flipped MEMCACHED_CMAKE_ON/OFF

[khng]

• Update patches with "make makepatch"

[khng]

• Make patches from PR #750 extra

[khng]

Rebased to the most recent ports tree.

• Upgrade devel/ccache to v4.1
• Comment on "WARN: Makefile: "PATCH_SITES" has to appear earlier."
• Fix a typo PATCH_SITE in comments
• Use upstream patches to replace PR #730
• Add ZSTD_SYSTEM_STATIC=On option to link against zstd static library
• Add dependencies on perl5 when both DOCS and MEMCACHED options are on
• Fix flipped MEMCACHED_CMAKE_ON/OFF
• Update patches with "make makepatch"
• Make patches from PR #750 extra

[rozhuk.im-gmail.com]

This change should fix infinite recursion: https://github.com/rozhuk-im/freebsd-ports/commit/dfe7746fb71eb1df89474f527499a1f5a768f01c

Here https://github.com/rozhuk-im/freebsd-ports/commit/56f23ccb032fff4dcd265b433f1f13cdb98fc7ed
4.1 ccache-devel, port rewritten:

• memcache removed
• add do-test ans TESTS option
• code compacted

Together both this commits allow normal bootstrap: build and install on fresh FreeBSD where no ports installed and ccache enabled before first port build.
IMHO better to move all memcache staff out from ccache / ccache-devel to ccache-memcached, this allow make port more compact and easy to support.

[khng]

In D27393#619198, @rozhuk.im-gmail.com wrote:

This change should fix infinite recursion: https://github.com/rozhuk-im/freebsd-ports/commit/dfe7746fb71eb1df89474f527499a1f5a768f01c

Here https://github.com/rozhuk-im/freebsd-ports/commit/56f23ccb032fff4dcd265b433f1f13cdb98fc7ed
4.1 ccache-devel, port rewritten:

• memcache removed
• add do-test ans TESTS option
• code compacted

Together both this commits allow normal bootstrap: build and install on fresh FreeBSD where no ports installed and ccache enabled before first port build.
IMHO better to move all memcache staff out from ccache / ccache-devel to ccache-memcached, this allow make port more compact and easy to support.

I think the infinite loop somehow happens in a weird way on my side. The cmake build, somehow, managed to build an older devel/ccache (3.7.x) from my another tree, thus recursion didn't happen.

[khng]

• devel/ccache: Apply NO_CCACHE_DEPEND=yes on Mk/Scripts/do-depends.sh

[khng]

This change should fix infinite recursion: https://github.com/rozhuk-im/freebsd-ports/commit/dfe7746fb71eb1df89474f527499a1f5a768f01c

My answer to the problem is to manipulate the .MAKEFLAGS target a bit, so that do-depends.sh will automatically inherit NO_CCACHE_DEPEND=yes on any possible depends-on builds.

[rozhuk.im-gmail.com]

IMHO,
.MAKEFLAGS: NO_CCACHE_DEPEND=yes
may stop work if some port define NOPRECIOUSMAKEVARS.

Mk/bsd.ccache.mk - all .MAKEFLAGS commented.
https://github.com/freebsd/freebsd-ports/commit/0033c2a4c4b4346e7ace80282f3a238e73434ec2
It is added as comment, but code uses MAKE_ENV, CONFIGURE_ENV to pass env vars to sub process.

Why to not fix NO_CCACHE_DEPEND, like in https://github.com/rozhuk-im/freebsd-ports/commit/dfe7746fb71eb1df89474f527499a1f5a768f01c ?

[khng]

In D27393#619474, @rozhuk.im-gmail.com wrote:

IMHO,
.MAKEFLAGS: NO_CCACHE_DEPEND=yes
may stop work if some port define NOPRECIOUSMAKEVARS.

NOPRECIOUSMAKEVARS will not stop variables not in _EXPORTED_VARS being exported to do-depends.sh

Why to not fix NO_CCACHE_DEPEND, like in https://github.com/rozhuk-im/freebsd-ports/commit/dfe7746fb71eb1df89474f527499a1f5a768f01c ?

I am not sure if it is really a good idea to simply let every dependencies inheriting NO_CCACHE_DEPEND. But if NO_CCACHE_DEPEND is only used by ccache-* then it seems fine to me.

[rozhuk.im-gmail.com]

If all ccache deps does not inherit NO_CCACHE_DEPEND then you may get infinite recursion, because some of dep may require ccache.
I already try bootstrap without this and get: ccache->cmake->ccache->cmake.....

[khng]

Yes. And .MAKEFLAGS: NO_CCACHE_DEPEND=yes should be sufficient on its own.
If NO_CCACHE_DEPEND is only a thing in devel/ccache then factoring the
logic out to Mk/* is also fine.

[rozhuk.im-gmail.com]

Yes, please use Mk.
It will be useful for https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252070 and https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252088

[khng]

• Revert "devel/ccache: Apply NO_CCACHE_DEPEND=yes on Mk/Scripts/do-depends.sh"
• Let NO_CCACHE_DEPEND propagate to the dependencies as well

[khng]

In D27393#620127, @rozhuk.im-gmail.com wrote:

Yes, please use Mk.
It will be useful for https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252070 and https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252088

I will move it to bsd.ccache.mk, but without CCACHE_ENV. Directly expanding CCACHE_ENV when invoking {SETENV} (which simply allows things inside sift through) in place seems to me doesn't match how the other flags work in do-depends.sh currently. At the end, this should still plays well with your proposed ports.

[khng]

• ZSTD_SYSTEM_STATIC=On could be replaced with explicit path to libzstd.a

[bdrewery]

Thanks for this. I split out ccache-memcached recently into its own port. It sucks that cmake and zstd are both dependencies now.
I also have local patches for src/ccache.cpp as well.
I will take what's here and adapt/credit where possible.

Mk/bsd.ccache.mk

36 ↗

(On Diff #81255)

I like the idea here but I believe this only works with direct port builds but will not with Poudriere. At least not without using the DEPENDS_ARGS hack which I think was mutually exclusive with FLAVORS support. I'll look into that.

[diizzy]

Regarding libmemcached that might be worth looking at
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=258816