Page MenuHomeFreeBSD

mkimg: Add support for stream-optimized VMDK
Needs ReviewPublic

Authored by cperciva on Tue, Sep 29, 8:14 PM.
Tags
None
Referenced Files
F174186502: D60151.diff
Thu, Oct 1, 5:44 AM
F174152257: D60151.id188133.diff
Wed, Sep 30, 11:21 PM
F174151628: D60151.diff
Wed, Sep 30, 11:15 PM
F174128929: D60151.diff
Wed, Sep 30, 7:39 PM
F174099687: D60151.id188133.diff
Wed, Sep 30, 3:18 PM
Unknown Object (File)
Wed, Sep 30, 4:51 AM
Unknown Object (File)
Wed, Sep 30, 4:13 AM
Unknown Object (File)
Wed, Sep 30, 3:20 AM
Subscribers

Details

Reviewers
emaste
Summary

FreeBSD VM/cloud images tend to be highly compressible: The generic VM
images compress roughly 3.5:1, and cloud images typically even more
since they have significant unused space in their virtual disks. This
generally doesn't matter for users who can download compressed release
images and extract them locally, but for EC2 in particular relying on
uncompressed image formats is painful: We now upload over 500 GB/week
to AWS.

This commit adds the "stream-optimized" version of the VMDK format,
which compresses each 64 kB "grain" individually (and omits grains
which are all zeroes). Compared to uncompressed formats, this can
produce much smaller images; experiments indicate that using this
format for EC2 image uploads will reduce the weekly traffic to under
100 GB/week.

Co-authored-by: Claude Opus 5.5
Sponsored by: Amazon

Diff Detail

Repository
rG FreeBSD src repository
Lint
Lint Skipped
Unit
Tests Skipped
Build Status
Buildable 77501
Build 74384: arc lint + arc unit