Content-defined chunking added to Bazel

(buildbuddy.io)

36 points | by siggi 3 days ago

2 comments

  • a_t48 2 hours ago

    This is something I'm very interested in implementing for Docker builds. I've tested out CDC for the final image outputs, it results in smaller outputs but requires tuning between saved space versus request count when pulling. For build cache it might be even more advantageous.

    • londons_explore 5 hours ago

      Doesn't this mean that malicious inputs can deliberately cause super tiny or super huge chunks?

      • ramchip 5 hours ago

        The same is true without CDC, and you can configure a maximum size.