erofs-utils: mkfs: implement extent-based deduplication
authorGao Xiang <hsiangkao@linux.alibaba.com>
Thu, 3 Apr 2025 08:14:03 +0000 (16:14 +0800)
committerGao Xiang <hsiangkao@linux.alibaba.com>
Sat, 5 Apr 2025 16:25:11 +0000 (00:25 +0800)
commitcf04b8b78f09aef6a7f0b77306db451332848c13
treef9e54e24318818c000bb2815e817aeeeafb8a679
parent7dd77b829c96f2ca5165addc3b6e50ee4a6bdde8
erofs-utils: mkfs: implement extent-based deduplication

Currently, only rolling-hash deduplication could be used for
compressed data, and it is still single-threaded for now.

Before applying multi-threaded compression to that, let's allow
extent-based compressed data deduplication if `-Efragments` is on.

This feature will only work if multi-threaded compression is active.

Signed-off-by: Gao Xiang <hsiangkao@linux.alibaba.com>
Link: https://lore.kernel.org/r/20250403081403.2671077-3-hsiangkao@linux.alibaba.com
include/erofs/dedupe.h
lib/Makefile.am
lib/compress.c
lib/dedupe_ext.c [new file with mode: 0644]
mkfs/main.c