Skip to content

eXdupe progressively gets worse at deduping #19

Description

@kskarlatos

I run a long test with 748 daily backups of my homeassistant db and eXdupe gets progressively worse at deduping

zpaq_stats.txt
exdupe_stats.txt

exdupe_redact.log

my script that did the job:

#!/bin/bash
ARCHIVE="/home/cartman/mysqlbackups.zpaq"
RAM="/mnt/zpaq/tmp"
OUT="/home/cartman/mysqlbackups.exd"
echo "starting at $(date)"

for i in $(seq 1 748); do
echo "=== Version $i ==="
rm -rf "$RAM"
mkdir -p "$RAM"

# Extract only this version
zpaqfranz x "$ARCHIVE" -to "$RAM" -range $i
ls -lAR $RAM

# Create full (first) or diff (rest)
if [ $i -eq 1 ]; then
    /home/cartman/exdupe -g8 -x1 -k "$RAM" "$OUT"
else
    /home/cartman/exdupe -D -x1 -k "$RAM" "$OUT"
fi
du -s "$OUT"
echo "ending compression version $i at $(date)"

done
rm -rf "$RAM"
echo "ending all at $(date)"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions