From: Siraaj Khandkar Date: Wed, 28 Nov 2018 22:28:52 +0000 (-0500) Subject: Fix statically-defined number of processes X-Git-Url: https://git.xandkar.net/?p=dups.git;a=commitdiff_plain;h=f289b74bfb797118e32341290319012e3f06f8c1 Fix statically-defined number of processes --- diff --git a/README.md b/README.md index 28ed81a..6677b47 100644 --- a/README.md +++ b/README.md @@ -6,7 +6,7 @@ as having the same (and non-0) file size and MD5 hash digest. It is roughly equivalent to the following one-liner (included as `dups.sh`): ```sh -find . -type f -print0 | xargs -0 -P 6 -I % md5sum % | awk '{digest = $1; sub("^" $1 " +", ""); path = $0; paths[digest, ++cnt[digest]] = path} END {for (digest in cnt) {n = cnt[digest]; if (n > 1) {print(digest, n); for (i=1; i<=n; i++) {printf " %s\n", paths[digest, i]} } } }' +find . -type f -print0 | xargs -0 -P $(nproc) -I % md5sum % | awk '{digest = $1; sub("^" $1 " +", ""); path = $0; paths[digest, ++cnt[digest]] = path} END {for (digest in cnt) {n = cnt[digest]; if (n > 1) {print(digest, n); for (i=1; i<=n; i++) {printf " %s\n", paths[digest, i]} } } }' ``` which, when indented, looks like: