parallel

Run commands on multiple CPU cores. More information: <https://www.gnu.org/software/parallel>.

Install

All systems
curl cmd.cat/parallel.sh
Debian Debian
apt-get install parallel
Ubuntu
apt-get install parallel
Alpine
apk add parallel
Arch Arch Linux
pacman -S parallel
image/svg+xml Kali Linux
apt-get install parallel
Fedora
dnf install parallel
Windows (WSL2)
sudo apt-get update sudo apt-get install parallel
OS X
brew install parallel
Raspbian
apt-get install parallel
Dockerfile
dockerfile.run/parallel
Docker
docker run cmd.cat/parallel parallel powered by Commando

Run commands on multiple CPU cores. More information: <https://www.gnu.org/software/parallel>.

  • Gzip several files at once, using all cores:
    parallel gzip ::: file1 file2 file3
  • Read arguments from `stdin`, run 4 jobs at once:
    ls *.txt | parallel -j4 gzip
  • Convert JPG images to PNG using replacement strings:
    parallel convert {} {.}.png ::: *.jpg
  • Parallel xargs, cram as many args as possible onto one command:
    args | parallel -X command
  • Break `stdin` into ~1M blocks, feed each block to `stdin` of new command:
    cat big_file.txt | parallel --pipe --block 1M command
  • Run on multiple machines via SSH:
    parallel -S machine1,machine2 command ::: arg1 arg2

© tl;dr; authors and contributors