Daily Shaarli

All links of one day in a single page.

06/07/20

Running Awk in parallel to process 256M records

TL;DR Awk crunches massive data; a High Performance Computing (HPC) script calls hundreds of Awk concurrently. Fast and scalable in-memory solution on a fat machine.