DE

↑ ↓ select, Enter open, Esc close

Count the most frequent lines in a file

harmlessText processingalle
Adjust the values, the command updates live
user@server
sort list.txt | uniq -c | sort -rn | head -n 20

Sorts the lines so that identical entries are adjacent, lets uniq -c count the repetitions and sorts the result numerically in descending order. This is the basic pattern behind many analyses, for example of IP lists, error messages or usernames. Any command that produces a list fits in front of the first sort, such as cut or grep -o.

Note: uniq only detects directly consecutive duplicates, which is why the first sort is mandatory.

Also searched as

  • count occurrences of each line linux
  • sort uniq count frequency
  • top entries in a list command line

Related one-liners

All in Text processing

Compare two lists: what is missing from the second

$comm -23 <(sort -u all-domains.txt) <(sort -u backed-up-domains.txt)
harmlessText processing

Join two files on a common field

$join -t ';' <(sort -t ';' -k1,1 domains-customers.csv) <(sort -t ';' -k1,1 domains-expiry.csv)
harmlessText processing

Align output as a table with column

$column -t -s ':' /etc/passwd
harmlessText processing

Calculate the average, minimum and maximum of a column

$awk -v c=2 'NR == 1 {min = max = $c} {s += $c; if ($c < min) min = $c; if ($c > max) max = $c} END {if (NR) printf "n=%d avg=%.2f min=%s max=%s\n", NR, s/NR, min, max}' measurements.txt
harmlessText processing

Convert a JSON array to CSV with a header row

$jq -r '(.[0] | keys_unsorted) as $k | $k, (.[] | [.[$k[]]]) | @csv' plugins.json > plugins.csv
cautionText processing

Convert text to lowercase or uppercase

$tr '[:upper:]' '[:lower:]' < domains.txt
harmlessText processing

Read first, then run.

The commands on myline.de act directly on servers, files and databases. A wrong path or placeholder can delete data irreversibly or make a server unreachable.

  • All commands are provided without warranty and are not tested on every system.
  • Understand what a command does before running it, and check every placeholder.
  • Make a backup first and, if possible, try it on a test system.
  • You run commands at your own risk. Liability for damages is excluded to the extent permitted by law.