nihilism is exhausting

Home
BikeHobo
ShiteCode
CodeLab
NoisyLittleBugger
Ελληνικά
Blather

AWK: Remove duplicate lines

Posted on 2025-10-162025-10-16 by Jarlath

awk '!seen[$0]++' input.txt > output.txt

…preserves line order

Categories: SHITECODETags: awk

Post navigation

Previous Post: SQL: Find CAS and EC

Next Post: SED: Remove lines with specified text

Latest Dumps…

SQL: Counting duplicate fields
SED: Find and replace in-situ
AWK: Remove lines ‘Error’ in nth field
GREP: Print ‘Error’ lines to new file
RDkit: Convert SMILES to canonical
SED: Remove lines with specified text
AWK: Remove duplicate lines
SQL: Find CAS and EC
AI: Coding with AI agents
BASH: CPU governor
RUST: Multi-line user input
RUST: Struct methods
RUST: Vector methods
RUST: Array operations
RUST: Print container contents
RUST: String methods
RUST: &str methods
RUST: Struct vs Vec
RUST: enum
RUST: String manipulation
RUST: Data Structures
BASH: .tmux.conf
C++: Bjorklund’s Algorithm
RUST: EC number validation checker
BASH: Tree to exclude specified directories
RUST: Axum app structure
RUST: Parse XML stream
RUST: Access the PubChem API
BASH: Script to process VEGA output files
SED: Delete first N lines of a file
BASH: Split a large file, retaining extension
SQLite: Find NOT NULL empty records
SQLIte: Table joins
SQLite: Remove duplicate rows
RUST: Delete sqlite records
RUST: Delete postgres records
RUST: Insert postgres record with sqlx
RUST: Insert sqlite record with sqlx
RUST: Insert character to -Nth position
RUST: Reverse a String
RUST: CAS number validation checker
RUST: Format chemIDplus to valid CAS
BASH: Solve file encoding issues
AWK: Swap columns
NGINX: Generate ssl certificate
SQLite: Create database and import data
GREP: GNU grep tutorial
AWK: Effective AWK programming
SED: A stream editor tutorial
RUST: Generate a random string
REGEX: Expression builder
AWK: Add a primary key column
POSTGRES: Load delimited file into table
POSTGRES: Add or delete columns
POSTGRES: Create a new database
SED: Delete specified lines from input file
RUST: Function with multiple return values
RUST: A half-hour to learn Rust
RUST: Web scraping template
RUST: Ownership & Borrowing
PHP: Hide category post in WordPress
BASH: System benchmarking script
BASH: Index directory to HTML file
RUBY: Extract text from pdf
RUBY: Recursive search and replace
RUBY: Delimited data – text file processing
RUBY: Validate chemical identifiers
RUBY: Open file modes
RUBY: Open file, read it, put lines into array
BASH: Rsync between servers

"Obviously, you're not a golfer."