Importing a CSV Into PostgreSQL Like a Pro

Rob Conery
1 min readFeb 22, 2022

--

Importing data into PostgreSQL can be time consuming and painful — unless you toss the GUI tools and use scripts.

The Head Command

It all starts with using the head command in the shell in order to pull out the column names:

head -1 master_plan.csv

This will pop out the very first line of the CSV, which is typically the header row. I’m working with Cassini’s mission plan data, so this is what I see:

Now I just copy/paste that into VS Code and run a simple replacement using “Change all Occurrences” to build my create table statement.

The final step is to use the copy from command to pull data out of the CSV and into the database. There’s a whole lot more to this (like data types to use and creating an isolated schema) — just watch the video already!

--

--

Rob Conery
Rob Conery

Written by Rob Conery

Author of The Imposter’s Handbook, founder of bigmachine.io, Cofounder of tekpub.com, creator of This Developer's Life, creator of lots of open source stuff.

No responses yet