Fast Postgresql QA database population

We do a lot of testing - manual and automated, unit and functional - and most of our apps tend to use Postgresql. That means we want to reset the database back to a known state before every test.

The obvious approach is to run a SQL script that drops and recreates all objects in the database. That works OK, but it's a little slow and it makes managing all the production objects, plus any mock or test data needed for tests annoying.

Hence this script (for OS X right now, but I'll probably modify it to run on Linux too).

It's nothing fancy. You edit the first few lines of the script to tell it which postgresql installation to use, and the name of the QA database you want to create.

The first time it's run, it'll create a ramdisk and start a postgresql cluster running there. It creates a template database, then goes through the current directory looking for SQL scripts to run to populate it. Anything that matches databasename_template*.sql will be run.

For example, I'm creating a test database called abacusqa and my SQL scripts are:

abacusqa_template001.sql
abacusqa_template010_users.sql
abacusqa_template020_license.sql
abacusqa_template030_tickets.sql

Once that template database is created, it creates the actual QA database, based on that template.

Each time it's run after that, it'll terminate any connections to the QA database, drop it and recreate it from the template - all in well under a second.

You can run the script with "-w" to drop and recreate the database cluster and with "-u" to clean up after itself and remove the ramdisk.

It doesn't make any attempt to lock out new attempts to connect to the test database in the short time span between current connections being terminated and the database being dropped, so if the application under test reconnects to the database automatically with no delay it can win that race, and prevent the database from being dropped and recreated. It should probably set datallowcon to false in pg_database to avoid that, but right now it doesn't.

Download