how to put initial data in db

Question

I have a csv file with around 30,000 rows of data.

I need these data to be in a database for my application.

I'm not sure what approach I should take to initialize this data.

I'm using docker image of postgresql.

my thoughts are:

make .sql file that inserts this data, and execute this when docker runs.
just keep the docker volume that has this data inserted and mount it every run.
some other way...?

first approach is very versatile since inserting rows is a very common task that doesn't break. But down-side is that I need to do this in every docker-run.

I guess second approach is faster and efficient...? but volume might not be compatible if some reason postgres updates version or if I decided to change database.

any advices?

BertC · Accepted Answer · 2022-07-20 07:55:28Z

1

Just mount a volume on your host and put the database in there. If the database does not exist, then it's created by the Postgres Image. In an entrypoint procedure you could check if the database is empty and then load the 30000 records.

You state that this might not be thebest solution for the following 2 reasons:

Volume might not be compatible is postgres updates. But this won't happen since postgres updates will have a very small chance of requiring to rebuild the database.
You decide the change the database What do you mean? Change the database to Mongo or MySQL? In that case you have a code-change on your hands regardless of the solution you pick. Unless you use an ORM (NodeJS: Prisma, TypeORM?) which might make the change minimal.

edited Jul 20, 2022 at 7:55

answered Jul 20, 2022 at 6:28

BertC

2,74835 silver badges41 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Guest-01 Over a year ago

what do you mean by "entrypoint procedure"? is it a command in Dockerfile?

BertC Over a year ago

docs.docker.com/engine/reference/builder/#entrypoint

BertC Over a year ago

This is a script you can define which runs every time the container starts. In that script you can do everything: Like checking if database contains data, and if not then load the data. Entrypoint procedures can be quite large, whole programs doing lots of checking and configuring.

Collectives™ on Stack Overflow

how to put initial data in db

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related