Variable table name in Django

Question

Can I use variable table name for db mapped objects? For example, there are n objects of the same structure and I want to store it in different tables, for raising performance on some operations.

Let's say I've got class defined as:

class Measurement(models.Model):
    slave_id = models.IntegerField()
    tag = models.CharField(max_length=40)
    value = models.CharField(max_length=16)
    timestamp = models.DateTimeField()

    class Meta:
        db_table = 'measurements'

Now all objects are stored into table 'measurements'. I would like to make table name dependant on 'slave_id' value. For example, to handle data from tables 'measurements_00001', 'measurements_00002' etc...

Is it possible to achieve this using Django ORM model or the only solution is to drop to SQL level?

Actually, it is equivalent to store in the same table. You just need to use the query to get those rows you need. You can't benefit much from doing in that way. — zs2020
– zs2020, Commented Jan 18, 2011 at 21:37

Javier · Accepted Answer · 2011-01-18 18:38:57Z

2

In the vast majority of cases, this shouldn't buy you any performance advantage. Any RDBMS worth its salt should handle immense tables effortlessly.
If it's needed, there could be some sharding of the table. Again, managed by the DB server; at SQL level (and ORM) it should be seen as a single table. Ideally, the discrimination should be automatically handled; if not, most RDBMS let you specify it at table definition time (or sometimes tune with ALTER TABLE)
If you choose to define the sharding method, each RDBMS has it's own non-standard methods. Best not to tie your Python code to that; do the tuning once on the DB server instead.

answered Jan 18, 2011 at 18:38

Javier

63.1k9 gold badges82 silver badges126 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

edkirin Over a year ago

The problem is that the performances drops with this table as it is filled with new records. Now there are more than 10 millions of records and it will be tens of millions more. The system communicates with various devices and logs data to this table. I'm considering to split this table for each device to have it's own. DB is MySQL, fine tuning is not an option since it's hosted on shared hosting.

Collectives™ on Stack Overflow

Variable table name in Django

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related