How can you message a background process from mod_python?

Question

We're running a Linux server running Apache2 with mod_python. One mod_python script inserts an entry in a database logging table. The logging table is large can be a point of disk-write contention, or it can be temporarily unavailable during database maintenance. We would like to spin off the logging as an asynchronous background task, so that the user request can complete before the logging is done.

Ideally there would be a single background process. The web handler would pass its log request to the background process. The background process would write log entries to the database. The background process would queue up to a hundred requests and drop requests when its queue is full.

Which techniques are available in Python to facilitate communicating with a background process?

forvaidya · Accepted Answer · 2014-10-16 13:08:48Z

1

you can use celery / redis task queue.

answered Oct 16, 2014 at 13:08

forvaidya

3,3435 gold badges28 silver badges36 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Andomar Over a year ago

Thanks. It looks like redis is a key-value store? How would you use that as a queue?

forvaidya Over a year ago

please refer to celeryproject.org. I have successfully used this in my projects.

Collectives™ on Stack Overflow

How can you message a background process from mod_python?

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related