python kill python's sub-process

Question

I'm using requests_html to scrape some site :

from requests_html import HTMLSession
    for i in range (0,30):
    session = HTMLSession()
    r = session.get('https://www.google.com')
    r.html.render()
    del session

Now this code creates more than 30 sub-process of chromium as Python's sub-process. And this acquires memory, so how can I remove them?

I don't want to use psutil, as it will increase one more dependency and to kill python's sub-process python may have some built in method, I want to be enlightened, if there is so

I can't even use exit() as I have to return and then exit(inside a method), and of course I can't exit and return

You can use with as context manager like it is used in files opening and it will automatically closes the session just like file. — Tamoor Salah-U-Din
– Tamoor Salah-U-Din, Commented Dec 9, 2019 at 9:58

Dan D. · Accepted Answer · 2019-12-09 07:19:40Z

1

You might want to try closing the session:

session = HTMLSession()
session.close()

See requests_html.HTMLSession.close.

answered Dec 9, 2019 at 7:19

Dan D.

75k15 gold badges111 silver badges129 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

python kill python's sub-process

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related