0

I have read this question but i am using something different, How can I log into a website using python?

I am using Scrapy for web crawling and i dont want to use Mechanize.

What i want to do is login to my webiste with python and then i have to submit the forms using my data from database.

Provided all data are valid . How can i do that with scrapy. or I need to use any other libraries as well?

Improve this question
1

4 Answers 4

Reset to default
1

There is an example in the scrapy docs of logging into a website before starting your crawl.

Improve this answer
Sign up to request clarification or add additional context in comments.

Comments

0

You can send request with your user data to auth controller. For example your site get POST requests from form on site. So you can directly send POST request to it.

Improve this answer

Comments

0

Check out a similar question here: How to use Python to login to a webpage and retrieve cookies for later usage?

Check out URLib: http://docs.python.org/2/library/urllib.html

That should answer your question, but remember that there are authentication bits you have to satisfy to log into some website. I suggest looking into OpenID and python libs relating to that.

Improve this answer

Comments

0

You can use a python library like requests or you can simply use urllib2,cookielib here is a reference

In this case you can write a method which handle login,before submitting form you can load your data using django ORM,and then submit form.

Improve this answer

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.