Scraping php site with python for a beginner

Question

I'm a complete newbie to scraping, and I'd like to get some data from here : http://fse.vdkruijssen.eu/ferrylist.php

I'm using Python 2.7 as it is the only language I know something about. I've tried and searched a lot, but there is a simple form to fill before accessing the data that I can't go through... No login required.

This is what I have so far:

import requests
from bs4 import BeautifulSoup

url='http://fse.vdkruijssen.eu/ferrylist.php'
params ={'selectplane':'Cessna 208 Caravan','submit':''}

response=requests.post(url, data=params)
soup = BeautifulSoup(response.text, 'html5lib')
print soup

Any help would be highly appreciated... Thank you !

EDITED & SOLVED : thank you 宏杰李!

your code gives HTML with results - so now learn how to use BeautifulSoup to search data in HTML. — furas
– furas, Commented Feb 5, 2017 at 20:48
Please edit your question to add exactly what your problem is. Don't just ask it in the comment. That way you will get your answer faster. — Raja
– Raja, Commented Feb 5, 2017 at 23:24

宏杰李 · Accepted Answer · 2017-02-05 21:09:28Z

1

params ={'selectplane':'Cessna 208 Caravan',
        'submit':''}

You missed a param:

answered Feb 5, 2017 at 21:09

宏杰李

12.2k2 gold badges32 silver badges37 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

MagicP Over a year ago

Thank you for this. Now beautifulsoup is raising a looping error

Collectives™ on Stack Overflow

Scraping php site with python for a beginner

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related