Having trouble trying to pull data from a url into python using an API

Question

I'm trying to pull data from a chart on a site in csv format. I've tried different combinations of code but can't seem to figure it out. I keep getting the following errors depending on the code I write:

TypeError: 'set' object is not subscriptable TypeError: a float is required

My latest attempt looked like this:

import urllib   
import urllib2    
import csv    
import StringIO


url = "https://api.rjmetrics.com/0.1/chart/chartid/export"    
headers = {"X-RJM-API-Key": "myapikey"}
data = {"format=csv"}
response = urllib2.Request(url, data, headers)    
re = urllib2.urlopen(response)    
spamreader = csv.reader(re, delimiter=',', quotechar='|')    
for row in spamreader:    
    print row

The working CURL version looks like this:

curl -d "format=csv" -H "X-RJM-API-Key: myapikey" https://api.rjmetrics.com/0.1/chart/chartid/export

but I don't know how to work with curl.

Thank you!

Bump. If you have found the answer yourself, you can still answer your own question. — Flavian Hautbois
– Flavian Hautbois, Commented Apr 22, 2014 at 9:36

Flavian Hautbois · Accepted Answer · 2014-04-17 16:56:43Z

1

For this kind of task you should use the Requests package. That way you can properly set your header:

headers = {'X-RJM-API-Key': 'myapikey', 'content-type: text/csv'}
r = requests.get('https://api.rjmetrics.com/0.1/chart/chartid/export', headers=headers)

and then use the default csv reader.

answered Apr 17, 2014 at 16:56

Flavian Hautbois

3,1006 gold badges32 silver badges47 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

jaime · Accepted Answer · 2014-04-17 16:19:19Z

0

data should be a url encoded string, you are passing it a set -- {"format=csv"} is a set literal. Try this:

data = urllib.urlencode(dict(format='csv'))

answered Apr 17, 2014 at 16:19

jaime

2,3641 gold badge20 silver badges24 bronze badges

Collectives™ on Stack Overflow

Having trouble trying to pull data from a url into python using an API

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related