Convert CSV Data Stream into Pandas DataFrame (Python 2.7)

Question

I have a CSV data stream/object called jobresults:

"number","person1","person2","type"
1234,"Michael Scott","Pam Beasley",false
2345,"Michael Scott","Jim Halpert",true
3456,"Jim Halpert","Dwight Schrute",false

How do I convert this object (it is NOT written out to a file) to a Pandas DataFrame?

I tried:

df = pd.read_csv(jobresults)

...to no avail. I believe read_csv requires an actual file pulled from the OS.

Any insight will be much appreciated!

piRSquared · Accepted Answer · 2017-06-12 21:21:25Z

6

Use io.StringIO

As stated here

For Python 3 use

from io import StringIO

df = pd.read_csv(StringIO(jobresults))

For Python 2 use

from StringIO import StringIO

df = pd.read_csv(StringIO(jobresults))

Considering your object is a splunklib.binding.ResponseReader You may need to use the read() method...

Try this:

from StringIO import StringIO

df = pd.read_csv(StringIO(jobresults.read()))

edited Jun 12, 2017 at 21:21

answered Jun 12, 2017 at 21:15

piRSquared

296k68 gold badges509 silver badges654 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

OverflowingTheGlass Over a year ago

I'm getting this error:

File "<ipython-input-39-64e491fd9bb9>", line 69, in <module>     df = pd.read_csv(StringIO(jobresults))  TypeError: initial_value must be unicode or None, not ResponseReader

I'm using Python 2.7 if that matters.

piRSquared Over a year ago

What is type(jobresults)?

OverflowingTheGlass Over a year ago

splunklib.binding.ResponseReader - it is a feed from a Splunk query

OverflowingTheGlass Over a year ago

Perfect - thank you very much. Apologies for the simple question.

Collectives™ on Stack Overflow

Convert CSV Data Stream into Pandas DataFrame (Python 2.7)

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related