Create variables from values in another column in a pandas dataframe

Question

I have what seems like a rather simple questions but can't wrap my head around them.

I have a pandas dataframe for Tweets. The location of the users is registered in a variable named "Location" in various ways:

When the location is well recorded, I often get:

{'country_code': 'tr', 'state': 'Central Anatolia Region', 'county': 'Ã‡ankaya', 'city': 'Ankara'}

or

('country_code': 'tr', 'state': 'Black Sea Region', 'city': 'Trabzon'}

But sometimes, all I get is:

{'country_code': 'tr'}

('country_code': 'tr', 'state': 'Batman'}

and often, there's nothing and all that's registered is this:

{}

I want to write a script that can create new variables in my pandas dataframe for these individual values. In other words, if country_code is registered for a specific row, then I want the value in question to be recorded in a variable named country_code. And so on for state, county, and city. If nothing is there, it can simply input a blank or an NA for all the missing variables in question (county, state, city).

The end result should be such that I have four new variables in my dataframe: country-code, state, county, and city, based on the values registered in the "Location" variable with something (or nothing) registered for these values.

Can someone help by any chance?

Thank you so much!

i am confused because when you are describing DataFrame you are showing a dict. Is it a list of dict that you are referring to? — Inyoung Kim 김인영
– Inyoung Kim 김인영, Commented Nov 10, 2020 at 2:44
Thanks for the reply Inyoung! The variable Location in my pandas dataframe has these values--they seem to be registered as a series: type(newdf2['Location']) Out[31]: pandas.core.series.Series — saladin1991
– saladin1991, Commented Nov 10, 2020 at 3:10
pandas will automatically fill missing variables with NULL. Try printing some rows from newdf2. — Inyoung Kim 김인영
– Inyoung Kim 김인영, Commented Nov 10, 2020 at 5:14
I understand, thanks Inyoung. But the problem is that I want to create four new variables based on the values registered for either country_code, city, county, and state in the variable "Location". — saladin1991
– saladin1991, Commented Nov 10, 2020 at 12:43

saladin1991 · Accepted Answer · 2020-11-11 15:51:37Z

0

I was able to fix the problem by working with the original JSON file directly. All I did was store the location data into the different categories I was looking by using a for and if loop similar to what others suggest here. I did so instead of trying to use pandas specific functions to store the data registered in variable "Location" into different variables in my dataset.

answered Nov 11, 2020 at 15:51

saladin1991

1529 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Create variables from values in another column in a pandas dataframe

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related