Python - remove json object if missing key

Question

I'm looking to delete all objects from some JSON data if it is missing the key or value.

Here is a snippet of the JSON data:

[
  {
    "cacheId": "eO8MDieauGIJ",
    "pagemap": {}
  },
  {
    "cacheId": "AWYYu9XQnuwJ",
    "pagemap": {
      "cse_image": [
        {
          "src": "https://someimage.png"
        }
       ]
      }
   },
  {
    "cacheId": "AWYYu9XQnuwJ",
    "pagemap": {
      "cse_image": [
        {
        }
       ]
      }
   }
]

I'm looking to delete the 1st and 3rd object in the data because the 1st object has an empty ['pagemap'] and the 3rd object has an empty ['pagemap']['cse_image']

Here is what I've tried so far without any luck:

for result in data[:]:
    if result['pagemap']['cse_image'] == []:
        data.remove(result)

for result in data[:]:
    if result['pagemap'] == None:
        data.remove(result)

for result in data[:]:
    if len(result['pagemap']) == 0:
        data.remove(result)

Thanks for the help!

None of that is actually JSON, it's pure Python objects.

Keith
– Keith

2022-02-20 02:36:41 +00:00
Commented Feb 20, 2022 at 2:36 — Keith
– Keith, Commented Feb 20, 2022 at 2:36

BrokenBenchmark · Accepted Answer · 2022-02-20 02:39:31Z

1

Two things:

You don't want to remove elements from a list while iterating over them -- the memory you're removing is shifting as you're accessing it.
The third object has a nonempty ['pagemap']['cse_image']. Its value is a one-element list containing an empty dictionary. You need to index into the list to check whether or not the inner dictionary is empty.

With these two points in mind, here is an approach using filter() that also leverages the fact that empty data structures have falsy values:

result = list(filter(lambda x: x['pagemap'] and x['pagemap']['cse_image'] and x['pagemap']['cse_image'][0], data))

print(result)

answered Feb 20, 2022 at 2:39

BrokenBenchmark

19.4k7 gold badges26 silver badges40 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Keith · Accepted Answer · 2022-02-20 02:43:18Z

1

If that data structure remains consistent, you can do it with a list comprehension.

[e for e in d if e["pagemap"] and e["pagemap"]["cse_image"] and any(e["pagemap"]["cse_image"])]

produces:

[{'cacheId': 'AWYYu9XQnuwJ', 'pagemap': {'cse_image': [{'src': 'https://someimage.png'}]}}]

Where d is your given data structure.

answered Feb 20, 2022 at 2:43

Keith

43.2k11 gold badges62 silver badges77 bronze badges

Collectives™ on Stack Overflow

Python - remove json object if missing key

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related