Sort out columns of multiple csv files at once in Python

Question

really appreciate your help.

I have around 200 csv files with same header. eg of headers are x , y, z, time, id, type

I would like to sort out time colums of all csv files and save them again.

This is so far I have tried. But it doesn't work.

Could you please help me ??

Thank you


import csv
import operator
import glob
import pandas as pd

data = dict() # filename : lists

path="./*.csv"
files=glob.glob(path)

for filename in files:
    # process each file
    with open(filename, 'r') as f:
        # read file to a list of lists
        lists = [row for row in csv.reader(f, delimiter=',')]
        # sort and save into a dict
        sorted_df = lists.sort_values(by=["time"], ascending=True)
        sorted_df.to_csv('%.csv', index=False)

If you want them sorted by time, why would you sort them by "id"? — Tim Roberts
– Tim Roberts, Commented Mar 11, 2021 at 4:20
So, this is not your real code? Because this will create a file called %i.csv and overwrite it, over and over and over. — Tim Roberts
– Tim Roberts, Commented Mar 11, 2021 at 4:31
It wasn't working before. I solved it. Thanks a lot for your time. — user12321371
– user12321371, Commented Mar 11, 2021 at 5:10

popeye · Accepted Answer · 2021-03-11 04:56:56Z

1

I don't have much knowledge about the csv module but you're using pandas and it supports reading csv files with pd.read_csv, why not utilize that..

for filename in files:
  df = pd.read_csv(filename)
  df.sort_values('time', inplace=True)
  df.to_csv(filename, index=False)

This would overwrite all the files with same data sorted by time.

answered Mar 11, 2021 at 4:56

popeye

9361 gold badge11 silver badges29 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Sort out columns of multiple csv files at once in Python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related