Python catch exception "pandas.errors.ParserError: Error tokenizing data. C error"

Question

I am facing problem with my malfunction csv input file whole reading and which i can deal with by adding "error_bad_lines=False" in my read_csv func to remove those.

But i need to report these many files which is creating the problem, I assumed that i need to catch that exception. And i tried it via using

except pd.parser.CParserError

and

except ExceptionSubclass as exceptionsubclass:

After searching over Internet, in both the cases i am not able to catch this exception, if you have any idea how to report all the malfunction file please let me know.

Error i am getting :

Traceback (most recent call last):
  File "main.py", line 134, in reading_csv
    df = pd.read_csv(absolute_path_of_file, sep=',', dtype=str, keep_default_na=False)
    data = self._reader.read(nrows)
  File "pandas/_libs/parsers.pyx", line 890, in pandas._libs.parsers.TextReader.read (pandas/_libs/parsers.c:10862)
  File "pandas/_libs/parsers.pyx", line 912, in pandas._libs.parsers.TextReader._read_low_memory (pandas/_libs/parsers.c:11138)
  File "pandas/_libs/parsers.pyx", line 966, in pandas._libs.parsers.TextReader._read_rows (pandas/_libs/parsers.c:11884)
  File "pandas/_libs/parsers.pyx", line 953, in pandas._libs.parsers.TextReader._tokenize_rows (pandas/_libs/parsers.c:11755)
  File "pandas/_libs/parsers.pyx", line 2184, in pandas._libs.parsers.raise_parser_error (pandas/_libs/parsers.c:28765)
pandas.errors.ParserError: Error tokenizing data. C error: Expected 7 fields in line 22, saw 8

Nordle · Accepted Answer · 2018-07-26 11:47:42Z

7

Try using except pd.errors.ParserError instead of except pd.parser.CParserError.

This is the exception that is raised by pandas.

answered Jul 26, 2018 at 11:47

Nordle

3,0013 gold badges18 silver badges37 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Indrajeet Gour Over a year ago

i used all the mentioned exception class "except pandas.errors.ParserError:" | "except pandas.errors.DtypeWarning:" | "except pandas.errors.EmptyDataError:" and others but unable to catch our scenario.

Indrajeet Gour Over a year ago

#Nordle any idea how to do that

Nordle Over a year ago

And except Exception isn't catching it?

Vaidøtas I. Over a year ago

@Nordle except Exception works, thanks! Was looking for the same solution to the same problem. :) Is there still no way to pinpoint a pandas ParserError non-generally without "except Exception" yet?

Vasyl Kolomiets · Accepted Answer · 2023-01-06 12:51:33Z

0

The answer is here

from pandas.errors import ParserError
try:
    ...
except ParserError:
    ...

or simple

except pd.errors.ParserError  as text_exception:

answered Jan 6, 2023 at 12:51

Vasyl Kolomiets

4511 gold badge11 silver badges21 bronze badges

Comments

Alaa M. · Accepted Answer · 2023-01-20 20:57:25Z

0

This is what worked for me:

from dateutil.parser import ParserError

answered Jan 20, 2023 at 20:57

Alaa M.

5,38211 gold badges62 silver badges103 bronze badges

Collectives™ on Stack Overflow

Python catch exception "pandas.errors.ParserError: Error tokenizing data. C error"

3 Answers 3

4 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

4 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related