Csv line contains null byte

Viewed 3k times. I am trying to read a csv file. Error: line contains NULL byte. Improve this question. Is this expected? Well, the error already tells you everything you need to know: that file is an invalid csv file. Thanks Jean! Turns out it was corrupt. Add a comment. Active Oldest Votes. Sign up or log in Sign up using Google. Stack Overflow for Teams — Collaborate and share knowledge with a private group.

Create a free Team What is Teams? Collectives on Stack Overflow. Learn more. Asked 3 years, 3 months ago. Active 3 years, 3 months ago. Viewed 2k times. I am using the following code to count the number of lines in a csv file with open "filepath. Improve this question. Can you show your csv file? But, is there a general solution that I can implement in my code?

I don't want to change the data for thousands of similar. Unfortunately, doesn't help — independentvariable. Show 4 more comments. Active Oldest Votes. Of course this is assuming the null bytes are not really part of the encoding and really are some kind of erroneous artifact or bug. I bumped into this problem as well. I looked around and found the xlrd Python module for reading and formatting data from MS Excel spreadsheet files.

With the xlrd module, I am not only able to read the file properly, but I can also access many different parts of the file in a way I couldn't before. How to convert a file to utf-8 in Python?

I solved my problem by copy-pasting in my text editor the data from my Calc-created file to a new editor-created file. I did the following to clean the file:. Disclaimer: Be aware that this overwrites your original data. Make sure you have a backup copy of it. You have been warned! I opened and saved the original csv file as a. I think the original encoding for the file I received was double byte unicode it had a null character every other character so saving it through excel fixed the encoding.

For all those 'rU' filemode haters: I just tried opening a CSV file from a Windows machine on a Mac with the 'rb' filemode and I got this error from the csv module:. Opening the file in 'rU' mode works fine. I love universal-newline mode -- it saves me so much hassle.

I encountered this when using scrapy and fetching a zipped csvfile without having a correct middleware to unzip the response body before handing it to the csvreader. Hence the file was not really a csv file and threw the line contains NULL byte error accordingly. I was trying to open a file that had been compressed but had the extension '. This error kept showing up until I used gzip. One case is that - If the CSV file contains empty rows this error may show up.

Check for row is necessary before we proceed to write or read. Stack Overflow for Teams — Collaborate and share knowledge with a private group. Create a free Team What is Teams? Collectives on Stack Overflow.

Learn more. Asked 11 years, 2 months ago. Active 1 month ago. Viewed k times. Error, e: sys. Improve this question. AP AP What does od -c say the first line looks like? How is the CSV generated? From excel, you may be able to try a dialect. Otherwise look at say: stackoverflow. It's not my CSV, and unfortunately I don't have the power to change it. I think it's been created as Excel and saved as CSV boo. A dialect sounds like a good idea - I'll try that!

If it's actually been saved as CSV, it should work. If it's been saved as an Excel file, and the extension changed to CSV, no dialect is going to work.