Ways of parsing big CSV files with Python
by - Thursday, January 1, 1970 at 12:00 AM
Hello...
Here I am going to share snippets of code I use to parse the CSV and print data inside.
You can technically do the same with cat or head commands on POSIX but this will help you to iterate data and post it into your own API endpoint, or Insert into external databases etc.

I can also suggest using cat or head commands on POSIX terminal to see what is inside.
$ cat filename.csv
$ cat filename.json

Here how to read files
Hidden Content
You must register or login to view this content.


Here is how I receive data in PHP on my endpoint:

Hidden Content
You must register or login to view this content.



If you want me to post the PHP file that receives data just answer to this thread.
Reply
You may just want to us: https://pypi.org/project/pandas/

You can import pandas, then using "read_csv" method of pandas, you can define "nrows" attribute as to how many rows you want to import.
https://baph.is | Telegram: @enemy

Reply
Manual parsing beats all.

#databreach
#RIU
Reply
nice share, thank you for posting it
Reply
ty for the share friend.
Reply
Awesome, thanks for sharing !!
Reply
ok, lets see what you have to offer
Reply
thanks for this share dude
Reply
thanks
Reply
nice share
Reply


 Users viewing this thread: Ways of parsing big CSV files with Python: No users currently viewing.