Skip to content

A simple script to count the number of records in a given list of CSV files. This is useful for verification after database loads as it takes into account newlines inside quoted strings, something a command like wc -l does not do.

License

Notifications You must be signed in to change notification settings

Ianvdl/csv-counter

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

csv-counter

A simple script to count the number of records in a given list of CSV files. This is useful for verification after database loads as it takes into account newlines inside quoted strings, something a command like wc -l does not do.

Quickstart

Example:

python3 csv-counter.py *.csv

Example output:

All counts exclude header row. One header row is assumed per file.

g_applicant_not_disambiguated.csv                 : 5,136,615
g_application.csv                                 : 8,257,883
g_assignee_disambiguated.csv                      : 7,596,786
g_assignee_not_disambiguated.csv                  : 7,596,786
g_attorney_disambiguated.csv                      : 9,283,885
g_attorney_not_disambiguated.csv                  : 9,383,336
g_botanic.csv                                     : 19,148
g_cpc_current.csv                                 : 48,473,812
g_cpc_title.csv                                   : 264,485
g_examiner_not_disambiguated.csv                  : 11,085,926
g_figures.csv                                     : 7,711,478
g_foreign_citation.csv                            : 35,757,764
g_foreign_priority.csv                            : 3,827,627
g_gov_interest.csv                                : 165,835
g_gov_interest_contracts.csv                      : 201,535
g_gov_interest_org.csv                            : 200,950
g_inventor_disambiguated.csv                      : 20,427,566
g_inventor_not_disambiguated.csv                  : 20,427,607
g_ipc_at_issue.csv                                : 20,730,648
g_location_disambiguated.csv                      : 81,837
g_location_not_disambiguated.csv                  : 33,168,375
g_other_reference.csv                             : 51,660,341
g_patent.csv                                      : 8,260,142
g_pct_data.csv                                    : 1,810,551
g_persistent_assignee.csv                         : 7,596,786
g_persistent_inventor.csv                         : 20,427,566
g_rel_app_text.csv                                : 2,240,992
g_us_application_citation.csv                     : 56,881,814
g_us_patent_citation.csv                          : 128,401,915
g_us_rel_doc.csv                                  : 13,211,907
g_us_term_of_grant.csv                            : 4,160,366
g_uspc_at_issue.csv                               : 14,139,741
g_wipo_technology.csv                             : 11,076,102

Done.

Contributions

Contributions are welcome to add features like delimiter selection and alternative output formats. Please open an issue or pull request for feature requests.

About

A simple script to count the number of records in a given list of CSV files. This is useful for verification after database loads as it takes into account newlines inside quoted strings, something a command like wc -l does not do.

Topics

Resources

License

Stars

Watchers

Forks

Languages