Skip to content

adamatti/mysql_to_redshift

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Pet project to load data from mysql to redshift. It is using select/insert, need to be improved to a better/faster way.

Known issues

  • it only checks if table exists, not if columns matches
  • redshift doesn't enforce pk, so need to check if data exists prior to insert (or use a staging table)

Todo / Next steps

  • lint
  • tests
  • improve log config (or change logger)
  • move import logic from postgresDB class

Releases

No releases published

Packages

No packages published