Skip to content

kliron/FASS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FASS

Java >= 1.8 needed.

A program that screen-scrapes data from FASS.se and inserts drug information in a postgres database in a machine friendly form.

The crawler is single threaded.The extractor uses java 8 parallel streams to do the extraction and saves synchronously to a single file. All data is serialized/deserialized to XML files before being inserted to postgres. Stream marshalling/unmarshalling is used and so the program executes in constant memory and can handle arbitrarily large data sets.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages