DEV Community

Discussion on: Load StackOverflow's StackExchange data in PostgreSQL®

Collapse
 
xzilla profile image
Robert Treat

Have you tried this on the larger tables? I ran into issues processing some of them so ended up using Python scripts to convert the XML to data that could be loaded using COPY statements, which was MUCH faster. Code is available at github.com/pgtreats/stackoverflow_....

Collapse
 
ftisiot profile image
Francesco Tisiot

Hi Robert! Good suggestion! I tried to do the minimal set of steps outside of the database to avoid the need of specialised tools or installations on the client side! Def the Python route is something to try!