DEV Community

Need Help, building off-line & file based airtable

Razak Wasiu on October 22, 2018

Web apps like notion,coda,airtable bring new dynamics to spreadsheet database, but most of them are backed up with back-end database,primarily onli...
Collapse
 
rakannimer profile image
Rakan Nimer

Have you considered using sqlite ? Stores its data on the filesystem and is query-able and pretty solid 👍

Collapse
 
madibalive profile image
Razak Wasiu • Edited

i research on websql and sqlite, how is the performance on a 500k - 1 million rows
i do alot java ee, and performance is crucial havent work sqlite or websql with 500k + rows , is performance passable and ensure correctness ? thanks for the reply

Collapse
 
rakannimer profile image
Rakan Nimer

Here's a good overview of when to use sqlite : sqlite.org/whentouse.html

Querying 500K - 1M rows of well structured and indexed data won't be the problem (unless you want to do very complex queries), it's more likely that concurrent writes will be your bottleneck, but in your use-case it doesn't seem like you'll have that problem ?

Hope that helps !
Cheers

Thread Thread
 
madibalive profile image
Razak Wasiu

Hi thanks for the reply,my plan is to switch to hosted mysql for collaboration, so use sqlite for single user ,over electron basically like excel, do i face concurrency using single user,mostly multiple promise chain query?

Thread Thread
 
rakannimer profile image
Rakan Nimer

Using it as a mysql caching layer for single-user should work smoothly. At worst, if you face performance issues you can trim old data.

Make sure to check out better-sqlite3. It offers a sync, fast API for sqlite.

Thread Thread
 
madibalive profile image
Razak Wasiu

thanks for the all the help. off to read the docs on sqlite but be best contender