I sought to solve this very problem with my not-a-framework, CSS-based SPA library hafcaf (github.com/andrew565/hafcaf). It's in need of a better readme (in progress), but the gist is you can have your cake (fast and responsive) and eat it too (only as much JS as you want, no more than you need). </shameless-plug>
We're a place where coders share, stay up-to-date and grow their careers.
We strive for transparency and don't collect excess data.