Sometimes with QGIS the best thing you can do is load up the stuff into Postgres, just orders of magnitude of perf improvements