I'm at https://github.com/adapter-hub/adapter-transformers/tree/master/examples/pytorch/question-answering . It looks like run_qa.py has been ported to use adapters, which makes for more effective tuning to tasks on low-end systems.