This fixes a number of UX issues with pdf-tools trying to eagerly build epdfinfo at the least appropriate times, e.g. when org-mode processes org-pdf-tools links. Mentioned in #5086