I was thinking of Isaac Asimov’s Second Foundation, the third in the sci-fi classic series. The secret group of scientist “saviors” of civilization were said to be at the end of the galaxy where they are the object of a galaxy-wide search by the evil mutant Mule, and others who essentially want to destroy them and all traces of their prescient knowledge.
But what is finally revealed it that these mysterious beings are quietly living at the center of the galaxy, more or less hidden in plain sight as simple farmers.
A great quote from that book:
“The most hopelessly stupid man is he who is not aware that he is wise.”
(Isaac Asimov)