One grammatical point?

I read from books that we can use the adverb "formerly" with past tense . Is it possible to use this adverb with present perfect or past perfect, too?