When Finasteride is used for treating enlarged prostate, the dose is usually 5mg/day, and it halves PSA readings over about 6 months.
When used for hair loss, the dose is 1mg/day, and possibly has a lesser impact on PSA, but like Dave says, very likely no one will know.
What you could do is:
Stay on the Finasteride. Your PSA is probably stable by now in respect to going on to Finasteride.
Get your PSA tested now and compare with the last reading.
Then test again in 3 months to see if PSA in currently changing (and maybe again in another 3 months to double check).
If you come off the Finasteride now, I think that opens up another whole can of worms about how that will impact PSA and for how long, which is probably more uncertainties than just staying on it.