EXTREMELY unlikely. Prostate cancer by definition starts in the prostate before it spreads elsewhere, and tumours would have firstly enlarged your prostate and secondly shown up in the scan. There are extremely rare types of prostate cancer that don't increase PSA, but they still show up by other means. Trust your urologist - he's the expert.
Best wishes,
Chris