PIRADS 4 means a strong likelihood of cancer, but sure, it can happen that it turns out not to be. A biopsy and looking at cells under a microscope is the only way to be certain.
Don't get too stressed about it. Localised prostate cancer is somewhat unpleasant to have treated, but not the end of the world.
All the best,
Chris