No, it's very common, and can go on for 6 weeks.
It's usually bright red for 3 days after the bleeding, and then it goes rust coloured (it is literally rust - the iron from the breakdown of the hemoglobin goes rusty). If you are still seeing bright red colour after 3 days, this would suggest it's still bleeding.
It's a good idea to get it out, because if you ever need more MRI scans of the area, rust is magnetic and causes the image quality in the prostate to be reduced.