Going back to your original point, how do you diet when on hormone therapy (or in your case, still under the influence of hormone therapy)?
This is a good question which I've never seen answered. I've been to several presentations on diet for prostate cancer patients, and they all had one thing in common, no adaptation to the effects of hormone therapy, beyond saying you need a regular good diet. For me at least, this isn't true.
I also exercise quite a bit, and I could lose weight. However, body composition scales showed when I did this, I was simply losing muscle faster than I was putting on fat, i.e. my body was in effect burning my muscle but still gaining fat, which is definitely not what I wanted. What I've had to do is increase my protein consumption well above what you'll see in the classic good diet. For me, this is mainly chicken (turkey over the last week!) and fish, as I'm not much of a red meat eater.
With exercise and reasonably high protein consumption, I've managed not to lose any more muscle for some time. I have put on fat, but at a rate I considered sustainable for time-limited hormone therapy, although not if I need to return to it lifelong in the future. I'm a year behind you, my last implant having just run out.
If you are looking to modify your diet and see what effect it has, I would recommend using body composition scales. They quickly showed up for me that some weight loss I might otherwise have been pleased with was actually a bad thing, as it was muscle loss with fat gain.