My husband is also 46 and had a Gleason 3+3. We had to wait 5 months for the best surgeon (Dr. Lee at University of Pennsylvania) to perform DaVinci and Dr. Lee was very reassuring about the slow growth of this cancer. He felt very confident that my husband would be OK waiting and that in fact the cancer was unlikely to grow much at all even within a one year period. Now of course we still felt nervous but the fact that younger men like you and my husband are increasingly being diagnosed is testament to the fact that it's likely that many men walk around with PC until their first PSA test at 50 or 55. Anyway, I am probably not articulating this very well but he had really good surgical outcome. Both nerves spared. The best news--post surgery his pathology report was exactly as it was before surgery, no additional growth or spread and so we were very relieved that there were no mistakes in the original reading and also that waiting 5 months was not an issue.
Bottom line, a really good surgeon will give you the best advice and if surgery is required sooner than May, he or she will tell you so. If they have given you a few months to wait, I suggest you take the time to do what we did. Put PC out of your mind for a bit (I know it's hard but try). If you're married or have a significant other, splurge on a romantic trip and enjoy a break from it all. It really helps.
Best of luck. It will work out.