"Is there a such thing as too early for sex after surgery?"
Yes there is. Prostate surgery is a major operation, and although many men feel they've had a quick recovery and few side effects after robotic surgery, they can have a false sense of security as there is still a lot of healing.
Over exertion of any kind can often be counter productive.