I'd say go ahead and have the hysterectomy if you are sure you do not want more children.
I, too, have a family history. My mother and her mother both had endometrial cancer. Even though I told my doctor about it at every visit, my endometrial cancer was stage IIB before it was diagnosed, and I had to have surgery and radiation treatment. The radiation treatment damaged the nerves in my lower back, and I am having slowly progressive difficulty walking. I wish that I had had a hysterectomy before age 45 (my only child was born when I was 40), but my doctor did not believe that the endometrial cancer in my family was hereditary and was more stunned that I when I was diagnosed with it at age 50. He never asked how old my mother and grandmother were at diagnosis (46 and 47, very young for endo cancer--most are in their 60s or older).
I am grateful that I am here to complain about it.