a (heavy) cross to bear
US /ə ˈhɛvi krɔs tə bɛr/
UK /ə ˈhɛvi krɔs tə bɛr/

1.
a difficult or unpleasant problem or responsibility that one has to deal with
:
•
Her chronic illness has been a heavy cross to bear for the entire family.
•
Dealing with constant criticism is a cross to bear for public figures.