When they get that old anything can happen, whether they're 1,000 or a 100,000 miles on the clock.
Yes, replace the complete caliper. For insurance, I would replace the other side too.
And for the bearings, after repacking and assembling, tighten the nut down that holds the bearings in while...