To say you should have done something implies that there was some kind of obligation, some kind of right or wrong. It’s a thing we say to shame ourselves, to express our regret for not having done something different. It’s the mournful cry of hindsight.