Remember that scene at the beginning of It’s a Wonderful Life, where people are all desperately trying to get into the bank because if it fails before they get in, they lose their money? That’s what the FDIC prevents.
This post uses a gift link which may have a view count limit. If it runs out, there is an archived copy of the article available
There’s also an implicit guarantee that the federal government would step in an make deposits good if there were a bank failure large enough to wipe out the FDIC