It's also about guilt. It sounds childish beyond what should be at all common. But a lot of people have this idea where they "have" to overindulge in some things. But the excuse only holds when everyone is doing it. The second even one person says no then the excuse goes away.