Bread is only banned during the week of Passover because the Jews didn't have time to wait until their dough had finished rising before having to flee from the Egyptians so when they baked it it came out flat, giving us matzah. It's just a way to remember what happened during the exodus.