Wow, I'm impressed that you already knew about the third, and ultimately most dangerous, part!
While it's true that sugar and caffeine are bad for your bird, actually the most dangerous part of soda is the carbonation. Birds cannot belch, and the carbonation in the soda can actually kill your birds if they consume very much of it.