You can use teabags with cold water, they'll work, it just might take a bit longer for them to infuse fully.
My daughter took the wrong teabag the other night when making herself tea and ended up with peppermint tea which she didnt want, so I just left it overnight and used it to make my shake in the morning, it was yummy.