You'll start introducing water when your little one is ~6 months.

These cups can be used for water or milk. Just like bottles, you'll want a bunch of 'em!