Do not use just water. Using straight antifreeze is also not recommended as it can be too concentrated. Always check your owner's manual for the specific recommendation for your vehicle, as there may be additional considerations.
Many auto parts stores can test your existing coolant and advise you on the best coolant to use.