In fact, the alcohol in the fluid can actually cause water to freeze more easily. This is because alcohol has a lower freezing point than water, so it can cause the water in the cleaning fluid to supercool. This means that the water can remain in a liquid state even below its freezing point, until it comes into contact with a nucleation agent, such as a dirt particle or a scratch on the windshield. Then, the supercooled water will rapidly freeze, forming a layer of ice on the windshield.
To prevent water from freezing on your windshield, you can use a windshield washer fluid that contains antifreeze. Antifreeze is a chemical that lowers the freezing point of water, so it can help to keep the cleaning fluid from freezing, even in cold weather.