To know for sure, you should:
* Check the car's window switches: Obvious, but the presence of power window switches on the driver's door is a strong indicator.
* Look at the owner's manual (if you have it): This will list the standard and optional features of your specific model.
* Check the vehicle's sticker (if still present): Often located on the driver's side doorjamb, the sticker details the original equipment.
* Check the window mechanisms: If you look at the door panel, the presence of electric motors and cabling suggest power windows. However, this requires some disassembly and is not recommended unless you're comfortable with car mechanics.
If there are no power window switches, and you're unsure after checking other sources, it's highly probable your Cavalier has manual windows.