The manual will have a diagram showing the fuse box layout and clearly indicating which fuse controls the power windows. Looking for a fuse labeled "Power Windows" or something similar is a good starting point. There might also be separate fuses for different window circuits (e.g., driver's side, passenger's side).