To find the relevant fuse(s), you need to consult your owner's manual. It will have a fuse box diagram showing which fuse(s) control the power windows. There might be one fuse for all the windows, or separate fuses for different circuits related to the power window system (like the driver's side and passenger's side).
The fuse box is typically located under the hood or inside the car, often under the dashboard. Your owner's manual will show you the location of the fuse box(es).