To find the correct fuse(s), you need to consult your owner's manual. It will have a fuse box diagram showing the location of each fuse and what circuit it protects. Look for fuses labeled things like "Power Windows," "Window Switch," or possibly something more general like "Body Control Module" (BCM) as the power windows often run through the BCM.
Without your owner's manual, I cannot definitively tell you which fuse(s) to check. Incorrectly replacing fuses can cause further damage. Always consult the manual first.