To find the correct fuse, you must consult your owner's manual. It will have a fuse box diagram showing which fuse(s) relate to the power windows. The diagram will also show the fuse amperage.
Without your owner's manual, I cannot give you the correct answer. Attempting to locate the fuse without the diagram risks damaging other systems by pulling the wrong fuse.