To find the correct fuse(s), you MUST consult your owner's manual. The manual will have diagrams of both the underhood power distribution box and the interior fuse panel, clearly showing which fuse(s) control the power windows.
Searching online for "2002 Ford Explorer fuse diagram" might give you some generic diagrams, but these may not be perfectly accurate for your specific vehicle. Always rely on your owner's manual as the definitive source.