Should the idler pulley turn freely when replaced without engine running?

Yes, a newly replaced idler pulley should spin freely when the engine is not running. If it's stiff or doesn't turn smoothly, there's likely a problem with the pulley itself (seized bearing), or perhaps it's improperly installed. A freely spinning idler pulley is essential for proper belt operation and to prevent premature wear on other components.