What happens if the offending team picks up the puck and there is player still offsides during a tag up?

For example say my team tags up and I'm offsides going after the attacker with the puck, and pick it up. Is the whistle blown? Or no because the opposing team touches it and kills the delayed offside?