It’s still detrimental to the conclusion to use a fallacious/invalid argument, as it will not convince people of the conclusion, even if it happens to be correct for a separate reason - in which case you should say that reason, not the fallacious one.