If your husband smokes marijuana and you are trying to get pregnant, what are the effects on the baby?

I know that it can make it harder to get pregnant, but are there health risks for the baby? I read something about increased risk of some heart abnormalities. Is this true? Are there other risks? How high are the risks? How long does it take for the sperm to not be affected if he were to quit?