Comment by KarlKode

Normally the risk of airborne spores taking over your growing material is much more likely than your (most of the time very selected and in no way adapted to the "normal" surroundings you try to grow them in) taking over your home. Keep in mind that almost all fungi like similar conditions and there are already loads of spores of fungi that are more adapted to your living conditions in the air.