The simplistic explanation you were given is qualitatively correct. There are two key concepts here: Crystal Quality and also Crystal Size. Just about any crystal grown will have some sort of defects that affect the crystal quality. read more
Not only do they grow silicon as a single crystal, but they can also grow the crystals virtually defect free! The ability to grow these crystals is one of the main reasons that we are able to have the computing power we have today. read more