Yes, it is a derogatory term. As is ‘vertically challenged’. As is ‘dwarf’ - unless you are actually referring to someone who suffers from the medical condition known as dwarfism. read more
The PC term Little People is used for both. But as you can see, it's like putting gay people and transgendered people into the same category. We're not really, except in the misunderstanding of others. read more