So white people are part Neanderthal?

Scientists have found that all non africans have Neanderthal DNA in them, apparently they inbreed with the Neanderthal before killing them all off. It is said to be only 1-4% of their genes though. Does this mean that most non-Africans are technically not fully human or Homo-sapiens?