Most are Hutu who fled their homes during the civil war that brought a Tutsi-dominated Government to power in July.
The Tutsi-dominated Government says anyone who did not take part in the massacres is welcome to come home.
An unknown number may have been Congolese citizens who had sought refuge under the Tutsi-dominated Government in Rwanda.
Fearing reprisals from Rwanda's Tutsi-dominated Government, the refugees have refused to return.
When the Tutsi-dominated Government took power, it insisted that the camps, filled with armed militias, were a destabilizing force and had to be disbanded.
At least one priest has been arrested by the new Tutsi-dominated Government on charges of collaboration in the massacres.
It is not only those guilty of taking part in the killings who fear revenge from the new Tutsi-dominated Government, but also the innocent.
As the rebellion grew and gathered other allies, Rwanda's Tutsi-dominated Government stepped in to arm and back the rebels.
Ties have worsened since the Tutsi-dominated Government came to power in Rwanda.
The new Tutsi-dominated Government in Rwanda is killing Hutu who dare to return, he said.