“When the time comes that the colored people of the South live in their own houses, cultivate their own farms, and read their own ballots, there will no longer be a race problem.”