As crazy as it might sound, even millionaires are fretting over whether they have enough for retirement. Researchers from Wealthville found that 31 percent of millionaires consider themselves wealthy and only 64 percent of those with $5 million or more are confident they'll meet their retirement goals.