Started investing late in life, should I take risks?

Taking on undue risk to "make up for lost time" usually ends in tears. But neither will your portfolio get anywhere if you only use investments with "guarantee profit" (your term). The only guaranteed vehicles--bank savings, bank money market accounts, fixed annuities (guaranteed by insurance company)--are mostly paying a pittance in the current low interest rate environment. And that's unlikely to change much in the near future.
Instead of those two extremes, you'd be better served by creating a diversified portfolio of good investments that's appropriate for your time horizon and your capacity to handle portfolio fluctuations without selling in downturn.
Instead of trying to get lucky with higher returns on risky investments, folks who get a late start saving are better served with these strategies:

• from here on, regularly save more than you otherwise would have
  
• if possible and health permitting, work longer than typical retirement age, even if it means part-time work or self-employment later on, and
  
• reduce your expenses where possible, including possible lifestyle and housing changes if necessary to accumulate sufficient resources to meet your future spending needs

I hope that helps. All the best!