Testosterone levels in men peak during adolescence and early adulthood. As you age, your testosterone levels begin to decline after age 30 at about 1% per year. That is a significant drop over the years, having a great effect on your energy levels, sex drive and more.