Testosterone is the principle male hormone and a decline in testosterone directly affects male libido. Testosterone levels can decline due to certain psychological and physical factors. However, it is possible to raise testosterone naturally through adopting a healthy lifestyle, good diet, regular exercise, less stress and natural supplements.