A drop in testosterone doesn’t always interfere with sex, but it can make it more difficult for your brain and body to get aroused. Some men may notice a drop in libido, while others may lose interest in sex completely. Low testosterone can also make it tougher to get or keep an erection.