His tenure was marred by a prostitution scandal involving Secret Service agents during a presidential trip to Colombia last year.