How do I get past my set point body fat?

I was wondering because Im one of those guys who is lean but around 11-12 percent fat but im not lean enough to see my abs. I stay at this fat percent with no effort what so ever but I want to get down to single digits. If I excercise daily and eat a helthier diet would I be able to maintain a single digit fat percentage?