That’s not entirely true. I guess it depends on if you rank your teams by overall record, conference record, ranking, or fans attendance. Since 2005 the ACC Championship runner up has only been invited to the Bowl once, (2010 FSU). The SEC Championship runner up has played in it twice since 2003, (LSU and South Carolina). But here are the rankings in overall record I think.
2003 – Clemson 3rd vs Tennessee 4th
2004 – Miami 3rd vs Florida 5th
2005 – Miami 3rd vs LSU 2nd *
2006 – Virginia Tech 3rd vs Georgia 6th
2007 – Clemson 4th vs Auburn T-4th
2008 – Georgia Tech T-3rd vs LSU 5th
2009 – Virginia Tech 3rd vs Tennessee 5th
2010 – FSU 2nd * vs South Carolina 2nd*