How about reliability and failure rate? These days the quality versions of both formats have a very low failure rate. But the CF cards are better in the quality department. This is really the only reason I use the CF as my primary.
Both shooting and download speeds are not that big of a deal for me. But if it were....its another notch for the CF.