Exactly. I can rent some storefront right now and set up a fake card swiper. Maybe the barrier of entry for this kind of thing is lower... but is it lower than creating a web page and stealing credit card numbers?
The beauty of credit cards is that you're not responsible for fraud. I know that when I go to a restaurant the server could easily take a quick cell camera shot of my card, but I accept that risk because I know that I monitor my card activity and that I can recover that money if it does happen. The same applies here.
Your iPhone leaves a data trail, at the provider, at wifi spots, at bluetooth sensors. Now someone who is technically adept could muddy that trail considerably. But the basic forensic evidence is still there. And remember, for the most part criminals are human, and make human mistakes; they will do a transaction in full view of a security camera, or something equally dumb. It's no better and not much worse than the systems we have now.
http://en.wikipedia.org/wiki/Credit_card_fraud#Skimming
How is this any different?