I suppose you might be able to get Apple to refund the cost if you can prove there was no "In-App Purchases" text under the "Free" price listed in the App Store.
Otherwise, it may be hard to prove "robbery", regardless of the rotation of the Earth.
AFAIK, you can easily
remove the app from any iDevice. But
that doesn't delete it from your account. If you go back to the App Store, you will see that the app is still in your "Purchased" list and you can re-download it for free, assuming no change in your credit rating.
To
remove an app, simply tap and hold any app's icon. You will soon see an "Remove app" and/or "Edit Home Screen" menu. Tap the small,
red "
-" on any app icon to
remove it from a screen. If you have an older version of iOS, you may not see any menu, but the small,
red "
-" will still be seen.