MonstaMunch: All I have is my email to them from months ago explaining that I'd tried to cancel my account, that I was still getting billed, and asking what I could do about it. All I got in response was what seemed like an automated reply telling me to cancel my account...
SimonG: How did you cancel? Per E-Mail? How are you supposed to cancel? I never had a MMO, but normally you need to cancel any contract with a signature (fax, scannedm etc.). Guess it is different with games.
That E-Mail is at least something.
I went to the my account thing on the Trion website (which owns Rift), and clicked the link to cancel my subscription. The second time I also tried to remove the billing information. I did think it was weird that I didn't get any confirmation from them, but like I said, I didn't get any confirmation from them when they charged me either, only from Paypal. And yes, they do have my email address, as they sent me one today asking me to join closed beta of their next crappy game.
Still, I'm glad it was easy to sort out with Paypal, that's something good I guess :)