Complaint Review: Credit Diagnosis PMIDENITY Your Savings Club

I googled 'free credit report' and the fist option that came up was FreeCreditReportsInstantly.com. I signed up thinking I would see my credit report for free (they were charging $1.00 which would be refunded). They asked several security questions (including my credit card numbers), which I also stupidly answered. I did get a copy of my credit report.
I was shocked the next day to see three $1.00 charges not only from creditdiagnosis.com (what they call the service after you sign up) but also from both yoursavingsclub.com and pmidentity.privicymatters.com. I had never signed up for either of the latter services. I got NO emails that I needed to call to cancel if I don't want to be charged a membership fee.
I was then also charged 29.95 from creditdiagnosis and 14.95 from pmidentity a couple days later.
I have searched the sites to find what I may have missed as far as being charged fees, and have found nothing. I don't even know how often I could get this charge to my account. I have gone to the two websites and cancelled membership.
I am terrified of what they are doing with all the personal information I provided them, especially the site: yoursavingsclub.com which is a club for getting wholsale prices on all kinds of merchandise. I don't know what to do since it doesn't appear to be a legitimate business.

What can I do now?

laurie
Lansing, Michigan
U.S.A.