LF Host for over 30 gigs of database storage (MySQL preferred)

[ev0]

Yes, i understand it's dumb to store using MySQL on this size of a database, but it's what I've been given as a task.

I need a host, just so i can either remote SQL connect or even just host my software.

I built a global character scraper:

Pull server's auctions -> store character names -> go to that characters guild -> store all guild members -> crawl and store json of each person.

Everything is optimized, I've tried to host it locally, but I want to eventually give every access to the data.

What you can search for:
Who currently has ashbringer transmog?
Who has BOA helm enchants?
How many of X are there in the world (currently equipped)

Anyway, yeah. I need a host. If anyone has access or information it will be appreciated.

[tumms]

I know you said you're looking to stay with MySQL -- and for that I'm not sure of what to recommend really -- but if you're willing to switch, I think mongodb would be good as it stores json docs natively.

If you want a managed, guaranteed uptime service, a large database like that won't be cheap to run. Consider rackspace for MySQL or mongohq for mongodb. An alternative is to rent a VPS and just deploy your own MySQL server. This will reduce cost significantly, but you are then responsible for all upkeep and setup.

Perhaps you could refactor to avoid having to store as much data (maybe filter bank toons, people with no interesting items), or perhaps limit the scope of what you can search for to make the database more lean? I don't know. Good luck!

[ev0]

I know you said you're looking to stay with MySQL -- and for that I'm not sure of what to recommend really -- but if you're willing to switch, I think mongodb would be good as it stores json docs natively.

If you want a managed, guaranteed uptime service, a large database like that won't be cheap to run. Consider rackspace for MySQL or mongohq for mongodb. An alternative is to rent a VPS and just deploy your own MySQL server. This will reduce cost significantly, but you are then responsible for all upkeep and setup.

Perhaps you could refactor to avoid having to store as much data (maybe filter bank toons, people with no interesting items), or perhaps limit the scope of what you can search for to make the database more lean? I don't know. Good luck!

I love how you're a member for 8 years, and this was your first comment :P Thanks

[tumms]

Hah yeah, I registered back in the WoW Glider days... just recently started playing again. Totally forgot I made an account but I guess I did. I'm finishing up a CS degree so if you need help or want to collaborate feel free to PM me.