Page 1 of 1

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 8:19 pm
by liz
We've finally got some money coming in, so we can migrate to a larger server setup. More info on the front page. HURRAY. (I promise you - none of you are as p***** off about the database errors as I have been.)

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 8:51 pm
by AlArenal
Yeah, some people seem to forget you, the admins and moderators are suffering, too. Looking forward to a smoother experience.

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 8:59 pm
by AlexPT
Good to know you trying to keep things working well

Hope the process goes well

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 9:25 pm
by Bakul Shah
I suspect your traffic will grow exponentially for a year or two and every couple months or so there will be a mad scramble for increased capacity. If affordable Amazon EC2 would be ideal as you can add capacity as needed. Alternately this may be a perfect opportunity to experiment with an elephant in a bramble: a hadoop map/reduce cluster! Map tasks run on individual 'Pis in the cluster, Reduce task(s) on the master node, which can be a hefty x86 server. Pi->Pi comm. will be much less than Pi<->master node so this should be a fairly scalable solution. 100 'Pis will give you 400MB/s to 1GB/s peak flash disk bandwidth, 10Gbps Pis<->master node bandwidth, 140,000 bogoMIPS processing BW (more, if GPUs can be deployed) etc. Probably $5K to $6K H/W cost, $500/year electricity + Internet pipe cost + management costs. Hm... not ideal and it will take a few months but 'Eating your own dog food' is also the best way to shake out bugs!

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 9:45 pm
by kghunt
I was starting to think that the forum was running on a pi cluster :-p

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 10:41 pm
by TheEponymousBob
Of course you say no more DB errors, but the day will come when Stephen Fry will unleash his Twitter Army upon you—it"s only a matter of time.

Speaking of which, I note he gave some Twitter loving to CoderDojo yesterday; nice to see him "bigging up" the whole kids + programming malarkey: https://twitter.com/#!/stephenfry/statu ... 7274733571

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 11:23 pm
by error404
I think you should look at fixing the software before / in addition to throwing hardware at the problem.

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 11:27 pm
by n3tw0rk5
Are the shiny new servers fitted with go faster stripes as well?

Re: Planned downtime tomorrow while we upgrade the servers

Posted: Tue Mar 06, 2012 11:29 pm
by Lynbarn
liz said:


We've finally got some money coming in, so we can migrate to a larger server setup. More info on the front page. HURRAY. (I promise you - none of you are as p***** off about the database errors as I have been.)



No, but you hide it pretty well (most of the time, anyway!)