Posted: January 29th, 2009 | Author: jgeiger | Filed under: Uncategorized | Tags: aws, ec2 | No Comments »
So, why is it if I launch an EC2 instance, I can’t access something like the user-data and get my aws access key and secret key? I launched it, so it knows it’s me. Why do I need to pass that information in?
Also, is there a place that I can check, similar to the meta-data section where I can get my account’s instance limit?
Posted: January 22nd, 2009 | Author: jgeiger | Filed under: Uncategorized | Tags: aws, ec2, github, google, map/reduce, mcw, vipdac | No Comments »
Why is it every example of Map/Reduce is counting words in a big textfile? Isn’t there someplace offering something of substance?
Also, the examples also seem to gloss over the fact that you need to get the data to the nodes in order to process it. Google’s got GFS hooked up to all 1000+ nodes, but how do you pull that off on EC2? EBS is only hooked to one node at a time…
I’m working on a system to do large scale analyses, and hopefully will be posting updates on the issues I’ve found.
You can follow the project at http://github.com/mcwbbc/vipdac/tree/master