This week Microsoft Research released Project Daytona MapReduce Runtime, a developer preview of a new product designed for working with large distributed data sets. Microsoft also has a big data analytics platform that uses LINQ instead of MapReduce called LINQ to HPC.Continue
EMC World is taking place in Las Vegas today. In addition to the announcement of EMC's own Apache Hadoop appliance and distribution, several other companies have announced new products ranging from software integration tools to storage appliances.
We've covered the increasing competition and innovation in the Hadoop market, and those trends show no signs of slowing down.
If you work with Hadoop, or want to, check out Antonio Piccolboni's overview of eight MapReduce languages. Piccolboni explores each language in search of a language that provides both concise syntax and the power to run both the "'inside' of map reduce, that is the code for the mapper and the reducer, as well as the 'outside', the logic that decides which map reduce jobs to run?" He also looked to whether he could write MapReduce programs that require multiple MapReduce jobs " including the case of a data dependent number and type of jobs."Continue
The explosion of data driven by sensors, data mining and social media and other Web-based interactions means that more and more companies will need to find ways of dealing with massive data sets - even companies that haven't typically been data driven before. But new business analytics applications may require more processing power than your organization has ever needed before, requiring you to find ways to handle data as efficiently as possible. Infrastructure-as-a-service providers and inexpensive data warehousing appliances with in-memory analytics will provide options for many organizations.Continue
Recommended by elsterama on January 16, 2011 via ReadWriteWeb
RedMonk analyst Stephen O'Grady tackles the question "What Factors Justify the Use of Apache Hadoop?" O'Grady cites two of the most common criticisms of Hadoop: 1) Most users don't actually need to analyze big data 2) MapReduce is more complex than SQL. O'Grady confirms these criticisms, but finds Hadoop useful anyway.Continue
Recommended by elsterama on January 13, 2011 via ReadWriteWeb
IBM's Watson supercomputer will take on Jeopardy champions Ken Jennings and Brad Rutter in a man-versus-machine Jeopardy competition that will air in February. The grand prize for the competition will be $1 million, with second place earning $300,000 and third place $200,000.
And at a practice round today, Watson was faster on the buzzer - and correct with its responses - than its human competitors.Continue