“Ayasdi, a company that has developed data visualization software it says uses big data to answer the questions you never thought to ask…Their new product is called the Iris Insight Discovery platform. It’s a type of machine learning that uses hundreds of algorithms and topological data analysis to mine huge datasets before presenting the results in a visually accessible way. Using algebraic topology, the system automatically hunts down data points close in nature and maps these out to reveal a network of patterns for a researcher to decipher…”
“Big Data will provide companies with unprecedented information. It will also provide lucrative careers for IT folks who are willing to take the plunge.”
“Barack Obama may have comfortably won re-election in the electoral college, and squeaked a victory in the popular vote. But here is the absolute, undoubted winner of this election: Nate Silver and big data.”
Nate Silver is a statistician and political blogger (FiveThirtyEight – Nate Silver’s Political Calculus) for The New York Times. His statistical forecasts for the 2012 American Presidential Election were amazingly accurate and are a great case study for validating the importance and value of big data.
Big data is almost on the cusp of the emerging technology hype cycle according to the Gartner 2012 Hype Cycle and according to Gartner’s Top 10 Strategic Technology Trends for 2012 (PCMAG.com). What is the ‘big’ deal with big data anyways? Below I have posted links to information resources highlighting a range of issues related to big data.
Gartner defines big data as…”the term adopted by the market to describe extreme information management and processing issues which exceed the capability of traditional information technology along one or multiple dimensions to support the use of the information assets. Throughout 2010 and into 2011, big data has focused primarily on the volume issues of extremely large datasets generated from technology practices such as social media, operational technology, Internet logging and streaming sources. A wide array of hardware and software solutions have emerged to address the partial issue of volume.”
The Data Drive Life by Gary Wolf (April 28, 2010) is a great backgrounder article on how we have come to generate more and more data in our daily lives.
Big Data/Linked Data White Paper from Fujitsu, March 2012
Significance to Libraries
Data Science: What’s in it for the New Librarian? from Information Space, July 16, 2012
Big data is also about the Internet of Things and Linked Data. Linked Data for Libraries OCLC Video posted August 7, 2012
Importance to Other Industries
Big Data and social media: A match made in heaven? posted October 23, 2012 at the TechRepublic
Big Data is Transforming Healthcare from Wired Science, October 16, 2012
Big Data Meets BI: Beyond The Hype from Information Week, October 30, 2012
Lists some of the other open source software in the big data space (versus Hadoop) Big Data Right Now: Five Trendy Open Source Technologies from TechCrunch, October 27, 2012