The Surprising Things You Don’t Know About Big Data

The Surprising Things You Don't Know About Big Data What is Big Data? Big data includes data sets with sizes beyond the ability of commonly used software tools to capture, curate, manage, and process data within a tolerable elapsed time. Data Sizes Megabyte Gigabyte (1,024 megabytes) Bit Nibble Byte (1 byte) (½ byte) (½ byte) (1,024 kilobytes) A 1/8 of a letter 1/2 of a letter 1 letter 1 book 1600 books Terrabyte (1,024 gigabytes) Petabyte (1,024 terrabytes) 1 exabyte is equivalent toabout Exabyte (1,024 petabytes) 3000 times %3D the entire content of the Library of Congress. Only 10,000 miles short of reaching the moon! 1,600,000 books 160,000,000 books 2.5 quintillion bytes of data are created daily, produced by everything from photos uploaded to social media websites, to weather balloons, to the Curiosity rover currently exploring Mars. 1,600,000,000,000 books Bigger Than Big Data Zettabyte (1,024 exabytes) Yottabyte (1,024 zettabytes) Googolbyte *theorized (10 + 1000's bytes) Big Data at Big Companies Google processes 3.5 billion requests per day. This requires a massive amount of data storage. It is estimated that Google is one of the largest big data companies in the world given their many products and functions. In 2009, Google was preparing to have over I Amazon draws data of data. It is estimated that Google is now storing over 10 exabytes of data. from 152 million customers' purchases to help users decide on items to purchase. Facebook collects They use historical purchasing data of millions of customers to 500 terrabytes of data ,2.5 billion Google make the most accurate daily, including predictions of shopping needs. a Amazon is estimated to have pieces of content, 2.7 billion E around 1 exabyte of data stored. They are not forthcoming "likes" and 300 million photos. Facebook has admitted Facebook Amazon with the size of their data 100 petabytes of photo to having stored Microsoft storage, only admitting to storing around a billion "objects." and video as of 2012. At an average of 1 megabyte "object," they would have about an exabyte of data. per Microsoft has been somewhat fuzzy with their numbers as wellI. While CEO Steve Ballmer claimed in 2013 that the company operated more than one million servers, they will only go so far as to say that Hotmail, their email client re-named as Outlook.com, stored hundreds of petabytes of data in its billion-plus mailboxes. Other Big Data Companies Target has focused attention on using customer buying histories, estimated incomes, ages, and marital statuses to predict potential buying patterns. Target caused some controversy with their efforts to determine whether or not female customers are pregnant in order to target their ads and properly stock their shelves. VMware is a company specializing in cloud and virtualization software. VMware offers In 2013 UPS introduced ORION. This software utilizes customer, traffic, and companies the ability to store and process big data through their server space and virtual machine software. They have recently received recognition for their expertise in the deployment of hybrid cloud computing systems. This allows companies to utilize multiple clouds, both private and public, simultaneously. Target ups driving data collected during deliveries to streamline routes, speed deliveries, and reduce emissions. By the end of 2013 they had saved 1.5 million gallons of gasoline and reduced their carbon dioxide emissions by VMWARE UPS AWS 14,000 metric tons. According to Amazon sources there are more than 60,000 companies using AWS. AWS currently uses more bandwidth than Amazon.com proper. AWS represents $131 million of Amazon's annual $5.7 billion revenue. AWS fields more than 650,000 s3 requests every second, and hosts more than 900,000,000 objects. Who Uses AWS? Organizations/Companies Using AWS 1/3rd of all daily internet users will access a NETFLIX website built on AWS infrastructure at least once a day. Expedia reddit 1% of all internet traffic is coming or going on AWS backed infrastructure. A Adobe Instagram Pinterest Dropbox Companies by Estimated Number of Servers amazon.com 1,400,000 Google 1,000,000+ Microsoft 1,000,000+ facebook. Hundreds of thousands hp 380,000 150,000 OVH.COM Akamai 127,000 YAHOO! 100,000+ SOFTLAYER 100,000 94,122 rackspace (intel. 75,000 GODaddy 70,000+ 70,000+ eb y 54,011 intergenia 40,000 36,000 leaseweb The Past, Present, and Future of Big Data THE PAST Digital storage grew annually by 23% between 1986 and 2007. Most data was stored on videotapes such as VHS cassettes in the pre-digital revolution world of the late 1980s, Vinyl LP records, audio cassette tapes, and photography accounted for significant portions as well. Paper-based storage represented 33% of all data storage on its own in 1986. 25% of all data stored in the world in 2000 was stored digitally. 2002 is the first year that digital storage capacity overtook analog capacity. 94% of all data was stored in digital format by 2007. PRESENT Today, more than 2.5 exabytes (2.5 billion gigabytes) of data is generated every single day. This is expected to continue growing at a significant rate with mobile devices accounting for much of this data. Some experts have estimated that 90% of all of the data the world today was produced within the last two years. THE FUTURE of Cloud Technologies NEXT EXIT It is estimated that 40 zettabytes will be created by 2020. Increased usage by companies Increased focus 110 1101100 1001101001 0101001101 on security Studies have shown that cloud users list security as one of A 2014 study found that 94% of organizations their top five concerns for the future of cloud computing. Theft of intellectual property is the primary security threat. either already are or want to make cloud computing a part of their operations. Increased usage of private cloud computing Increased education and employment related to cloud computing PRIVATE Currently, /% of companies use entirely According to one survey, 66% of U.S. and U.K. organizations were interested in increasing their organization's IT skills to private cloud computing, while 58% use some combination of private and public cloud computing. better handle cloud computing, but 56% reported that they were unaware of available courses in cloud computing. 24% of respondents to a survey, however, claimed that they were interested in exploring private cloud adoption because of legal and regulatory challenges involved in public cloud computing. 42% of U.S. and U.K. organizations reported having hired IT professionals because of particular skills related to cloud computing, while 43% reported difficulty in finding candidates with necessary cloud computing skills. 79% of U.S. and U.K. companies reported that they believed that greater incorporation of cloud computing into college and university curriculums is necessary. How Does Big Data Affect Our Daily Lives? Sports Predictions Voting Prediction Smartphones VOTE Big Data has been shown to be useful in predicting the outcomes of sporting events; big data was famously used in 2012 to predict that the U.S. would win 108 medals in that years' Summer Olympics in which the U.S. ended up winning 104 medals. When a smartphone user gets directions, asks their phone a question out loud, or any number of other functions, it is the result of analyzing big data. Big Data has been used to predict the outcomes of elections. Statistician Nate Silver managed to predict the outcome of the 2012 presidential election with perfect accuracy. Personalized Advertising and Purchasing Recommendations Improved Traffic Flow Epidemic Detection and Prevention One of the primary uses for big data has been in the recommending of purchases and personalization of ads on websites. One study found that a person is more likely to complete Navy Seal training than to actually from drivers' GPS signals to react Several companies and cities have utilized big data to streamline the flow of traffic in Big data has recently come into use by Google and more recently by the traditional medical establishment to predict where outbreaks of potentially epidemic viruses such as the flu are most likely to appear. their towns. Using data derived click a banner ad. Both customers and in real time to traffic conditions, companies stand to benefit from more personalized and relevant ads. weather, accidents, etc. in order to maintain smooth traffic flow. SOURCES: www-01.ibm.com/software/data/bigdata/what-is-big-data.html webopedia.com/TERM/B/big_data.html gizmodo.com/5557676/how-much-money-would-a-yottabyte-hard-drive-cost pcmag.com/article2/0,2817,2372163,00.asp inc.com/graham-winfrey/what-cloud-security-will-look-like-in-2017.html infosys.com/industries/financial-services/white-papers/Documents/big-data-analytics.pdf networkworld.com/article/2288276/big-data-business-intelligence/114134-15-most-powe rful-Big-Data-companies.html datafloq.com/read/amazon-leveraging-big-data/517 fastcodesign.com/166955I/how companies-like-amazon-use big data-to-make-you love-them nytimes.com/2012/02/19/magazine/shopping-habits.html?pagewanted=all wired.com/2014/03/facebook-decade-big-data/ thebigdatainsightgroup.com/site/article/facebook-reveals-what-it-does-big-data businessinsider.com/facebook-350-million-photos-each-day-2013-9 crm.com/slide-shows/applications-os/240147224/8-ways-big-data-will-change-our-lives.ht m/pgno/0/1 theguardian.com/science/grlscientist/2012/nov/08/nate-sliver-predict-us-election crn.com/slide-shows/applications-os/240147224/8-ways-big-data-will-change-our-lives.htm/ usatoday.com/story/news/nation/2012/12/12/big-data-instant-information-lifestyles/17655 63/ hjo3.net/bytes.html ijis.net/ijis7_1/ijis7_1 editorial.pdf ADEPTIA