{"id":9040,"date":"2015-04-14T10:30:16","date_gmt":"2015-04-14T15:30:16","guid":{"rendered":"http:\/\/www.mrc-productivity.com\/blog\/?p=9040"},"modified":"2023-03-13T16:17:43","modified_gmt":"2023-03-13T21:17:43","slug":"7-hidden-sources-of-big-data-that-you-probably-have","status":"publish","type":"post","link":"https:\/\/www.mrc-productivity.com\/blog\/2015\/04\/7-hidden-sources-of-big-data-that-you-probably-have\/","title":{"rendered":"7 \u201chidden\u201d sources of big data (that you probably have)"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-725\" src=\"https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2010\/11\/Education.jpg\" alt=\"Education\" width=\"76\" height=\"100\" \/><span style=\"font-size: 14px;\"><em>Summary: Many businesses assume they don\u2019t have \u201cbig data.\u201d But, they unknowingly generate (or have access to) large data sets that just go unused. Where is this data, and how can you turn it into a competitive advantage?<\/em><\/span><br \/>\n<a name=\"20150406\"><\/a><!--more--><br \/>\nIf you\u2019re like most companies, you don\u2019t generate terabytes of data. You have no need for Hadoop or \u201cbig data\u201d processing.<\/p>\n<p>Or do you?<\/p>\n<figure id=\"attachment_8781\" aria-describedby=\"caption-attachment-8781\" style=\"width: 300px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-8781\" src=\"https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2015\/01\/digital-388075_640-300x211.jpg\" alt=\"photo credit: geralt via pixabay cc\" width=\"300\" height=\"211\" \/><figcaption id=\"caption-attachment-8781\" class=\"wp-caption-text\">photo credit: <a href=\"http:\/\/pixabay.com\/en\/digital-zeros-ones-woman-stylish-388075\/\">geralt<\/a> via <a href=\"http:\/\/pixabay.com\/\">pixabay<\/a> <a href=\"http:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/deed.en\">cc<\/a><\/figcaption><\/figure>\n<p>As it turns out, businesses generate (or have access to) more data than they realize. They\u2019re sitting on a gold mine of information that they never use.<\/p>\n<p>Just imagine:<\/p>\n<p>What if these businesses started using this data? What if they turned this data into meaningful management information?<\/p>\n<p>They could answer new questions about the business. They could discover better ways to reach customers. They can learn new ways to improve efficiency.<\/p>\n<p>The big question:<\/p>\n<p>Where is this data? How can a business access this untapped potential?<\/p>\n<p>Here are 7 \u201chidden\u201d sources of big data that you probably have (or can access):<\/p>\n<h3>1. Public domain data<\/h3>\n<figure id=\"attachment_8710\" aria-describedby=\"caption-attachment-8710\" style=\"width: 300px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-8710\" src=\"https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2014\/12\/ball-457334_640-300x168.jpg\" alt=\"photo credit: geralt via pixabay cc\" width=\"300\" height=\"168\" srcset=\"https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2014\/12\/ball-457334_640-300x168.jpg 300w, https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2014\/12\/ball-457334_640.jpg 640w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><figcaption id=\"caption-attachment-8710\" class=\"wp-caption-text\">photo credit: <a href=\"http:\/\/pixabay.com\/en\/ball-about-binary-ball-hand-keep-457334\/\">geralt<\/a> via <a href=\"http:\/\/pixabay.com\/\">pixabay<\/a> <a href=\"http:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/deed.en\">cc<\/a><\/figcaption><\/figure>\n<p>Even if your company doesn\u2019t generate \u201cbig data\u201d, that doesn\u2019t mean you can\u2019t use it. Big data is everywhere, and much of it is free for the taking.<\/p>\n<p>How so?<\/p>\n<p>Data placed in the public domain is freely available to any business. The problem is, many businesses either don\u2019t realize it exists, or choose not to use it.<\/p>\n<p>For example, here\u2019s a list of <span style=\"color: red; font-weight: bold;\">freely available \u201cbig\u201d data sources<\/span>. How can your company use this data to your advantage? Look for ways to combine this free data with your existing data. What insights can you pull out of these sources?<\/p>\n<p>Here\u2019s one great example: This company explains how they used freely available census data to boost revenue.<\/p>\n<blockquote style=\"line-height: 1.7em; background-image: none; margin-left: 0; padding-left: 18px; height: auto;\"><p>\u201cIn a recent campaign we ran in Nashville, TN , we ran pay-per-click (PPC) Adwords campaign with one ad targeting the entire metro Nashville area,\u201d says Bryan Clayton, CEO of <a href=\"http:\/\/www.yourgreenpal.com\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: red; font-weight: bold;\">GreenPal<\/span><\/a>. \u201cThe headline read \u2018Local Lawn Pros in Nashville are a click away.\u2019 and I thought the performance of the ad was good with a click through rate of over one percent and conversion rate of over 10 percent on the Nashville landing page but we needed to improve on it.<\/p>\n<p>We thought, how can we make this more contextual and relevant to the viewer? So we researched census data, looking at the average income and home values throughout the Nashville area.<\/p>\n<p>We found that East Nashville, an up-and-coming neighborhood, was populated with more working class, and a creative class demographic and we hypothesized this customer segment would be price sensitive but still not want to cut their own lawns. So we segmented those zip codes and only ran a specific ad for them, with a headline \u2018The Cheapest Lawn Mowing in Nashville. Lawn mowing from $20.\u2019\u201d<\/p>\n<p>We then created a matching landing page. After running the ad for one month, on-page analytics proved the guess to be true. We saw over 200 percent lift in click through rate and and 30 percent lift in on-page conversion.<\/p>\n<p>Studying the data your own business generates can tell you which of your online marketing campaigns works best. Do the ads appeal to your target market or another market altogether? The data may also point to completely new areas of customer interest.\u201d<\/p><\/blockquote>\n<h3>2. Energy metering<\/h3>\n<p>How much data does your office building generate? What if that data could help you save money every month? As explained below, this is a direction many companies are heading.<\/p>\n<blockquote style=\"line-height: 1.7em; background-image: none; margin-left: 0; padding-left: 18px; height: auto;\"><p>\u201cOne often-overlooked source of big data for companies is energy metering on their structures,\u201d says <a href=\"http:\/\/www.linkedin.com\/in\/douglasrbriggs\/en\" target=\"_blank\" rel=\"noopener\"><span style=\"color: red; font-weight: bold;\">Douglas R. Briggs<\/span><\/a>, Director, Business Intelligence at Washington University in St. Louis. \u201cWhile many companies with legacy structures have only building-level energy and utility metering, many more are installing metering locations to provide more granular collection and control of energy usage data. With granular data information collected by vendors&#8217; systems, it&#8217;s possible to feed dashboards showing both real-time and trend resource usage, which can be used to influence occupant behavior or highlight opportunities for conservation.\u201d<\/p><\/blockquote>\n<h3>3. Emails and Memos<\/h3>\n<figure id=\"attachment_9043\" aria-describedby=\"caption-attachment-9043\" style=\"width: 300px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-9043\" src=\"https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2015\/04\/spider-monkey-637062_640-300x225.jpg\" alt=\"photo credit: Hebi65 via pixabay cc\" width=\"300\" height=\"225\" srcset=\"https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2015\/04\/spider-monkey-637062_640-300x225.jpg 300w, https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2015\/04\/spider-monkey-637062_640.jpg 640w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><figcaption id=\"caption-attachment-9043\" class=\"wp-caption-text\">photo credit: <a href=\"http:\/\/pixabay.com\/en\/spider-monkey-email-letters-637062\/\">Hebi65<\/a> via <a href=\"http:\/\/pixabay.com\/\">pixabay<\/a> <a href=\"http:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/deed.en\">cc<\/a><\/figcaption><\/figure>\n<p>It\u2019s estimated that 400,000 terabytes of new email messages are created every year. What are you doing with all of that email data?<\/p>\n<p>Many companies place strict email storage size limits on their employees. But, what if&#8211;instead of making employees delete their emails&#8211;you stored that email data in a file system like Hadoop?<\/p>\n<p>What would that do for you?<\/p>\n<p>First, it gives your employees a way to go back and search through old emails (rather than deleting them). You never know when you might need to access an email from a few years ago.<\/p>\n<p>Second, it opens the door for analysis on that email data. For instance, <a href=\"http:\/\/blogs.igalia.com\/dpino\/2012\/08\/07\/metamail-email-analysis-with-hadoop\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: red; font-weight: bold;\">this company<\/span><\/a> learned that employees worked less on Mondays and Fridays from analyzing email volume. Another example: As explained below, data contained in email can help you understand employee sentiment.<\/p>\n<blockquote style=\"line-height: 1.7em; background-image: none; margin-left: 0; padding-left: 18px; height: auto;\"><p>\u201cOrganizational emails and memos are often good sources of data, enabling companies to understand employee grievances and general buzz about ongoing events within an organization,\u201d says Durjoy Patranabish, Senior Vice President &#8211; Analytics, for <a href=\"http:\/\/www.blueoceanmi.com\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: red; font-weight: bold;\">Blueocean Market Intelligence<\/span><\/a>. \u201cTracking these data sources and their analysis helps organizations understand the current buzz in the organization and how people and executives have reacted to changes or the general environment.\u201d<\/p><\/blockquote>\n<h3>4. Customer Requests\/Queries<\/h3>\n<p>How much data does your support department generate? From phone calls and emails with customers to support tickets, you can glean all types of information.<\/p>\n<p>For instance, this data could highlight:<\/p>\n<ul class=\"arrow-list colored\">\n<li>Problems with your product<\/li>\n<li>New features your customers want<\/li>\n<li>Customer training opportunities<\/li>\n<li>Good\/bad customer service reps in your company<\/li>\n<li>and much more.<\/li>\n<\/ul>\n<blockquote style=\"line-height: 1.7em; background-image: none; margin-left: 0; padding-left: 18px; height: auto;\"><p>\u201cCall center logs are vital in understanding the performance of customer service executives,\u201d says Patranabish. \u201cTracking these requests, queries and responses over a period of time can help organizations evaluate their training programs and manage customer experience.\u201d<\/p><\/blockquote>\n<h3>5. Software log files<\/h3>\n<figure id=\"attachment_7557\" aria-describedby=\"caption-attachment-7557\" style=\"width: 150px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-7557\" src=\"https:\/\/www.mrc-productivity.com\/blog\/wp-content\/uploads\/2014\/02\/background-213649_150.jpg\" alt=\"photo credit: PublicDomainPictures via pixabay cc\" width=\"150\" height=\"112\" \/><figcaption id=\"caption-attachment-7557\" class=\"wp-caption-text\">photo credit: <a href=\"http:\/\/pixabay.com\/en\/background-bits-bit-network-blue-213649\/\">PublicDomainPictures<\/a> via <a href=\"http:\/\/pixabay.com\/\">pixabay<\/a> <a href=\"http:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/deed.en\">cc<\/a><\/figcaption><\/figure>\n<p>Your business software generates massive amounts of data in the form of log files. These log files track everything about that software usage. For instance, a server log file tracks when users log on and off, which applications they access, and much more.<\/p>\n<p>What questions could that data help you answer? Here are a few:<\/p>\n<ul class=\"arrow-list colored\">\n<li>Which applications are most popular?<\/li>\n<li>Which applications are unused?<\/li>\n<li>Which users access which applications the most?<\/li>\n<li>How are users using the applications?<\/li>\n<\/ul>\n<p>It doesn\u2019t stop there. What if you could combine usage data across different software platforms in your business? Or, what if you could pull data out of your business software and give managers a clearer view of the business? For instance, as explained below, the data contained in collaboration tools would help businesses better understand project status and bottlenecks.<\/p>\n<blockquote style=\"line-height: 1.7em; background-image: none; margin-left: 0; padding-left: 18px; height: auto;\"><p>&#8220;Making sense of data from collaboration tools is important because managers are feeling increasing pressure to keep track of who&#8217;s doing what with whom and where projects stand,&#8221; says Brent Frei, Chairman, Co-Founder and CMO of <a href=\"http:\/\/www.smartsheet.com\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: red; font-weight: bold;\">Smartsheet<\/span><\/a>. &#8220;Visualizing the data from collaboration tools can give managers a big picture view of where everything stands. A new report by the late tech industry news and analysis site GigaOM describes the value of combining people, work, and content in a visual framework that uncovers valuable insights about the patterns of work collaboration. Not only is it possible to graphically depict project status, you can now identify patterns in team collaboration, visualize hubs of activity, and identify who the top performers are.&#8221;<\/p><\/blockquote>\n<h3>6. Outside social\/forum data<\/h3>\n<p>Customers and prospects increasingly share opinions about companies across social sites and forums. More and more, I see people asking questions about specific companies or products on Twitter, Facebook, and forum sites.<\/p>\n<p>Are you tracking this data? Not only does this information highlight your company\u2019s perception in the market, it can provide other valuable insights. For instance, Patranabish explains how it helps you understand how to improve your products\/services.<\/p>\n<blockquote style=\"line-height: 1.7em; background-image: none; margin-left: 0; padding-left: 18px; height: auto;\"><p>\u201cCustomer feedback mentioned on technical blogs and forums is useful for product development and engineering teams to understand the perceptions and general reactions to the features and services of the brand,\u201d says Patranabish. \u201cImprovements can be made on continuous tracking and analysis of customer feedback.\u201d<\/p><\/blockquote>\n<h3>7. Sensor data<\/h3>\n<p>As more hardware connects to the web, sensor data provides one of the biggest opportunities for real-time insights. In fact, it\u2019s <a href=\"https:\/\/medium.com\/i-m-h-o\/sensors-primary-source-of-big-data-c811326ef6e5\" target=\"_blank\" rel=\"noopener\"><span style=\"color: red; font-weight: bold;\">estimated that sensors will be the primary source<\/span><\/a> of big data for years to come.<\/p>\n<p>Where are all of these sensors? How are businesses using them today? Here are a few examples:<\/p>\n<p>&#8211; Location-tracking sensors help transportation companies track and analyze their fleets.<\/p>\n<p>&#8211; Sensors are making their way into homes and businesses, which track energy usage, activity, and more.<\/p>\n<p>&#8211; Bluetooth beacons are cropping up&#8211;offering many companies <a href=\"https:\/\/www.umbel.com\/blog\/mobile\/beacons-and-big-data\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: red; font-weight: bold;\">incredible opportunities with big data<\/span><\/a>.<\/p>\n<p>&#8211; This <a href=\"http:\/\/searchbusinessanalytics.techtarget.com\/feature\/Sensors-offer-big-data-users-an-operational-analytics-edge\" target=\"_blank\" rel=\"noopener\"><span style=\"color: red; font-weight: bold;\">article<\/span><\/a> explains how an energy company installed sensors on old pipelines to monitor pressure, flow, and other data.<\/p>\n<h3>Summary<\/h3>\n<p>Businesses generate more data than they realize. How can they capitalize on this data? The first step: Begin storing this data in a framework like Hadoop. Once you start capturing this data, you can start creating reports and dashboards to analyze it. Chances are, you\u2019ll find that it helps your business answer questions and provide insights that you never thought were possible.<\/p>\n<p>So, what do you think? Is there anything you would add to this list? If so, please share your thoughts in the comments.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Summary: Many businesses assume they don\u2019t have \u201cbig data.\u201d But, they unknowingly generate (or have access to) large data sets that just go unused. Where is this data, and how can you turn it into a competitive advantage?<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-global-header-display":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","slim_seo":{"title":"7 \u201chidden\u201d sources of big data (that you probably have) - mrc&#039;s Cup of Joe Blog","description":"Summary: Many businesses assume they don\u2019t have \u201cbig data.\u201d But, they unknowingly generate (or have access to) large data sets that just go unused. Where is thi"},"footnotes":""},"categories":[8],"tags":[79],"class_list":["post-9040","post","type-post","status-publish","format-standard","hentry","category-education","tag-big-data"],"_links":{"self":[{"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/posts\/9040","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/comments?post=9040"}],"version-history":[{"count":6,"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/posts\/9040\/revisions"}],"predecessor-version":[{"id":14690,"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/posts\/9040\/revisions\/14690"}],"wp:attachment":[{"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/media?parent=9040"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/categories?post=9040"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.mrc-productivity.com\/blog\/wp-json\/wp\/v2\/tags?post=9040"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}