• Cogent DataHub
  • Industrial
    • Industrial AI
    • Industrial IoT
      • Edge Computing
      • DHTP – The DataHub Transfer Protocol
      • IIoT Protocol Comparison
      • Demo
    • Cogent DataHub
    • Security
    • DataHub™ Service
    • ETK – Embedded Toolkit
      • IoT Gateways
      • Tested Devices
  • Case Studies
    • Blog
    • White Papers
    • News
  • Partners
    • Microsoft
    • Siemens
    • AVEVA
    • Join Now!
  • Investors
    • Financials
  • About Us
    • Management
    • Customers
    • Careers
    • Legal Notices
  • Click to open the search input field Click to open the search input field Search
  • Menu Menu
Blog
Blog - Industry Embraces Big Data

Industry Embraces Big Data

by Bob McIlvride

We blogged about Big Data six years ago. Back then, pushing industrial data to the cloud in real time was a novel idea. Collecting industrial data within the plant for on-site use had been going on for decades, but few companies were integrating that data with enterprise IT or analytical systems.

Today, all that is changing. IoT and Industrie 4.0 are ideal for connecting industrial processes to Big Data. Progressive companies routinely use digital transformation to feed analytical systems to improve performance across the enterprise. Others are taking notice, trying to catch up. A recent research project by Automation World points to the growing rate of acceptance and adoption of Big Data among system integrators and end users, and how they leverage it.

Half of the system integrators in the study report that most or all of their clients collect production data to run improvement analysis. A quarter of the end-users surveyed say that they collect data from over 76% of their systems and devices.

While most of the data being collected is for in-plant improvements in equipment and maintenance operations, somewhere between 40% and 54% is also being used for Industry 4.0, smart manufacturing, or digital transformation initiatives. Pulling Big Data from the shop floor has become that important in just a few years time.

Data collection technologies

Despite the move towards Big Data, the most widely-used approaches to collecting data are still hand-written notes entered into a spreadsheet, as well as on-site data historians, according to the report. So for many users, the technology hasn’t changed significantly since the 1980s. However, cloud and edge technologies are gaining acceptance, being used at some level in about one fourth of the facilities reported on.

The survey didn’t specifically address it, but we see that some technologies originally developed for in-plant use—most notably data historians—are now widely used in edge and cloud scenarios. Some of the most well-known real-time data historians have cloud equivalents, or can be run on cloud servers. As a result, there is no clear line between traditional data collection and IoT-based systems, and there doesn’t need to be.

What is needed is secure, real-time data communication between the plant and the office or cloud. As high-quality data communication is more widely adopted, and as companies implement digital transformation in more areas, we can expect to see a huge growth in Big Data applications to optimize resource use, increase production efficiencies, and bolster the profits of the enterprise.

Share this entry
  • Share on Facebook
  • Share on X
  • Share on WhatsApp
  • Share on LinkedIn
  • Share by Mail
https://skkynet.com/media/blog-industry-embraces-big-data.jpg 430 1000 Bob McIlvride https://skkynet.com/media/skkynet-logo.svg Bob McIlvride2022-11-29 02:30:532022-11-22 11:06:27Industry Embraces Big Data

Skkynet Blog

Explore the questions, watch the developments, and evaluate solutions for one of the biggest opportunities of our time: Implementing secure, real-time data access on the Industrial IoT.
- Bob McIlvride

Recent Entries

  • Skkynet Times Newspaper
    Skkynet Reports Q2 FY2026 Financial Results
  • CISA warns of attacks on PLCs like these
    CISA Warns of Attacks on PLCs Across U.S. Critical Infrastructure
  • The Ransomware Threat Manufacturers Can’t Afford to Ignore
X Logo X Logo Followon X RSS Feed Logo RSS Feed Logo Subscribeto RSS Feed
About Us Icon white

About Us

Skkynet has been helping organizations securely share real-time data for more than 25 years. We offer privately-hosted or fully managed solutions for moving data in industrial, embedded and financial systems, from anywhere to anywhere.

News

June 18, 2026

Skkynet Reports Q2 FY2026 Financial Results

January 28, 2026

Skkynet Reports Fiscal 2025 Financial Results: Subscription Revenue Surges 268% Amidst Strategic Pivot to AI and SaaS

December 18, 2025

Skkynet Announces C$2.6 Million Industrial AI Product Development Initiative

December 16, 2025

Skkynet Appoints M&A and Software Executive Shaunna Balady to Advisory Board

Contact us icon white

Contact Us

Skkynet
2233 Argentia Road, Suite 302
Mississauga, ON L5N 2X7

International: 1-905-702-7851

US/CA Toll Free: 1-888-702-7851

[email protected]

Skkynet logo white

Cogent DataHub | Industrial | Case Studies | Partners | Investors | About us

Back to Top

linkedIn logotwitter logoyoutube logo

© 2026 Skkynet | All rights reserved | Legal notices
Link to: Case Study: TEPSYS, Japan Link to: Case Study: TEPSYS, Japan Case Study: TEPSYS, JapanTepco Systems Case study banner image Link to: Skkynet Achieves Record Sales Growth and Profitability for Fiscal Year 2022 Link to: Skkynet Achieves Record Sales Growth and Profitability for Fiscal Year 2022 Skkynet Times NewspaperSkkynet Achieves Record Sales Growth and Profitability for Fiscal Year 2022
Scroll to top Scroll to top Scroll to top

We are using cookies to give you the best experience on our website.

You can find out more about which cookies we are using or switch them off in .

Skkynet logo
Powered by  GDPR Cookie Compliance
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Strictly Necessary Cookies

Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

3rd Party Cookies

This website uses Google Analytics to collect anonymous information such as the number of visitors to the site, and the most popular pages.

Keeping this cookie enabled helps us to improve our website.

Cookie Policy

More information about our Cookie Policy