The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Data Engineering for the Factory of the Future: From Factory Floor to the Cloud – Part 1: Performance Evaluation of State-of-the-Art Data Formats for Time Series Applications
Abstract
In this chapter, the benefits that can be derived by using different existing data formats for industrial IoT (IIoT) and factory of the future (FoF) applications are analyzed. For factory floor automation, in-depth performance evaluation in terms of storage memory footprint and usage advantages and disadvantages are provided for various traditional and state-of-the-art data formats including: YAML, Feather, JSON, XML, Parquet, CSV, TXT, and Msgpack. Benefits or otherwise of using these data formats for cloud based FoF applications including for setting up robust Delta Lakes having very reactive bronze, silver, and gold data tables are also discussed. Based on extensive literature survey, this chapter provides the most comprehensive data storage performance evaluation of different data formats when IIoT and FoF applications are considered. The companion chapter, Part II, provides an extensive Pythonlibraries and examples that are useful for converting data from one format to another.
Related Content
|
Sakthivel Velusamy, S. Raguvaran, S. Vinoth Kumar, B. Suresh Kumar, T. Padmapriya.
© 2024.
25 pages.
|
|
Vishal Jain, Archan Mitra.
© 2024.
13 pages.
|
|
Ashish Khaira.
© 2024.
15 pages.
|
|
Udai Chandra Jha.
© 2024.
13 pages.
|
|
Akhilesh Kumar Singh, Ajeet Sharma, Pradeep kumar Singh, Surabhi Kesarwani, Amit Pratap Singh.
© 2024.
12 pages.
|
|
Sherly Alphonse, S. Abinaya, Ani Brown Mary.
© 2024.
32 pages.
|
|
Pancress Eddie Bato, Norfaradilla Wahid, Nur Liesa Mohammad Azemi.
© 2024.
12 pages.
|
|
|