200+ Powerful Dashboards for Data Archival in Azure Data Lake

Industry:
Pharmaceuticals

Client Overview

Epredia was established in July 2019 through an acquisition by PHC Group from Thermo Fisher Scientific. Powered by trusted brands such as Shandon, Microm, Menzel Gläser and Richard-Allan Scientific, Epredia has a wide breadth of solutions that have and will continue to transform the anatomical pathology market.  Today, Epredia is a global company working to improve patient outcomes by providing groundbreaking technologies. Every product developed has been impacted by generations of employees who are committed to improving lives by enabling pathologists through enhancing precision in cancer diagnostics.

Specialties: Cancer Diagnostics, Tissue Processes, Cassette Printing, Tissue Processing, Embedding, Section Management, Sectioning, Cryotomy, Microtomy, Microscope Slides, Staining, Coverslipping, Diagnosis and Archiving, Digital Pathology, Archiving, Storage, Standalone Consumables, Histology, Anatomical Pathology, Cytology, IHC, Immunohistochemistry, Pathology, and Histopathology

Project Scope

  • Historical data Archive from JDE(JPOR), JKAL, Dataflo  to Microsoft Azure Data Lake. 
  • 1000+ Objects to be Identified from JPOR, JKAL & DataFlo
  • Showcase Technical end-to-end Capability
  • 15 Enhanced Inquiry Screens configured to see data in Archive (appBuilder)
  • 150+ Data Archival Dashboard in Visualization (appVISULAIZE)
  • Lift & Shift Methodology

Business Situation

Business is planning to retire the existing system (JDE JKAL, JDE JPOR & Data Flow) and migrate to SAP S4/Hana. Epredia is migrating all Existing Open Transaction Data from legacy systems into S4 Hana. For Auditing/Reuse and regulatory compliance Purpose Epredia has planned to migrate all the Historical Data into Azure Cloud using Appconnect application before retiring the existing application. There are several reasons businesses like archiving data. Some need to retire the existing system and moving to other Application, some need to meet regulatory compliance, Others do it because it helps their business systems run more efficiently. Many companies are finding ways to repurpose or reuse existing data or Auditing, whatever your reasons, archiving your data can save resources like time, storage space, money, and Customer Data.

Technical Situation

Historical Data Migration will be done using ETL Tool(dataZap) which includes data extraction from JDE(Both JKAL and JPOR) as well Dataflo system and Data Loading into Azure Cloud MSSQL Database .Once the Data migrated to Azure Cloud ,then with the help of dataZense data are represented in graphical and table grid views for the end user reporting purpose. Smart BUILDER application is used to replicate the form as such in the source JDE system for the Business user to view the form for future reference.

Solutions

“Archiving the right data can not only save your business money, but also add value to your business.”  A data archive is a place to store data that is important but that doesn’t need to be accessed or modified frequently.  Data archiving is the task of identifying and moving data that is no longer actively used to a separate storage system for long-term retention. Archived data is typically information that is important to the organization or must be retained for legal reasons or for compliance with regulatory frameworks.

The solution proposed was dataZense (a cloud-based Data Archival solution) that runs on the ChainSys Smart Data Platform.  dataZense comes with prebuilt templates for all ERP applications, thereby reducing the effort and time involved in Data Loading. DataZense is based on Web-service based architecture and is fully configurable to suit the business needs.


Illustrations

Benefits

The implementation of Data Archiving was done in 8 weeks. Agile execution is enabled by the use of templates and a configurable and no programming approach to the solution process. Businesses that invest in proper data archiving strategies will not only achieve regulatory compliance, lower costs, and mitigate risks, but will also meet operational goals and achieve long-term viability.

Below some Key Benefits.

  • Archive all the Historical Data (850 million records) in 8 Weeks
  • Provide 200+Dashboard to Business to view historical data from the Azure cloud
  • Provide 15+ Application Inquiry screens to view the historical data same as the JDE View screens.
  • Can be able to download more than a million records in a single export


Reduced Costs:  Data is typically stored on low performance, high capacity with lower associated maintenance and operation costs.

Reduce Backups Windows: With continuous data growth, backup times are now stretching more hours. With a copy of your files in the archive, you can control your backup times as there is no need to backup old historical data.

Application Retirement:  Application retirement allows the application and the supporting hardware and software stack to be decommissioned. This eliminates recurring costs such as licensing, maintenance, and application administration costs, representing potential significant savings. Also noteworthy are the space savings and reduction of power consumption in the data center when applications are retired.

Improved Efficiency:  Most organizations are using their primary storage systems to store inactive data. As your system accumulates more data, it decreases the efficiency of the system. 

Archiving allows you to move infrequently needed data from your system, freeing up valuable primary storage space by off-loading unused data. With an effective archive strategy, organizations would be able to easily search for and access old data that continues to add value to the business over time and they can restore the same data whenever they need

Data Availability:  Legally, your business must retain certain documents for a set period.  Regulatory compliance in several industries - like finance, healthcare, and Services - will continue to drive changes in data retention. 

Data security: Data held in archive must be protected from loss, corruption, theft, and compromise. Archived data may need to be accessed by a wide variety of users. Data archiving solutions can simplify access requirements with role-based/User permissions that allow users to easily search and retrieve without intervention by IT teams. archiving Process limiting the chance of cyberattack or malware infection

Prevention of data loss: Archiving reduces the ability to modify data, preventing data loss

Products and Services Used

  • dataZap was used for Extract and Load the Historical Data into Azure Data Mart.
  • dataZense was used for Data Profiling, Transformation, Data Validation and Reconciliation
  • dataZense was used to provide the Dashboards to view the historical Data
  • dataZense was used to provide the Application screens same as the JDE screens
  • Smart appBuilder was used to create forms and reports like in JDE.

Reference


No items found.