International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 10 Issue: 08 | Aug 2023
www.irjet.net
p-ISSN: 2395-0072
Evaluation of Data Auditability, Traceability and Agility leveraging Data Vault Modeling in frequently changing Data ecosystem Sayan Guha1 Sr. Data Architect, AI & Analytics Practice, Cognizant Technology Solutions, West Bengal, India ---------------------------------------------------------------------***--------------------------------------------------------------------1.1 Motivation Abstract – Maintaining the data audibility and traceability in the frequently changing agile business driven data ecosystem has been the pain area for every organization. Designing the storage architecture of a business which frequently needs to change its business strategy and rules, requires the agility and flexibility of Data Vault design & data modeling techniques which can accommodate frequent changes to the design without having to do much programming changes on the underlying processing logic. This paper discusses, the critical role of Data Vault modeling to address scenarios where frequent changes a business rule has minimal impact on the spend & An evaluation of the data auditability and traceability have also been studied with the help of business scenario comparing with other modeling techniques where Data Vault modeling it was not in practice. Key Words: Data Vault modelling, Auditability, Data traceability, third normal form data modelling, dimensional data modelling, hash key, hash key difference, data warehouse, Raw Data Vault, Business Data Vault, SQL,
My motivation here to write this paper is to help the readers understand about the flexibility, robustness and agility Data Vault modeling technique has to offer. As opposed by tradition third normal form or dimensional data modeling techniques where the data design practitioners can address the frequent changes & history data requirements respectively, Data Vault modeling provides the best of both schools of thoughts and hence if it is chosen it comes up the flexibility of adapting to the changes of business rules which is often required to have a competitive edge in today’s business. All companies particularly often need to change the relationship between the business entities, get rid of them or add few more and the changes in relationships resulting many to many relationships established in the process between these entities. A Data Vault model duly designed not only addresses the same but also provides a benefit in complete data auditability and traceability in the process by leveraging a Data Vault modeling.
1.INTRODUCTION
1.2 Aim of this paper
In the current time, as we have observed the continuous changes to business strategy for most organizations remains the pain area because implementation of such frequent changes to the business data sources, business rules and relationships between the business entities requires a considerable spend on the IT infrastructure, its design and storage architecture modelling techniques and to ensure IT design & execution doesn’t become a bottleneck for seamless execution & adoption of Data Vault modelling in this context not only provides the required agility to the business but also empowers the organization of data governance through complete data auditability and traceability. In this paper, we will discuss a specific case study where agile business process of a subscription-based ecommerce business adopted data vault modelling technique to their benefit of agility We would try to evaluate how the changes in the business rules have minimal impact on the design architecture of the data model in the context using Data Vault modelling & how the data auditability and traceability .be maintained.
In this paper, I have aimed to discuss the specifics of business model of an Ecommerce Retailer based on a subscription-based business model as business scenario and sequential break-up of the business rules in terms of relationship between the customer & subscription. In this process, I will evaluate the Data Vault model suited for the purpose which will not undergo any change despite the changes in the business approach. In the end of the paper, I will share the evaluation metrics on how this approach have benefited on the data metrics e.g., auditability, traceability in scenarios when the data vault model has undergone changes.
© 2022, IRJET
|
Impact Factor value: 7.529
2. LITERATURE REVIEW A literature review was undertaken encompassing few academic and industry papers. This section reviews Data Vault as undertaken by organizations & addresses the key aspect of its agility and robustness. The evolution of data modeling methodologies in organizations along with the business scenario is listed in the below table.
|
ISO 9001:2008 Certified Journal
|
Page 805