-
-
-
-
URL copied!
“True happiness comes only by making others happy.” - David O. McKay
Background and Context
As in the quote above, a data platform can only be truly “happy” if it can make others happy. The others in this context are the actors/teams with whom the data platform interacts, including:
- Data Engineers
- Data Consumers
- Data Analysts
- Data Scientists/Machine Learning Engineers
- External Data Consumers like partners & data buyers
- DataOps Engineers
- Data Stewards & Admins (for Data Governance)
While Part I of this blog series covered the perspectives of Data Engineers and Data Consumers, in this second and final post you’ll find the perspectives of DataOps Engineers and Data Stewards & Admins.
Great (User) Expectations
Data Governance
End-to-end data governance encompasses aspects of Data Quality, Data Security and Data Compliance.
It also includes data cataloging, enabling us to discover the data and data lineage. This furthers our understanding of its origins, process, and journey to its current state.
Data stewards want to make sure that all the above aspects are taken care of by the data platform; that all of the data quality, security, and compliance requirements are converted into policies, controls and processes.
Overarching management processes, policies, and control are needed around aspects including the following:
- Defining the tags and tagging the data.
- Establishing communication and collaboration around the data and the data platform assets.
- Monitoring and managing the usage of these assets.
- Monitoring and managing the effectiveness and efficiency of these assets.
- Defining, monitoring, and managing policies and controls.
- Establishing a continuous improvement process of managing feedback/changes such as regulatory ones.
- Analysis and improvements across all the three dimensions of quality, security, and compliance.
- Implementing workflows to allow search and request for access to existing data assets, as well as requesting the availability of new data.
Enabling enterprise data governance has to be a step-by-step process, and it needs to start with defining MVP based on the specific needs and context. You can keep adding features based on specific priorities, rather than trying to do a “big bang” implementation covering everything all at once.
Data Ops
While DataOps might sound similar to DevOps for data projects, it is much more than that.
DevOps typically covers aspects such as software and services setup, environment provisioning, infrastructure as code, and continuous development, continuous testing, continuous integration, continuous deployment, continuous monitoring, etc.
While DevOps is involved as part of the DataOps, it is only a subset of the whole gamut of aspects that the SuperSet DataOps includes. The high-level objective of DataOps is to make sure that the appropriate data is available to the right consumers, at the right time.
DataOps covers an end-to-end, 360-degree aspect of orchestrating data and converting it into value. It is about enabling an ecosystem of technology, tools, processes, policies, and people to effectively and efficiently ingest, process, store, discover, and consume the data in a secured and compliant manner.
DataOps also involves enabling end users’ trust in the data assets made available to them (which encompasses the aspects covered in Part I of this series).
Accelerate Your Own Data Journey
The objective of a data platform is to eventually enable purposeful, actionable insights that can lead to business outcomes. Additionally, if the data platform puts the right emphasis on the journey and process (i.e., how it can make the job easier for its key actors while delivering the prioritized projects), then it will deliver an ecosystem that is fit for purpose, minimizes waste, and enables a “reuse” mindset.
At GlobalLogic, we are continuously improving our Data Platform Accelerator based on a similar approach. This digital accelerator enables enterprises to immediately manifest a solution that can gather, transform, and enrich data from across their organization. We are excited to work with our clients to accelerate their data journeys and would be happy to discuss your needs with you. Please get in touch using the contact form below.
Related Blogs - The Happy Data Platform - A Personified Perspective (Part I)
Top Insights
Manchester City Scores Big with GlobalLogic
AI and MLBig Data & AnalyticsCloudDigital TransformationExperience DesignMobilitySecurityMediaTwitter users urged to trigger SARs against energy...
Big Data & AnalyticsDigital TransformationInnovationRetail After COVID-19: How Innovation is Powering the...
Digital TransformationInsightsConsumer and RetailTop Authors
Top Insights Categories
Let’s Work Together
Related Content
Unlock the Power of the Intelligent Healthcare Ecosystem
Welcome to the future of healthcare The healthcare industry is on the cusp of a revolutionary transformation. As we move beyond digital connectivity and data integration, the next decade will be defined by the emergence of the Intelligent Healthcare Ecosystem. This is more than a technological shift—it's a fundamental change in how we deliver, experience, … Continue reading The Happy Data Platform: A Personified Perspective (Part II) →
Learn More
Leveraging SaMD Applications to Improve Patient Care and Reduce Costs
One of the most exciting developments in healthcare is the emergence of Software as a Medical Device (SaMD) as a more convenient and cost-effective means to deliver superior care to the tens of millions of people worldwide who suffer from various health conditions.
Learn More
View on payment industry modernisation: Drivers of change
The payment industry has been going through radical modernisation with multiple regulatory and infrastructure changes over the last five to ten years. The post-pandemic era has accelerated these efforts as consumer behaviour changed significantly during the COVID-19 outbreak. Consumers across the world expect real-time responses in all aspects of digital payment transactions and have adopted … Continue reading The Happy Data Platform: A Personified Perspective (Part II) →
Learn More
The Rise of The Invisible Bank
Banks will power experiences, but everyone will ignore them. Inspiration for this blog title comes from Jerry Neumann, the author of the blog Reaction Wheel, who wrote in 2015 that ‘software eats the world and everybody ignores it’. Neumann also observed that ‘information and communications technology becomes ubiquitous but invisible’ – in other words, … Continue reading The Happy Data Platform: A Personified Perspective (Part II) →
Learn More
GlobalLogic wins at the 2023 Analytics Institute Awards, Dublin
*This blog was updated on Friday 16th June. The team is excited to announce that GlobalLogic was named winners of the Emerging Technology Award at last night's Analytics Institute Awards! This prestigious award recognises organisations that have successfully employed new technologies such as IoT, Edge Computing, Machine Learning, or RPA. Our submission showcased the successful application of … Continue reading The Happy Data Platform: A Personified Perspective (Part II) →
Learn More
MLOps Principles Part Two: Model Bias and Fairness
Welcome back to the second instalment of our two-part series – MLOps (Machine Learning Operations) Principles. If you missed part one, which focused on the importance of model monitoring, it can be found here. This blog explores the various forms that model bias can take, whilst delving into the challenges of detecting and mitigating bias, … Continue reading The Happy Data Platform: A Personified Perspective (Part II) →
Learn More
Share this page:
-
-
-
-
URL copied!