Long recognized as a must in the data-driven world, data governance has never been easy for big and tiny organizations alike. Today, the complexities associated with adopting data governance best practices are greater than ever. Data, both structured and unstructured, is arriving in increasing volumes from proliferating sources to be stored and processed on multiple platforms. Points of integration are expanding, along with the number of regulatory mandates. Even small companies have to deal with dozens of undocumented data sources and data silos, not to mention poor data quality or the horror of identifying flat files floating around the network with sensitive data inside. In the background, the maturity of data governance initiatives has regressed. According to Quest’s regular of IT and line-of-business respondents, less than 15% of companies fully implemented a data governance program in 2020, which was half as many as reported in the previous research. Citing “understanding the right approach to data governance” as a major challenge, organizations are revisiting their strategies to check if they indeed follow best practices for data governance. survey In this article, we will examine how leading companies are mastering best practices for data governance to eliminate costs across their data ecosystem and harness for new sources of revenue. Dive in. powerful data analytics solutions What is data governance? Data governance is the practice of organizing processes, standards, and responsibilities to enable the company to know where its data is, how it is used, whether it is protected and how fully it meets data quality criteria (accuracy, completeness, reliability, relevance, and timeliness). It describes who can take what actions with what information, and when, under what circumstances, using what methods. By implementing best practices for data governance, organizations reduce privacy and security risks, improve response to regulatory requirements, and enable more advanced data analytics and . data science initiatives The goal of data governance is to manage data as a strategic asset. To ensure the success of the data governance program, it’s also important to understand what data governance is not: . While pursued as part of , data governance is only one — albeit a central — component of a data management strategy. The latter is an overarching term covering 10 knowledge domains, including , Data Modelling, Data Storage & Operation, Data Security & Privacy, Data Integration & Operability, Document Management, Master Data Management, and , and Metadata Management ( ). Data governance is not data management data management Data Architecture Data Warehousing BI discover more about data management strategies here . Similar to data governance best practices, MDM also plays a key role in ensuring users’ access to the same current and complete datasets, but MDM controls only master data, i.e., the organization’s key business data about customers, products, suppliers, locations, etc. Data governance is more than master data management (MDM) Metadata management centers around data catalogs that use metadata (data that describes data) to deliver a searchable inventory of the company’s data assets. Data cataloging was the main focus of data governance initiatives in their early days and continues to be marketed as the answer to data governance, but it is not. Data catalogs lack many essential data governance capabilities, like lineage tracing or data quality checks. Data governance is more than metadata management. Data governance is about how decisions are made and how people and processes are expected to behave in relation to data. Data stewardship is the hands-on execution of data governance initiatives on a day-to-day basis (read more below). Data governance is more than data stewardship. What are the key business drivers behind data governance? Following the adoption of the EU’s General Data Protection Regulation (GDPR) in 2016 and massive data breaches across sectors in 2018, security became a key motivator for organizations to adopt best practices for data governance. However, the focus has slightly shifted in recent years. According to data governance professionals participating in a , today’s investment in data governance is primarily driven by an effort to improve data quality (74%) and get faster insights from data analytics/BI (57%). In the released by ESG and Quest Software, 41% of respondents ranked data quality as the top driver for applying data governance best practices against 37% who cited “improving data security.” 2022 Zaloni survey 2022 State of Data Governance and Empowerment Report On the one hand, increasingly more organizations want to democratize access to quality data to drive better decisions. On the other hand, advances in have fueled interest in the revenue-generating potential of . This trend is particularly strong among customer-focused companies that are struggling to get new insights as fast as possible to remain competitive. machine learning solutions big data now successfully leveraged for business impacts How do leading organizations implement best practices for data governance? Data governance is a pain. This should be accepted from the start. There is one big problem that makes data governance extremely hard. Above all, it requires a mindset shift. Similar to DevOps implementation, people and processes come first. Tools come last. Introducing best practices for data governance takes a lot of effort because you need to instill rules and procedures around data access, consistency, and uptake of new data sources. This means holding a lot of meetings with stakeholders, rather than doing purely technical work. The second biggest challenge is finding an optimum balance. When promoting best practices for data governance, you need to give business users the right level of flexibility that will be enough for exploring data but not enough for messing things up. Regardless of how difficult, frustrating, or costly data governance is, it is something that any organization has to deal with eventually if it wants to become data driven. Drawing on ITRex’s extensive data experience, we’ve collected a few useful tips on how to get started with data governance best practices. Jump in. 1. Identifying the most painful problems for business The first step would be to do an assessment of the organization’s data governance readiness to discover the pain points that are holding the company back. You need to prioritize them and build a high-level plan to work around priority use cases. Companies at the beginning of their data governance journey usually hire an external consultant to do this job (drop us a line, if you need an experienced data consultant). For instance, you can even start building off from your CFO’s frustration over different financials they get for the same historic period every time they ask for them. Or the company’s painful problem can be an inefficient business process for discovering outdated transactions, or meaningless report generation, or siloed systems that lock important data away from users who need it quickly for forecasting patterns. Identifying the quick wins of introducing data governance best practices and setting specific benchmarks will give you a compass and help you with the next step (see below). 2. Getting buy-in Data governance has to start from the top to ensure role clarity and empowerment, so executive buy-in is key. This part will be hard because data governance is rarely perceived as a profit center. Just telling the C-suite that you want to improve data quality won’t be enough. You need a clearly defined business case built around the pain points identified in the first step. This case should promise value creation. Basically, you should link your data governance best practices initiative to either revenue lost due to bad data and resulting business errors or man hours spent (e.g., by data teams finding, curating, or enabling data). You can also cite the costly risk of regulatory non-compliance or increasing spending on data storage. Looking further ahead, you might also have a tough battle ahead of you fighting for buy-in from various departments. Your program might be labeled as red tape slowing down processes. Or you might have to deal with frustrated users demanding unrestricted access to everything that your policies won’t allow. Getting buy-in from across the organization is critical to your data governance initiative. So, polish your storytelling skills. 3. Defining roles Although each organization can set up its data governance structure differently, there are stakeholders that are most commonly involved: This is a centralized role primarily responsible for defining policies, standards, and rules around data governance best practices while making sure they are followed for all data projects. This role can be taken by a senior data master or by the chief information officer, who is often seen as a perfect fit. Chief Data Officer: This team is often set up within senior management and includes C-suite individuals. It steers the governance strategy with specific outcomes aligned with business needs, defines data domains, assigns leaders, approves funding for initiatives, and oversees the progress. Steering Committee: These are typically senior managers or departmental heads assigned to be responsible for a specific data domain in addition to their primary role. Their tasks range from approving data definitions to reviewing master data management activities, resolving data issues, and providing the steering committee with inputs. Data Owners: Their major responsibility is to attest to the quality of data by ensuring data is correctly cataloged, critical data elements are identified, data lineage is documented, datasets are prioritized by impact, and data quality standards are adhered to. They run quality checks, profile data sources, implement security and analytics updates, and sometimes act on behalf of data owners approving access requests. Data Stewards: A clear definition of roles and responsibilities is a fundamental part of best practices for data governance. If no one owns them, then no one will care about achieving the results. 4. Doing the heavy lifting Data governance is not a one-off project. It’s an ongoing program, and applying data governance best practices is a continuous, iterative process. This process involves complex technical activities, including: : These legislative-like activities focus on defining, enforcing, and reevaluating policies, procedures, standards, and the enterprise data architecture that will guide the organization into the future desired state. They span all stages of the data lifecycle, from data creation to acquisition, integrity, security, quality, and use. Setting and enforcing the rules For this, companies build both a business glossary and a data dictionary. A business glossary is a list of business terms with their definitions used in the day-to-day activities of the organization. It is compiled in cooperation with all business departments to ensure that everybody uses the same language. Data dictionaries comprise detailed definitions and descriptions of data itself, or metadata, which can be data type, size, default values, constraints, etc. Both are key to ensuring that the company makes decisions on the same data. Establishing a single source of truth: Fundamentally, data governance is not a problem that can be solved through technology, but it’s important to automate as much as possible to save time and resources. There are tools to support the process, including open-source solutions, which can help with data discovery, profiling, curation, classifying sensitive data, visualizing lineage, providing integrated business glossaries and data dictionaries, or generating data quality measurements. Selecting tools: To make the adoption of data governance best practices smooth and efficient, leading organizations also follow two strategies when designing their operating models: . This often means centralizing governance of technology, designing simple architecture, and keeping fewer dashboards and KPIs for easy focus and consistency. They also don’t over restrict data use, however tempting it may be. Creating an intricate web of permissions to give everyone access exactly to the data they require is confusing and delays business value. They keep systems as simple as possible . The goal is not only to display the value added by data governance best practices to counter resistance but also to make sure there is continuous improvement. Sample metrics can include contributions to business objectives, risk reduction, operational efficiencies, the use of relevant tools, or conformance to standards and procedures. They measure progress through metrics 5. Engaging users The success of the data governance program is a company-wide responsibility. It ultimately depends on how end-users are data aware, literate — and excited about data enablement. To make employees understand the value of quality data, leading organizations offer regular training. If a salesperson onboarding a client has to fill in dozens of table fields they don’t make sense of, why would they care about entering this data correctly? You need to educate users on the value of data governance best practices that is not always tangible to them. At the same time, you should also show how sticking to the rules can improve their personal and business results. Data governance leaders also use various incentives. Such interventions include rewards for sticking to data quality standards or demonstrating new use cases, along with a punishment for errors uncovered in a periodic audit. Set clear data governance processes and buy all users into them. Mastering data governance best practices is no easy fit, but your organization can succeed. Also published . here

Discovery

Funding

Project Management in Software Development: Key Questions Answered

The Costs and Considerations for Making a Fitness App

Bring us your challenge!

Read My Stories

Portfolio

Now Hiring

2021 - HackerNoon Contributor of the Year - TECH

2021 - HackerNoon Contributor of the Year - CONTINUOUS-INTEGRATION

2021 - HackerNoon Contributor of the Year - HEALTHCARE

Too Long; Didn't Read

Make resilience your competitive advantage

How to Get Started with Data Governance Best Practices

How to Get Started with Data Governance Best Practices

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Untitled Story

What is The True Price of Generative AI?

The Noonification: Feature Optimization for Price Prediction (11/26/2023)

10 Ways to Optimize Your Database

10 Essential Computer Skills for Data Mining

10 Most Evolving Big Data Technologies to Catch Up on in 2022

What is The True Price of Generative AI?

The Noonification: Feature Optimization for Price Prediction (11/26/2023)

10 Ways to Optimize Your Database

10 Essential Computer Skills for Data Mining

10 Most Evolving Big Data Technologies to Catch Up on in 2022

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps