What We’ve Coated
All through the One Massive Cluster Caught collection we’ve explored impactful greatest practices to achieve management of your Cloudera Information platform (CDP) atmosphere and considerably enhance its well being and efficiency. We’ve shared code, dashboards, and instruments that can assist you in your well being enchancment journey. We’d like to offer one final device.
The Environmental Well being Scorecard
We observe atmosphere well being on the macro degree with a dashboard that mirrors our weblog collection methodology with a number of additions. We set quarterly OKR (Goals and Key Outcomes) targets to enhance our rating.
At decrease ranges of grain our measurements are data-driven and automatic, however on the macro degree we favor to use some subjectivity (after all our weightings will differ from yours as we’re on a distinct journey). Our knowledge and analytics leaders meet month-to-month to guage our well being enchancment and log subjective measures. Some could name that anecdotal proof however we worth the pairing of our data-driven evaluation with our observable actuality.
Platform Well being
All of it begins with platform well being which we selected to measure in 3 dimensions: {hardware} efficiency, companies efficiency, and optimum configuration/tuning. We supplied dozens of how-to manuals to acquire visibility and tune your atmosphere.
Is it shocking that we weighted platform well being solely an 8 on a 100 level scale? Our mannequin considers the period and useful resource dedication required to finish 80% of the journey, and since our platform optimization took just a few assets a number of months, we weighted it low. For those who’ve received a multiyear platform journey forward of you, you’ll weigh it extra closely.
NOTE: The Optimally configured quantity is only a rely of tunings we accomplished, and the chances are subjective evaluations.
Visibility and Transparency
Weighted a 20?! Yup. It’s that vital to us as now we have written. We selected separate measures for our personal jobs and our customers’ jobs. With 100% monitoring, alerting (notifications to DevOps), and notifications (to our prospects), why didn’t we earn a 20? As a result of we weren’t as proactive in resolving points as our OKR targets indicated we ought to be.
Information Democratization
Though we didn’t weblog about knowledge democratization, we discover it an vital measure of environmental well being. Each different measurement is meaningless if important knowledge parts are unavailable to choice makers. By the way, this measure is within the reverse seat of the see-saw because the others: ungoverned knowledge democratization is the one biggest explanation for all the issues we’re making an attempt to affect. Take into consideration that.
Information Course of Well being
Though we didn’t dedicate a weblog to this well being measure, we supplied quite a few directions to restore issues you discover. The objectives we selected within the dashboard are vital to us, however select these which are vital to you. The person scores are counts however the total well being rating isn’t a sum, it’s subjective. It is a multiyear journey.
Information Asset Standardization
This measure will get our highest weighting at 25 out of 100. The well being of the atmosphere is most depending on the belief that customers have within the knowledge. The higher your knowledge observability, and the higher the quantity that’s accessed through enterprise commonplace dashboards and governance-certified sources of fact, the higher the chance for belief. The belief develops by an understanding of the info as maintained by metadata in your Information Catalog: classification, lineage, forex, and enterprise context . You’ll be able to see that we did nice on report standardization however now we have longer to go to certify our enriched datasets and knowledge marts, and to repipe our customers’ belongings. One other multiyear journey.
Information High quality & Information Governance Extensibility
Like knowledge standardization this goes to the guts of trusted knowledge. We’ve 37 whole well being factors measuring knowledge trustworthiness. That will appear counterintuitive when utilized to an environmental “well being” measure, however that’s how we see it. You may even see these and different measures in a different way.
Better of Luck!
We smile on the chance that we would have enabled you to be extra environment friendly or succesful (or each!). Go to our Group Web page, our blogs, and Information and IT Leaders web page for a lot extra.
