Friday, April 16, 2021

Whole to part panorama

 Any new initiative brings with it several bytes of data to start with. When we start with the goal to derive insights, evaluating the available raw data becomes the only activity for days. Fields stop making sense with relation to another if at all when we challenge it enough but often enables modeling with precision with regards to the context.

 It all began with a few spreadsheets with lots of related data from respective areas, the discovery activity started with all the enthusiasm and energy similar to past activities. When we dived deeper to build the whole picture we started to struggle in putting the individual parts together. It seemed more complex than we anticipated, after adding moving and rolling aspects to current key measures. The more we focused on deriving the key metrics, the more the data fought back. 

It was then a transformative journey where narrowing down from the goal backward for a change proved helpful. Adding in the variables and factors to account for precision along the way, moving ahead and backward in timelines, until it looked well enough to be stable. Few metrics that apparently did not look convincing enough proved useful in enhancing the accuracy of our insights. 

A data discovery journey is not without its fair share of hurdles, but it gets more exciting when we are able to create something more than what actually existed before and what we hoped to achieve. Overturning the conventional part to whole relationships and stereotypes it was an incredible satisfaction on being able to finish painting the final picture. 


Post a Comment

“Don't part with your illusions. When they are gone you may still exist, but you have ceased to live.” ~ Mark Twain