Home > TradeEdge > Blogs > Prepare your data for demand planning: Your step-by-step data-transformation guide
Not all data is ready to give you insights. But it can be. In this blog post, we draw from our experience working with a global FMCG player to shed light on the processes that can power your data transformation.
To put simply, demand planning is the process of forecasting the demand of a product—which is then used to inform the manufacturing and distribution strategies of said product. Among retailers, demand planning is an integral part of supply chain management. Demand planning, when done well, has multi-fold benefits: It helps save money, manage product lifecycle better, improve marketing effectiveness, even heighten customer satisfaction.
But in today’s scale of operations, volume of data that is available, and the need for real-time insights, it is impossible to perform demand planning manually—over 54% of the companies surveyed in 2018 by the Sourcing Journal say that they frequently experience inventory imbalances. In fact, 13% say they do so ‘all the time’.
Technologies like artificial intelligence and machine learning can offer great value for demand planners, by crunching numbers meaningfully and at scale. It enables demand planners to work on real-time data and react to real-time market forces. But, given the maturity of AI tech today, it’s best to approach with caution.
In this blog post, we’ll outline the things to keep in mind while developing demand forecasting models for your AI engine.
The first step to building a demand forecasting model is to bring all your data to one place. Identify all data sources—explore all dimensions across geographies, channel partners, third party consolidators, products.
Once you’ve identified where you can source your data from, understand their tech maturity. Are all sources capturing data digitally? Even among digital data capture systems, there is a wide range from spreadsheets and emails to ERPs and CRMs. If your data is disparate, consolidate them. You might be able to leverage APIs and data pipes to achieve this.
Once you’ve collated your data, you need to make sure the information is standardized. Procurement officers surveyed in the 2019 CPO survey by Deloitte complain that “poor master data quality, standardization and governance are the biggest problems to master digital complexity”.
To standardize your data, you need to identify the variance in data formats and use a unifying taxonomy like the United Nations Standard Products and Services Code (UNSPSC), Harmonized System (HS) or Central Product Classification (CPC).
Once you have your data standardized, but before syncing them, perform a thorough master data validation. Perform data cleansing first—for both historical and real-time data—without this, analysis would be tedious and possibly inaccurate as well. Once the data is validated, map them to your product hierarchy.
Set up clear, actionable processes for your data sync. For instance, outline what level of data (geo, region, distributor, store) needs to be synced, at what frequency does data need to sync with the master data, how the data is to be transferred (AS2, sFTP, XML) etc.
Once your data is synchronized, probably in a data lake on the cloud, enable reporting. Identify what kind of reports are necessary and build corresponding dashboards. For instance, if you need a demand planning dashboard, identify all the data points you need extracted, and pull them into your dashboard. For instance, for one of our clients—a global FMCG player—we brought data points across retail execution, e-commerce, inventory, secondary sales etc. to build their demand planning dashboard.
Some products like TradeEdge Market Connect have built-in dashboard templates that you can customize instantly.
Once the first set of data is ready for reporting, go back to the drawing board and explore other sources you might collect data from. Onboard all your channel partners into your demand planning system—hire the right onboarding partner to achieve this at high-accuracy at scale.
If you have all bases covered, identify other data dimensions you may have missed. Or see if you can increase the frequency or data flow. Study if there are any external factors—like seasonal changes, competitor promotions etc.—that can have an impact on demand for your products; include data from there too.
Remember that your insights are only as good as your data. Gathering, cleaning and optimizing your data is an important part of improving your demand planning.
TradeEdge TeamMore blogs from TradeEdge Team >