Customized data analytics process for PDU

This is a high level overview of the journey that PDU and its members are likely to follow for Data Analytics.

Unique to Electric Distribution & Utilization

Ingest-to-store

  • Decisions that consumers make have a huge impact in aggregate
  • The network of intelligent devices is growing with different protocols and data formats, where the same event is measured in different ways
  • At ingestion, it is critical not to throw out any data

Cleanse & Data Prep

  • Data cleanse and prep takes a huge investment in time to curate and normalize. Expect information gaps in the data records
  • Time series is not a snapshot in time. It changes by day, week, month, and year
  • Need to determine how sensors are collecting information: constant monitoring or event based monitoring
  • Given the massive amounts of data, start with a portfolio of prototype projects that can be scaled up

Visualize-to-Analyze

  • Visualize the data to make it easier to see patterns, identify important variables and develop a plan for modeling
  • Select manageable analytic data sets to use for data modeling
  • Data at different resolutions and sampling may be a useful approach when the data is sparse
  • Build several analytic models to help characterize and understand end-use load profiles and extract insights

Find more information here.