degree of standardization of DQC. A proposal for a Dutch initiative for standardization of DQC for drinking water utilities is suggested as a possible follow-up of this
work. Such a task might require the development of a tool which could help
operatives with the task of daily time series analysis, IVS, regression, interpolation,
data smoothing, data aggregation and data correction.
5.2.1 Standardization
Defining when the quality of the data is good enough is case specific. Standardization can help to 1) understand common problems among utilities, 2) speak the same
language so that similar issues can be addressed across utilities, 3) apply the same
methods and 4) use the same tools. Challenges for which data standardization can
provide a solution including:
• Allowing integration of data that come from different sources, origins and
formats
• Automating data control and correction (support to automate processes) – less by
hand and subjective handling of data
• Allowing faster and better analysis and understanding of processes (more objective, reproducible and comparable results)
• Improving and facilitating reporting and compliance
• Reducing cost (and time) by providing certainty of units, protocols, event
types, etc.
• Allowing data sharing and implementation of hydroinformatics tools
• Facilitating interoperability of (IT) tools within a company and between
companies
• Allowing comparison within departments or companies, e.g. benchmarking
• Enhancing transparency and clarity about what can and cannot be done with data
Water companies can use as a starting point, relevant experiences of other sectors.
There are several standards which are relevant to the water sector, developed for
instance within Internet of Things (IoT) initiatives (using smart appliances) [90, 91]
or smart cities initiatives [92, 93]. Standardization within the water sector is a subject
that the European Commission [14] is very interested to achieve and promote, and
where different actions need to take place, but bottom-up action is also needed from
utilities.
Data Model
It is recommended to adopt and adapt a framework where different dimensions and
categories are clearly identified not only for the data content, data management, but
also for diverse users considered. Currently, data from the utilities are highly
variable in volume and resolution, format, metadata and shape. However, they all
measure the same types of variables. It would be very helpful to have a standard data
102
M. Castro-Gama et al.
work. Such a task might require the development of a tool which could help
operatives with the task of daily time series analysis, IVS, regression, interpolation,
data smoothing, data aggregation and data correction.
5.2.1 Standardization
Defining when the quality of the data is good enough is case specific. Standardization can help to 1) understand common problems among utilities, 2) speak the same
language so that similar issues can be addressed across utilities, 3) apply the same
methods and 4) use the same tools. Challenges for which data standardization can
provide a solution including:
• Allowing integration of data that come from different sources, origins and
formats
• Automating data control and correction (support to automate processes) – less by
hand and subjective handling of data
• Allowing faster and better analysis and understanding of processes (more objective, reproducible and comparable results)
• Improving and facilitating reporting and compliance
• Reducing cost (and time) by providing certainty of units, protocols, event
types, etc.
• Allowing data sharing and implementation of hydroinformatics tools
• Facilitating interoperability of (IT) tools within a company and between
companies
• Allowing comparison within departments or companies, e.g. benchmarking
• Enhancing transparency and clarity about what can and cannot be done with data
Water companies can use as a starting point, relevant experiences of other sectors.
There are several standards which are relevant to the water sector, developed for
instance within Internet of Things (IoT) initiatives (using smart appliances) [90, 91]
or smart cities initiatives [92, 93]. Standardization within the water sector is a subject
that the European Commission [14] is very interested to achieve and promote, and
where different actions need to take place, but bottom-up action is also needed from
utilities.
Data Model
It is recommended to adopt and adapt a framework where different dimensions and
categories are clearly identified not only for the data content, data management, but
also for diverse users considered. Currently, data from the utilities are highly
variable in volume and resolution, format, metadata and shape. However, they all
measure the same types of variables. It would be very helpful to have a standard data
102
M. Castro-Gama et al.