Unique ID: 2015055

Division: DIQR Department
Issue Date: February 13th 2019
Last modified: February 22nd 2019
Collaborative

Use of Scanner Data for CPI

Use of Scanner Data for CPI

Use of scanner data provided by the largest supermarket chains for estimating the consumer price index. Scanner data should be integrated with survey data collected in the small outlets. Currently, ISTAT received two years of data for some provinces related to food and grocery products.

Project Objective:

Pilot intended to go to production to supplement existing data, Pilot intended to go to production to replace existing data

Project Outcomes:

Define a general approach for using scanner data to improve the quality of the Italian CPI.

Statistical Area

Price

Project Sources
Project Sources
Type Of Institution: National statistical office
Big Data Source: Scanner data
Region: Europe & Central Asia
Country Area: Italy
Id Country Regional: country
Partnerships
Partnerships
Other Partners: Other
Partnership Comments: Association of Modern Distribution (supermarket chains)
Accessing Data
Accessing Data
Data Access Rights: Only for this project
Intermediary Comments: In this initial phase an intermediary company prepares the data (formatting the data and imputation of missing values)
Data Coverage
Data Coverage
Data Coverage: Only a portion of all data
Coverage Geo Pop: Part of country / high % of market
Cost Implication: Commercial
Coverage Period: Two years
Project Details
Project Details
Frequency Comments: In this pilot, data referred to some types of products. The agreement foresees all available data, on a weekly basis.
Data Quality
Data Quality
Quality Framework: Quality of output statistics
Quality Aspects Evaluated: Privacy and Security, Completeness, Usability, Time Factors, Accessibility, Relevance, Institutional/Business Environment, Validity, Accuracy, including selectivity, Coherence, including linkability to other sources
Validation Comments: At the end of the project, the estimates using scanner data will be compared with the official CPI (food and grocery). Nevertheless, in case of discrepancies does not mean scanner data index is unreliable.
Quality Framework Comments: Eurostat is defining a quality framework.
Data Quality Concerns Comments: Outliers have been detected, but they seem to have a low impact. Currently, the intermediary company imputes the missing values.
Methodology
Methodology
Methods Used: Traditional statistical methods
Technologies
Technologies
Technologies: Relational database, Column store database, Data visualization tools
Other
Other
Income Level: High-income
Iso: IT
Timeframe To Produce Indicator: NA
Frequency Comments: In this pilot, data referred to some types of products. The agreement foresees all available data, on a weekly basis.
Write Your Own Review
You're reviewing:Use of Scanner Data for CPI
Your Rating