Unique ID: 2015042

Division: Standards and Methods
Issue Date: February 13th 2019
Last modified: February 22nd 2019

Modernization of price collection and compilation with web and scanner data

Using web-scraping and scanner data for price collection and compilation

On-going pilot project on consumer prices searching opportunities for web scraping and scanner data usage.

Project Objective:

Exploration, Pilot intended to go to production to supplement existing data, Pilot intended to go to production to replace existing data

Project Outcomes:

Better information on price collection and a framework for the modernization of the future production.

Statistical Area


Project Sources
Project Sources
Type Of Institution: National statistical office
Big Data Source: Web scraping data, Scanner data
Region: Europe & Central Asia
Country Area: Finland
Id Country Regional: country
Data Providers: Intermediary Big Data provider
Other Partners: Other, Technology partner
Partnership Comments: Direct data providers in certain cases.
Accessing Data
Accessing Data
Data Access Rights: Only for this project
Data Access Comments: After the pilot phase, broader access rights will be negotiated.
Data Coverage
Data Coverage
Data Coverage: All available data
Coverage Geo Pop: Whole country / high % of market
Cost Implication: Free
Coverage Period: Previous month in question
Data Quality
Data Quality
Quality Aspects Evaluated: Privacy and Security, Completeness, Usability, Time Factors, Accessibility, Relevance, Validity, Accuracy, including selectivity, Coherence, including linkability to other sources
Quality Framework Comments: Not yet.
Methods Used: Traditional statistical methods, Supervised learning, Data visualization methods
Income Level: High-income
Iso: FI
Timeframe To Produce Indicator: NA
Write Your Own Review
You're reviewing:Modernization of price collection and compilation with web and scanner data
Your Rating