Unique ID: 2015025

Division: Research Institute of Statistical Science
Issue Date: February 13th 2019
Last modified: February 22nd 2019
Collaborative

Using web scraping price data for price index of e-commerce

Using web scraping price data for price index of e-commerce

Crawling the particular cellphone price data by Crawler program and establishing the daily price index as a reference for the monthly price data.

Project Objective:

Exploration

Project Outcomes:

In the future, this project can be used to assess quality of the existing data and to expand data sources.

Statistical Area

Price

Project Sources
Project Sources
Type Of Institution: National statistical office
Big Data Source: Web scraping data
Region: East Asia & Pacific
Country Area: China
Id Country Regional: country
Accessing Data
Accessing Data
Data Access Rights: Only for this project
Data Coverage
Data Coverage
Data Coverage: Only a portion of all data
Coverage Geo Pop: Whole country / high % of market
Cost Implication: Free
Cost Comments: Self-developed.
Coverage Period: From March 2014 to September 2014
Data Quality
Data Quality
Quality Framework: Quality of source/input
Quality Aspects Evaluated: Privacy and Security, Completeness, Usability, Time Factors, Accessibility, Relevance, Institutional/Business Environment, Validity, Accuracy, including selectivity, Coherence, including linkability to other sources
Quality Framework Comments: Still evaluating and not applied yet.
Data Quality Concerns Comments: All figures are real transaction price data of suppliers.
Methodology
Methodology
Methods Used: Traditional statistical methods
Methods Comments: Using the data by current statistical methods
Technologies
Technologies
Technologies: Column store database, Spreadsheet
Technologies Comments: Develop small database to calculate data.
Other
Other
Income Level: Upper-middle-income
Iso: CN
Timeframe To Produce Indicator: NA
Write Your Own Review
You're reviewing:Using web scraping price data for price index of e-commerce
Your Rating