Retail and consumer dataset

Retail Price History, US and Europe

The lowest advertised price on each day on record for 7,063 popular consumer products in six countries, with the shop offering it.

  • Warehouse-ready Parquet, CSV, SQLite
  • One row per product per day
4,126,261
daily price points
7,063
products
6
countries
60
product types

Overview

This dataset tracks what popular consumer products cost, day by day. For each of 7,063 products in six countries it gives the lowest advertised price on every day on record and the shop that offered it: 4,126,261 price points in total.

Daily resolution is the point. A weekly or monthly average hides the pattern that matters around a sale: a price that rises in October and returns to its earlier level in late November reads as a discount on the day. With one row per product per day, that pattern can be measured for every product and summarised by category and country.

The same structure in all six countries makes cross-country comparison direct: the same product types, the same fields, and prices in local currency.

Coverage

Price points 4,126,261 product-days, each with the lowest advertised price and the shop offering it
Products 7,063 products: United States 1,161, United Kingdom 1,163, Germany 1,178, France 1,195, Spain 1,171, Italy 1,195
Product types Up to 20 products per country in each of 60 product types, including televisions, audio, laptops, phones, tablets, cameras, smart home, kitchen appliances, vacuums, personal care, furniture, mattresses, large appliances and fitness
History From 2018 for the oldest UK products and from 2022 in the US. Most products have daily history from 2024 or 2025
Currencies USD, GBP or EUR, in the currency of the product country
Seasonal events Covers the Black Friday 2025 period for products with history from 2025 or earlier

Data dictionary

products / One row per product.
Field Description
country, productId Country and product identifier
category, categoryName Product type in English and the category as shown to shoppers
name, description Product name and description
currency USD, GBP or EUR
lowest_price, highest_price Range of the daily lowest price over the period on record
days_recorded, shops Number of days on record and number of shops that offered the product
first_recorded, last_recorded First and last day on record
daily_prices / One row per product per day.
Field Description
country, productId, day The product and the date
price Lowest advertised price that day, in the product currency
shop The shop offering that price

The full field list is sent with every sample.

Who uses it

  • Newsrooms and consumer organisations

    Testing whether sale prices are lower than the weeks before, with dated evidence for each product.

  • Economists and inflation research

    High-frequency price series for consumer durables, comparable across six countries.

  • Pricing and category teams

    Promotion depth, timing and the shops that lead price moves in a category.

  • Consultancies

    Evidence on discounting behaviour for retail strategy and competition work.

  • Academic research

    A product-level daily panel for work on price dispersion and promotional pricing.

Source and definitions

Source and method

Compiled by Direct Dataset from publicly available price history on a major price-comparison service. Direct Dataset is an independent data provider and is not affiliated with that service or with the shops named in the data.

Collection, standardisation and quality checks are described in the methodology.

Scope and definitions
  • Each price is the lowest advertised price for that day, from retailers and marketplace sellers, with the shop named.
  • The products table gives the first and last day on record for every product.
  • New editions are produced on request, with the products, categories and countries you choose.
  • The product list is a selection of popular products in each type and country.

Samples and licensing

Sample data

A sample file in the delivery format, with the full field list, is available on request. Write to hello@directdataset.com and say which areas, categories or dates you want to check.

Licensing and delivery
  • Quotation: scoped to the period, geography and fields you need.
  • Formats: Parquet, CSV, SQLite. Parquet files load directly into Snowflake, BigQuery, Databricks, DuckDB and pandas.
  • Updates: Supplied as an edition. New editions, products and countries on request.
  • Licence: internal use as standard. Research, publication and redistribution terms are on the licensing page.

Questions

Can other products, categories or countries be added?

Yes. Products, categories and countries can be collected to order, as a one-time history or as a recurring file.

Does it show the price at a specific retailer?

It shows the lowest advertised price each day and which shop offered it. It does not hold a separate series for every shop.

Can findings be published?

Yes. Aggregate findings, charts and individual product examples can be published with attribution. See the citation guidance.

How to cite

Direct Dataset. Retail Price History, US and Europe [dataset]. https://directdataset.com/datasets/retail-price-history-us-europe. Retrieved [date you received the data].

Guidance for publications and newsrooms is on the citation page. This page is also available as Markdown.

  • 11,682 products

    Sephora US Product Catalogue and Price History

    The Sephora US range as linked tables: 11,682 products from 355 brands with prices, ratings, ingredient lists and categories, and a dated price and rating record for every capture day since February 2026.

  • 4.63M reviews

    Sephora US Customer Reviews

    4.6 million customer reviews of 11,280 beauty products, from 2008 onwards, with rating, full text, reviewer-stated attributes and helpfulness votes.

  • 864,749 products

    Tesco UK Product Catalogue

    The full Tesco UK catalogue: 864,749 products with prices, Clubcard offers, nutrition, ingredients, allergens and barcodes, in linked tables.