# Data sourcing and compliance

> How Direct Dataset sources public data and handles personal information, with answers to the questions a procurement or legal review asks.
>
> Web page: https://directdataset.com/compliance

What a review team needs to know before approving a dataset: where the data comes from, how it is gathered, what personal information it contains and what is delivered with an order.

## How data is sourced

Direct Dataset is an independent provider of public data. Catalogue datasets are compiled from publicly available information: public records, published catalogues, advertised listings and published prices and reviews.

- Each dataset page names its source and carries a source and method statement.
- Each dataset page publishes its coverage, data dictionary and field definitions before purchase.
- Direct Dataset is not affiliated with, endorsed by or sponsored by the organisations or platforms whose public information its datasets describe.

The full process is on the [methodology](https://directdataset.com/methodology.md) page.

## Personal information

The datasets describe properties, products, prices and businesses. They are not built to profile individuals.

- Where a source publishes business contact details or public display names, the dataset page says so in its data dictionary.
- A version of any dataset without those fields can be delivered.

## Your use of the data

The licence in your quotation sets out what you may do with a dataset. You remain responsible for making sure your own use meets the laws and internal policies that apply to your organisation. If your review needs something specific in writing, ask before you order and it can be addressed in the quotation.

Licence types are summarised on the [licensing](https://directdataset.com/licensing.md) page.

## Due diligence questions

Where does the data come from?

From publicly available information: public records, published catalogues, advertised listings and published prices and reviews. Each dataset page names its source.

Is Direct Dataset affiliated with the sources?

No. Direct Dataset is an independent provider. It is not affiliated with, endorsed by or sponsored by the organisations or platforms whose public information its datasets describe.

How is the data gathered?

Each source is recorded on a schedule, then standardised into flat tables with stable identifiers. For sources that change daily, each change is kept as a dated event. The methodology page describes this in full.

Do the datasets contain personal information?

The datasets describe properties, products, prices and businesses. Some include business contact details that a business has published about itself, or public display names on reviews. The dataset page says so wherever that is the case, and a version without those fields can be delivered.

What documentation comes with an order?

A data dictionary, the record count for the agreed scope, the source and method statement and the definitions behind each field. The same information is published on the dataset page before purchase.

What licence terms apply?

The quotation states the licence. Internal use is standard. Research, publication and redistribution terms are summarised on the licensing page.

How are files delivered?

By a time-limited download link, as Parquet, CSV or SQLite. Parquet files load directly into Snowflake, BigQuery, Databricks, DuckDB and pandas.

Can we evaluate the data before buying?

Yes. A sample in the delivery format is available for every dataset, cut to the areas, categories or dates you want to test.

How do we know a figure is accurate?

Every count on this site is measured from the data. The quotation states the exact count for your scope, and a record count by period can be supplied so coverage can be reconciled against figures you already hold.

## Questions not answered here

Send your vendor questionnaire or your questions to [hello@directdataset.com](mailto:hello@directdataset.com?subject=Due%20diligence%20questions).

---

## All pages on this site, as Markdown

- [Home](https://directdataset.com/index.md): Direct Dataset is an independent provider of public data: documented, record-level datasets on property markets, retail prices and businesses.
- [Datasets](https://directdataset.com/datasets.md): The Direct Dataset catalogue: record-level datasets on property markets, retail prices and consumer products, each with coverage, data dictionary and method.
- [What teams do with the data](https://directdataset.com/use-cases.md): Worked examples of what research, analytics and pricing teams do with Direct Dataset data, each with real figures, the fields used and a sample query.
- [Findings from the data](https://directdataset.com/market-pulse.md): Market Pulse: short, dated findings from Direct Dataset data on property markets and retail prices, with figures and method. Free to quote with attribution.
- [Market statistics, free to quote](https://directdataset.com/statistics.md): Free market statistics from Direct Dataset: reference tables of prices and rents by area, category and brand, worked out from the full datasets. Free to quote.
- [Methodology](https://directdataset.com/methodology.md): How Direct Dataset collects, standardises, checks and documents its datasets: sources, updates, change history, standardisation and quality checks.
- [Licensing and delivery](https://directdataset.com/licensing.md): Licence terms for Direct Dataset data: internal use, research, publication and redistribution, with delivery formats, updates and how quotations work.
- [Data sourcing and compliance](https://directdataset.com/compliance.md): How Direct Dataset sources public data and handles personal information, with answers to the questions a procurement or legal review asks.
- [Cite the data](https://directdataset.com/cite.md): Citation formats and attribution wording for research papers, reports and news stories that use Direct Dataset data, with a citation for every dataset.
- [Custom data](https://directdataset.com/custom-data.md): Datasets collected to order by Direct Dataset: public information from a source you name, as a one-time file or a recurring delivery, with documentation.
- [About Direct Dataset](https://directdataset.com/about.md): Direct Dataset is an independent provider of public data. It gathers publicly available information and supplies it as documented, record-level datasets.
- [Contact](https://directdataset.com/contact.md): Contact Direct Dataset for a quotation, a sample file, a custom data brief or a press data request. All enquiries are handled by email.
- [Terms of use](https://directdataset.com/terms.md): Terms for using the Direct Dataset website. Dataset purchases are governed by the quotation and licence issued with each order.
- [Privacy](https://directdataset.com/privacy.md): How the Direct Dataset website handles personal information: no cookies, no tracking scripts and no forms. Enquiries are handled by email.
- [Dubai Property Sales Transactions](https://directdataset.com/datasets/dubai-property-sales-transactions.md): Record-level dataset of 1.36 million registered Dubai property sales from 1997 to today: price, size, property type, off-plan status and location.
- [Dubai Rental Contracts](https://directdataset.com/datasets/dubai-rental-contracts.md): Contract-level dataset of 8.8 million registered Dubai rental contracts from 2010 to today: rent, contract length, new lease or renewal, unit and location.
- [Retail Price History, US and Europe](https://directdataset.com/datasets/retail-price-history-us-europe.md): Daily lowest advertised prices for 7,063 consumer products in the US, UK, Germany, France, Spain and Italy: 4.1 million price points with the shop on each.
- [Sephora US Customer Reviews](https://directdataset.com/datasets/sephora-us-customer-reviews.md): 4.6 million Sephora US customer reviews since 2008 across 11,280 beauty products: rating, text, reviewer attributes, votes and brand replies.
- [Sephora US Product Catalogue and Price History](https://directdataset.com/datasets/sephora-us-product-catalogue.md): Sephora US product data: 11,682 products from 355 brands with prices, ratings, ingredient lists and categories, and a daily price history from February 2026.
- [Tesco UK Product Catalogue](https://directdataset.com/datasets/tesco-uk-product-catalogue.md): The full Tesco UK product catalogue: 864,749 products with prices, Clubcard offers, nutrition, ingredients, allergens and GTIN barcodes.
- [UAE Property Listings and Asking-Price History](https://directdataset.com/datasets/uae-property-listings-price-history.md): Daily record of UAE property listings on Bayut and Property Finder since June 2026: asking prices, dated price changes, delistings and time on market.
- [Dubai new-lease rents fell 8.6% in a year while renewal rents kept rising](https://directdataset.com/market-pulse/dubai-rental-market-october-2026.md): Dubai rents, October 2026: the median new apartment lease was AED 65,000, down 8.6% in a year like for like, while the median renewal rose to AED 60,000.
- [Dubai property prices and rents by area](https://directdataset.com/statistics/dubai-property-prices-and-rents-by-area.md): Dubai property statistics by area: typical sale prices, price per sq ft and yearly apartment rents by size, for the 40 busiest areas. Free to quote.
- [Skincare ingredient data from the Sephora US range](https://directdataset.com/use-cases/skincare-ingredient-data.md): Use Sephora US product data to analyse skincare ingredients: full ingredient lists for 2,328 products, with the share containing niacinamide and other actives.
- [Catalogue as JSON](https://directdataset.com/datasets.json)
- [Every page in one file](https://directdataset.com/llms-full.txt)
