RMORIEDATA
data.rmorie.com

The tablesbehind the MORIE packages

Google BigQuery public datasets, the survey, court and justice data of the MORIE research ledger, the Health Infobase tables and the OTIS research files: each a fixed, documented copy checked against its SHA-256, opened from R or Python with no sign-in, and each kept under its source’s own licence.

1,634
Tables
183
Databases
0
Sign-ins needed
From the packages

One call per tablecached after the first pull

R · rmorie
x <- rmorie::morie_load_dataset(
  "chicago_crime/incidents")
rmorie::morie_hosted_datasets()
R · rmoriebricklayer
rmoriebricklayer::dload(
  "hacker_news/stories")
Shell · rmbl
rmbl data list
rmbl data pull nhtsa_fars/accidents
Python · morie
from morie.data import load_dataset
df = load_dataset("chicago_crime/incidents")
Shell · morie
morie pull chicago_crime/incidents --out x.csv
From anything else

The list is openthe tables come through the packages

Shell · every table: rows, columns, size, SHA-256, source
curl https://data.rmorie.com/manifest.json

Table files are served to the MORIE packages, which check each one against the SHA-256 in the manifest and resume a large one where it stopped. A browser that opens a table’s address gets a short note naming the packages instead of the file. The browse page queries the SQLite databases in this browser.

The fine print

Sources, versionslicences, what is kept

Sources

Every table names its source in the manifest, and each keeps its source’s own licence (Statistics Canada Open Licence, the Open Government Licences of Ontario and Canada, the BigQuery publishers’ terms). Cite the source the manifest names.

Fixed copies

Each table is a fixed copy, checked against the SHA-256 in the manifest, so a result reproduces. No project machine is in the request path.

Not served here

ICPSR studies, whose terms do not allow redistribution. Asking for one gives the address to get it from ICPSR.

What is kept

No register of users and no sign-in: only how often each table is downloaded, with no address, place or identifier. Nothing from the SQL you run here, which runs on your machine.

Fair use

Requests are rate limited per address so the service stays available to everyone.

Found by the packages

The packages read this address from the signed document at rmorie.com/.well-known/morie-services.json, so it can move without a release.