←back to thread

Foursquare Open Source Places: A new foundational dataset

(simonwillison.net)
152 points po | 1 comments | 20 Nov 24 08:19 UTC | HN request time: 0.199s | source
Show context
Qem ◴[20 Nov 24 15:07 UTC] No.42194528[source]▶
It's a bit bothersome they nudge you to install and use aws tools to download the data, instead of providing a plain CSV or JSON downloadable dump instead.
replies(2): >>42196400 #>>42204843 #
1. simonw ◴[20 Nov 24 17:45 UTC] No.42196400[source]▶
It's S3 so this works to list the bucket contents:

    curl -s "https://fsq-os-places-us-east-1.s3.amazonaws.com/?list-type=2&prefix=release/dt=2024-11-19/places/parquet/&delimiter=/"
And you can download a file called places-00000.snappy.parquet like this:

    curl -O "https://fsq-os-places-us-east-1.s3.amazonaws.com/release/dt=2024-11-19/places/parquet/places-00000.snappy.parquet"