Ask HN: Where can I find datasets of size greater than 1 GB?
I am looking for datasets of size greater than 1 GB for a graduate academic project.
Datasets which are publicly available (or available upon request) and contain location-data and/or vary over a period of time. Try http://academictorrents.com/
See also the comments in https://news.ycombinator.com/item?id=7149006 Historical weather would fit your description. The NOAA has a large collection going back a century or more from different weather stations. ftp://ftp.ncdc.noaa.gov/pub/data/ Openstreetmap? Not sure that is the sort of data you want. In the U.S., lots of states and the federal government also have extensive geographical data sets (so you mind find one with a theme you are more interested in). Look for the following: Census data Maybe wikipedia's data is available? Is there some open search engine, which gives its data free? There could be more but I'm tired and this will hopefully be of help. You can download Wikipedia data; with only articles, it's around 20gb. OpenCrawl has TBs worth of info.