Project Title: Scrape Local Climatological Data
We are conducting research on air pollution.
We would like spreadsheets (csv or excel) of daily weather information from NOAA’s local climatological data from January 1st, 2020, to the present. Link below.
The deliverable is all data from January 1st, 2020, to the present for all county location types.
For each county, this data can be extracted by clicking Location Type>County, a state, a specific county, and then selecting add to cart on all stations produced below.
The same procedure will need to be done for each county in the US.
Once all stations have been added to a cart, select the output “LCD CSV” and the date range 01-01-2020 to (present). Then press continue, enter an e-mail address, and submit the order to have the files sent to an e-mail address.
If possible, we would like you to send us one spreadsheet with all monitor files appended.
Please generate a variable for county and state in your looping procedure.
We understand that this data is not posted in a straightforward manner.
Various roadblocks or paywalls may come up.
As such, we are looking for an experienced web scraper with the skills necessary to handle these types of issues.
We’d be happy to work with you in adjusting the deliverable if anything comes up, and we’re open to you using any type of software you’re most comfortable with.
For similar work requirement feel free to email us on firstname.lastname@example.org.