Data pre-processing is an important job.
- Download data from the website (www.pjm.com) into a folder on desktop.
- Using FileInfo and Directory classes in C#, process all the csv filenames in the folder.
- Using the filenames in the above step, parse each file and extract a record satisfying the query (zone). A single record consists of the date and hourly prices for that day.
- Get the temperature archive of a chosen city from University of Dayton website.
- Categorize the dates into weekend, weekday, and national holiday as much as possible.
No comments:
Post a Comment