Friday, July 08, 2005

To Do List

Data pre-processing is an important job.

  1. Download data from the website (www.pjm.com) into a folder on desktop.
  2. Using FileInfo and Directory classes in C#, process all the csv filenames in the folder.
  3. Using the filenames in the above step, parse each file and extract a record satisfying the query (zone). A single record consists of the date and hourly prices for that day.
  4. Get the temperature archive of a chosen city from University of Dayton website.
  5. Categorize the dates into weekend, weekday, and national holiday as much as possible.

No comments: