From Earlham CS Department
Revision as of 11:23, 3 December 2011 by Twright09 (talk | contribs) (Project Tasks)
Jump to navigation Jump to search
  • Examining Trends in a Performance Sport
  • Data set: WCA Database
Project Tasks
  1. Identifying and downloading the target data set

The WCA Dataset was easily downloaded as a set of SQL inserts. The file can be downloaded from [| here].

  1. Data cleaning and pre-processing

The issue was that the .sql file was in MS-SQL or OracleSQL, so some mass modifications to the file had to be made. Primarily it was with changing smallint(n) to int, and `tablename` without the `.

  1. Load the data into your Postgres instance

It took a few times to get everything from the script all working, but the script was successfully run on my directory on BigFe.

  1. Develop queries to explore your ideas in the data
  2. Develop and document the model function you are exploring in the data
  3. Develop a visualization to show the model/patterns in the data
Tech Details
  • Node: as3
  • Path to storage space: /scratch/big-data/tristan
  • The visualization(s)
  • The story