Difference between revisions of "SE2006:group bar:todo"

From Earlham CS Department
Jump to navigation Jump to search
Line 11: Line 11:
 
** exception handling
 
** exception handling
 
*** (asserts, etc.)
 
*** (asserts, etc.)
*** make ScrAPI run as a daemon?
 
** thread support (scrape multiple sources simultaneously)
 
 
  
 
** single place for var name to sql type - done
 
** single place for var name to sql type - done

Revision as of 19:28, 30 March 2006

  • 5 data sources
  • scrAPI:
    • testing suite - colin & alex
    • source stream - toby
    • Source Management -toby
      • Scheduler
      • sourceManager
      • sourceDefinition
    • proper javadoc
    • exception handling
      • (asserts, etc.)
    • single place for var name to sql type - done
    • figure out group skipping - done
      • to skip a group, put a '?' as the first character in that group, e.g., (?.+)
      • see this awesome regexp tutorial (specific to Python but talks about Perl as a baseline too)
  • database
  • geocoding