Difference between revisions of "SE2006:group bar:todo"

From Earlham CS Department
Jump to navigation Jump to search
Line 2: Line 2:
  
 
* scrAPI:
 
* scrAPI:
 +
** testing suite - colin & alex
 +
** source stream  - toby
 +
** Source Management -toby
 +
***Scheduler
 +
***sourceManager
 +
***sourceDefinition
 
** proper javadoc
 
** proper javadoc
** testing suite
 
 
** exception handling
 
** exception handling
 
*** (asserts, etc.)
 
*** (asserts, etc.)
** auto (periodic) fetching of data
 
 
*** make ScrAPI run as a daemon?
 
*** make ScrAPI run as a daemon?
 
** thread support (scrape multiple sources simultaneously)
 
** thread support (scrape multiple sources simultaneously)
 +
 +
 
** single place for var name to sql type - done
 
** single place for var name to sql type - done
 
** figure out group skipping - done
 
** figure out group skipping - done

Revision as of 16:54, 30 March 2006

  • 5 data sources
  • scrAPI:
    • testing suite - colin & alex
    • source stream - toby
    • Source Management -toby
      • Scheduler
      • sourceManager
      • sourceDefinition
    • proper javadoc
    • exception handling
      • (asserts, etc.)
      • make ScrAPI run as a daemon?
    • thread support (scrape multiple sources simultaneously)


    • single place for var name to sql type - done
    • figure out group skipping - done
      • to skip a group, put a '?' as the first character in that group, e.g., (?.+)
      • see this awesome regexp tutorial (specific to Python but talks about Perl as a baseline too)
  • database
  • geocoding