SE2006:group bar:todo: Difference between revisions

From Earlham CS Department
Jump to navigation Jump to search
Lemanal (talk | contribs)
No edit summary
Lemanal (talk | contribs)
No edit summary
Line 11: Line 11:
** exception handling
** exception handling
*** (asserts, etc.)
*** (asserts, etc.)
*** make ScrAPI run as a daemon?
** thread support (scrape multiple sources simultaneously)


** single place for var name to sql type - done
** single place for var name to sql type - done

Revision as of 23:28, 30 March 2006

  • 5 data sources
  • scrAPI:
    • testing suite - colin & alex
    • source stream - toby
    • Source Management -toby
      • Scheduler
      • sourceManager
      • sourceDefinition
    • proper javadoc
    • exception handling
      • (asserts, etc.)
    • single place for var name to sql type - done
    • figure out group skipping - done
      • to skip a group, put a '?' as the first character in that group, e.g., (?.+)
      • see this awesome regexp tutorial (specific to Python but talks about Perl as a baseline too)
  • database
  • geocoding