SE2006:group bar:todo: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 2: | Line 2: | ||
* scrAPI: | * scrAPI: | ||
** testing suite - colin & alex | |||
** source stream - toby | |||
** Source Management -toby | |||
***Scheduler | |||
***sourceManager | |||
***sourceDefinition | |||
** proper javadoc | ** proper javadoc | ||
** exception handling | ** exception handling | ||
*** (asserts, etc.) | *** (asserts, etc.) | ||
*** make ScrAPI run as a daemon? | *** make ScrAPI run as a daemon? | ||
** thread support (scrape multiple sources simultaneously) | ** thread support (scrape multiple sources simultaneously) | ||
** single place for var name to sql type - done | ** single place for var name to sql type - done | ||
** figure out group skipping - done | ** figure out group skipping - done | ||
Revision as of 21:54, 30 March 2006
- 5 data sources
- scrAPI:
- testing suite - colin & alex
- source stream - toby
- Source Management -toby
- Scheduler
- sourceManager
- sourceDefinition
- proper javadoc
- exception handling
- (asserts, etc.)
- make ScrAPI run as a daemon?
- thread support (scrape multiple sources simultaneously)
- single place for var name to sql type - done
- figure out group skipping - done
- to skip a group, put a '?' as the first character in that group, e.g., (?.+)
- see this awesome regexp tutorial (specific to Python but talks about Perl as a baseline too)
- database
- geocoding