SE2006:group bar:todo: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 10: | Line 10: | ||
*** (asserts, etc.) | *** (asserts, etc.) | ||
** auto (periodic) fetching of data | ** auto (periodic) fetching of data | ||
*** make ScrAPI run as a daemon? | |||
** thread support (scrape multiple sources simultaneously) | ** thread support (scrape multiple sources simultaneously) | ||
* database | * database | ||
* geocoding | * geocoding | ||
Revision as of 05:02, 30 March 2006
- 5 data sources
- scrAPI:
- proper javadoc
- testing suite
- figure out group skipping
- to skip a group, put a '?' as the first character in that group, e.g., (?.+)
- see this awesome regexp tutorial (specific to Python but talks about Perl as a baseline too)
- single place for var name to sql type
- exception handling
- (asserts, etc.)
- auto (periodic) fetching of data
- make ScrAPI run as a daemon?
- thread support (scrape multiple sources simultaneously)
- database
- geocoding