SE2006:group bar:todo: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 11: | Line 11: | ||
** auto (periodic) fetching of data | ** auto (periodic) fetching of data | ||
*** make ScrAPI run as a daemon? | *** make ScrAPI run as a daemon? | ||
** thread support (scrape multiple sources simultaneously) | |||
** single place for var name to sql type - done | ** single place for var name to sql type - done | ||
* database | * database | ||
* geocoding | * geocoding | ||
Revision as of 14:27, 30 March 2006
- 5 data sources
- scrAPI:
- proper javadoc
- testing suite
- figure out group skipping
- to skip a group, put a '?' as the first character in that group, e.g., (?.+)
- see this awesome regexp tutorial (specific to Python but talks about Perl as a baseline too)
- exception handling
- (asserts, etc.)
- auto (periodic) fetching of data
- make ScrAPI run as a daemon?
- thread support (scrape multiple sources simultaneously)
- single place for var name to sql type - done
- database
- geocoding