SE2006:group bar:todo
Jump to navigation
Jump to search
- 5 data sources
- scrAPI:
- proper javadoc
- testing suite
- figure out group skipping
- to skip a group, put a '?' as the first character in that group, e.g., (?.+)
- see this awesome regexp tutorial (specific to Python but talks about Perl as a baseline too)
- exception handling
- (asserts, etc.)
- auto (periodic) fetching of data
- make ScrAPI run as a daemon?
- thread support (scrape multiple sources simultaneously)
- single place for var name to sql type - done
- database
- geocoding