CS382:Scraper Recipes
Jump to navigation
Jump to search
Contents
Scraper Recipes
Get the code
bzr branch ~edlefma/mwscraper
Pick a template
Right now our templates are:
software.tt # software dependency page geneds.tt # geneds req page quizcrs.tt # crs and quiz questions page scraper.tt # generates scraper's doc page
Run & check results
The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload:
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template>
Run & upload changes
Now that we know we want to make this change, run again with --upload.
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> --upload <template>