CS382:Scraper Recipes: Difference between revisions
Jump to navigation
Jump to search
New page: =Scraper Recipes= == Getting ready == # get the code. bzr branch ~edlefma/mwscraper |
|||
| (4 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
=Scraper Recipes= | =Scraper Recipes= | ||
== | == Get the code == | ||
bzr branch ~edlefma/mwscraper | bzr branch ~edlefma/mwscraper | ||
== Pick a template == | |||
Right now our templates are: | |||
software.tt # software dependency page | |||
geneds.tt # geneds req page | |||
quizcrs.tt # crs and quiz questions page | |||
scraper.tt # generates scraper's doc page | |||
== Run & check results == | |||
The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload: | |||
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template> | |||
== Run & upload changes == | |||
Now that we know we want to make this change, run again with --upload. | |||
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> --upload <template> | |||
Latest revision as of 14:38, 10 April 2009
Scraper Recipes
Get the code
bzr branch ~edlefma/mwscraper
Pick a template
Right now our templates are:
software.tt # software dependency page geneds.tt # geneds req page quizcrs.tt # crs and quiz questions page scraper.tt # generates scraper's doc page
Run & check results
The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload:
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template>
Run & upload changes
Now that we know we want to make this change, run again with --upload.
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> --upload <template>