Difference between revisions of "CS382:Scraper Recipes"
Jump to navigation
Jump to search
(→Getting ready) |
(→Pick a template) |
||
| (3 intermediate revisions by the same user not shown) | |||
| Line 4: | Line 4: | ||
bzr branch ~edlefma/mwscraper | bzr branch ~edlefma/mwscraper | ||
| − | == Pick a | + | == Pick a template == |
| − | Right now our templates are software.tt | + | Right now our templates are: |
| + | software.tt # software dependency page | ||
| + | geneds.tt # geneds req page | ||
| + | quizcrs.tt # crs and quiz questions page | ||
| + | scraper.tt # generates scraper's doc page | ||
| − | == Run & | + | == Run & check results == |
The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload: | The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload: | ||
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template> | ./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template> | ||
| − | == Run | + | == Run & upload changes == |
Now that we know we want to make this change, run again with --upload. | Now that we know we want to make this change, run again with --upload. | ||
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> --upload <template> | ./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> --upload <template> | ||
Latest revision as of 09:38, 10 April 2009
Contents
Scraper Recipes
Get the code
bzr branch ~edlefma/mwscraper
Pick a template
Right now our templates are:
software.tt # software dependency page geneds.tt # geneds req page quizcrs.tt # crs and quiz questions page scraper.tt # generates scraper's doc page
Run & check results
The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload:
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template>
Run & upload changes
Now that we know we want to make this change, run again with --upload.
./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> --upload <template>
