CS382:Scraper Recipes

From Earlham CS Department
Revision as of 10:38, 10 April 2009 by Nate (talk | contribs) (→‎Pick a template)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Scraper Recipes

Get the code

bzr branch ~edlefma/mwscraper

Pick a template

Right now our templates are: 

software.tt # software dependency page
geneds.tt   # geneds req page
quizcrs.tt  # crs and quiz questions page
scraper.tt  # generates scraper's doc page

Run & check results

The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload: 

./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template>

Run & upload changes

Now that we know we want to make this change, run again with --upload. 

./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> --upload <template>
Retrieved from "https://wiki.cs.earlham.edu/index.php?title=CS382:Scraper_Recipes&oldid=9026"