Difference between revisions of "CS382:Scraper Recipes"

From Earlham CS Department
Jump to navigation Jump to search
(Run and upload changes)
(Pick a template)
 
(2 intermediate revisions by the same user not shown)
Line 4: Line 4:
 
  bzr branch ~edlefma/mwscraper
 
  bzr branch ~edlefma/mwscraper
  
== Pick a templte ==
+
== Pick a template ==
Right now our templates are software.tt, to generate a software dependency page, geneds.tt, and scraper.tt, which creates its own doc page.
+
Right now our templates are:
 +
software.tt # software dependency page
 +
geneds.tt   # geneds req page
 +
quizcrs.tt  # crs and quiz questions page
 +
scraper.tt # generates scraper's doc page
  
== Run & Check results ==
+
== Run & check results ==
 
The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload:
 
The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload:
 
  ./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template>
 
  ./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template>

Latest revision as of 09:38, 10 April 2009

Scraper Recipes

Get the code

bzr branch ~edlefma/mwscraper

Pick a template

Right now our templates are:

software.tt # software dependency page
geneds.tt   # geneds req page
quizcrs.tt  # crs and quiz questions page
scraper.tt  # generates scraper's doc page

Run & check results

The tool can either print its new wiki pages to STDOUT or upload them to the wiki. Check your results by running mwscraper without --upload:

./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> <template>

Run & upload changes

Now that we know we want to make this change, run again with --upload.

./mwscraper --host https://wiki.cs.earlham.edu --login --username <user> --password <pass> --upload <template>