|
|
(597 intermediate revisions by 20 users not shown) |
Line 1: |
Line 1: |
− | __NOTOC__
| + | This is the hub for the CS sysadmins on the wiki. |
| | | |
− | == Admins pages == | + | = Overview = |
− | * [[Sysadmin:Vitalli|Vitalli]]
| |
− | * [[Sysadmin:James|James]]
| |
− | * [[Sysadmin:Bret|Bret]]
| |
− | * [[Sysadmin:Eamon|Eamon]]
| |
− | * [[Sysadmin:Wislon|Wilson]]
| |
| | | |
− | == Sysadmin Responsibilities ==
| + | [https://docs.google.com/drawings/d/1XaULz5IxXV_BZQjrko3QJ8wV5aXsSTYcSWxxT49OyZk/edit If you're visually inclined, we have a colorful and easy-to-edit map of our servers here!] |
− | This is the basic list of tasks that Earlham CS system administrators are in charge of.
| |
| | | |
− | {| class="wikitable"
| + | == Server room == |
− | |-
| |
− | ! Responsibilities !! Wilson !! Eamon !! Vitalii !! James !! Bret
| |
− | |-
| |
− | | Install software on Debian (ACL) || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Install software on FreeBSD (servers) || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Make a CS user account || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || || ||
| |
− | |-
| |
− | | Change users CS password || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || || ||
| |
− | |-
| |
− | | Add DNS & DHCP entry || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || || ||
| |
− | |-
| |
− | | Being able to edit wiki || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Make a CS wiki account || || || || ||
| |
− | |-
| |
− | | Add people to different groups (ldap) || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || || ||
| |
− | |-
| |
− | | Modification and maintenance of Nagios || || || || ||
| |
− | |-
| |
− | | DD a new ACL image || || || || ||
| |
− | |-
| |
− | | Set up a new ACL || || || || ||
| |
− | |-
| |
− | | Shut down / start up of the entire machine room || || || || ||
| |
− | |-
| |
− | | Creating and configuring mailing lists (electron) || || || || ||
| |
− | |-
| |
− | | Admin list moderating || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || || ||
| |
− | |-
| |
− | | Backups and restore (bacula) || || || || ||
| |
− | |-
| |
− | | Create and configure jails || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || || ||
| |
− | |-
| |
− | | VMware || || || || ||
| |
− | |}
| |
| | | |
− | == Sysadmin basic Training ==
| + | Our servers are in Noyes, the science building that predates the CST. For general information about the server room and how to use it, check out [[Sysadmin:Server Room|this page]]. |
− | This is the list of skills that our System Administrators are trained during their orientation.
| |
| | | |
− | {| class="wikitable"
| + | Columns: machine name, IPs, type (virtual, metal), purpose, dies, cores, RAM |
− | |-
| |
− | ! Training Sections !! Wilson !! Eamon !! Vitalii !! James !! Bret
| |
− | |-
| |
− | | | ||
| |
− | |-
| |
− | | Wiki Editing || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div>
| |
− | |-
| |
− | | Installing operating systems (Debian and FreeBSD), including single-user mode || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Installing packages || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | *nix Filesystem layout || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Command line tools including I/O redirections and pipes || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | TCP, UDP and ICMP packets, including 3-way handshake || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Ports || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | DNS || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | DHCP || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Network debugging tools (tcpdump, ping, traceroute, netstat) || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Simple shell scripting || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || ||
| |
− | |-
| |
− | | Jails || <div style="text-align: center;"> [[File:StarIconBronze.png|20px]] </div> || || || ||
| |
− | |}
| |
| | | |
− | == Sysadmin 2014 to do list: == | + | == Compute Resources == |
| | | |
− | * () Spam Filter (CP, JR)
| + | [https://wiki.cs.earlham.edu/index.php/Sysadmin:Computer_Resources Machines and VMs related information here!] |
− | * () lockd install on electron (Jim)
| |
− | * () New proto
| |
| | | |
| + | == Network == |
| | | |
− | * (I) check hydra with Charlie
| + | We have two network fabrics linking the machines together. There are three subdomains. |
− | * (?) On ACLs login disappears after pressing cancel (Reported JR)
| |
| | | |
| + | === 10 Gb === |
| | | |
| + | We have 10Gb fabric to mount files over NFS. Machines with 10Gb support have an IP address in the class C range 10.10.10.0/24 and we want to add DNS to these addresses. |
| | | |
− | * () new-proto from the outside world
| + | === 1 Gb (cluster, cs) === |
− | * Getting rid of Quark <br />
| |
− | * ACL screensaver, leave only lightweight? (JR)
| |
− | * Removing mailman form quark <br />
| |
− | * Mailman Heather (not all of them accepted the changes electron to cs.earlham.edu) <br />
| |
− | * (W) Script for changing users password
| |
− | * (W) Script for changing and adding groups
| |
− | * (W) Brushing the add a user script
| |
− | * (W) Check machines chooser can choose from
| |
− | * (E) Script that will send an e-mail to all people
| |
− | * (E) Improve nagios settings
| |
− | * (W) Can we change Kristin Muterspaw CS username (from kmmuter11 to buzzlightyear)
| |
| | | |
− | ** Done
| + | We have two class C subnets on the 1Gb fabric: 159.28.22.0/24 (CS) and 159.28.23.0/24 (cluster). This means we have double the IP addresses on the 1Gb fabric that we have on the 10Gb fabric. |
− | * Wireshark should be run only be 410 students (Reported JR) (Fixed)
| |
− | * Re-imaging ENI machine (ACL21) <br />
| |
− | * () DNS troubles (Reported CP)
| |
− | * (I) fab lab list (HL)
| |
− | * (I) Hassan, SSH Trouble to Electron (Hassan, JR)
| |
| | | |
| + | Any user accessing *.cluster.earlham.edu and *.cs.earlham.edu is making calls on a 1Gb network. |
| | | |
| + | === Intra-cluster fabrics === |
| | | |
| + | The layout cluster has an Infiniband infrastructure. Wachowski has only a 1Gb infrastructure. |
| | | |
| + | == Power == |
| | | |
| + | We have a backup power supply, with batteries last upgraded in 2019 (?). We’ve had a few outages since then and power has held up well. |
| | | |
| + | == HVAC == |
| | | |
| + | HVAC systems are static and are largely managed by Facilities. |
| | | |
| + | [[Topology|See full topology diagrams here.]] |
| | | |
− | '''Documentation:'''
| + | [[Sysadmin:Layers of abstraction for filesystems|A word about what's happening between files and the drives they live on.]] |
| | | |
− | Wilson:
| + | = New sysadmins = |
− | * DNS & DHCP (done)
| |
− | * Sage (done)
| |
− | * Add User (done)
| |
− | * Password change (done)
| |
− | * Firewall
| |
− | * Add/change group (done)
| |
| | | |
| + | These pages will be helpful for you if you're just starting in the group: |
| | | |
− | Eamon:
| + | * [[Sysadmin:New Sysadmins | Welcoming a new sysadmin ]] |
− | * Cups | + | * [[Sysadmin:Troubleshooting|General troubleshooting tips for admins]] |
− | * PSCP | + | * [[Sandbox Notes|Sandbox Notes]] |
− | * PSSH (done) | + | * [[Password managers]] |
| + | * [[Server safety]] |
| + | * [https://code.cs.earlham.edu/sysadmin/ticket-tracker Ticket tracking for current projects] |
| | | |
− | Ivan
| + | Note: you'll need to log in with wiki credentials to see most Sysadmin pages. |
− | * Cloning ACL box
| |
| | | |
− | == Systems Administration Documentation == | + | = Additional information = |
| | | |
− | {|
| + | These pages contain a lot of the most important information about our systems and how we operate. |
− | |- valign="top"
| |
− | |
| |
− | <div style="border:10px solid #E3E0FA; padding:5px">
| |
− | <div style="background-color:#D7D1F8; padding:5px;">
| |
− | === Works in Progress ===
| |
− | </div>
| |
| | | |
− | * [[Sysadmin:todo13|To do before Fall 13 starts]]
| + | ===Handy Tools=== |
− | * [[Sysadmin:handbook|Handbook (WIP)]]
| + | * [http://monitor.cluster.earlham.edu:8088/packages Porter's Package Explorer] |
− | * [[Sysadmin:Temporary Page | Temporary Page for Wiki Adjustment]]
| |
− | * [[Sysadmin: Upgrading FreeBSD | Upgrading FreeBSD]]
| |
− | * [[Sysadmin:Fail2Ban on FreeBSD | Fail2Ban on FreeBSD]]
| |
− | * [[Sysadmin:Running Nessus | Running Nessus]]
| |
− | * [[Sysadmin:SrvcCheck|Things to check when things go down]] | |
− | * [[Sysadmin:AaronsHowTo| Aaron's How-To Pages]]
| |
− | * [[Sysadmin:Sonresources| Son's "Cook" Pages]]
| |
− | * [[Sysadmin:Installing ACLs]]
| |
| | | |
− | <!-- This has to stay as part of the formatting -->
| + | ===Technical docs=== |
− | </div>
| |
− | | style="width:50px;" |
| |
− | |
| |
− | <div style="border:10px solid #E0EAF8; padding:5px;">
| |
− | <div style="background-color:#CEDEF4; padding:5px;">
| |
| | | |
− | === Admin Tasks ===
| + | * [https://code.cs.earlham.edu/sysadmin/ticket-tracker Ticket tracking for current projects] |
− | </div>
| + | * [[Server safety]] |
| + | * [[Sysadmin:Backup|Backup]] |
| + | * [[Sysadmin:Monitoring | Monitoring ]] |
| + | * [[Sysadmin:SSH|SSH info relevant to admins]] |
| + | * [[Sysadmin:User Management | User Management]] and [[Sysadmin:LDAP|LDAP]] generally |
| + | * [[Sysadmin:Jupyterhub Notebook Server|Jupyterhub]] and [[Nbgrader notes|NBGrader]] |
| + | * [[Sysadmin:MailStack|Email service]] |
| + | * [[Sysadmin:XenDocs | Xen Server]] |
| + | * [[Sysadmin:NFS|Network File System (NFS)]] |
| + | * [[Sysadmin:Web Servers|Web Servers and Websites]] |
| + | * [[Sysadmin:Services:Databases|Databases]] |
| + | * [[Sysadmin:DNS & DHCP|DNS and DHCP]] |
| + | * [[Sysadmin:AWS|AWS]] |
| + | * [[Bash_start_up_script|Bash startup scripts]] |
| + | * [[Sysadmin:VirtualBox | VirtualBox]] |
| + | * [[X Applications]] |
| + | * [[Sysadmin:Services:ClusterOverview|Cluster Overview]] and [[Sysadmin:Ccg-admin|additional details]] |
| + | * [[Sysadmin:Firewall|Firewall]] running on babbage.cs.e.e |
| + | * [[Sysadmin:Setting_up_Lovelace_Lab_Machines|Setting up Lab Machines]] |
| | | |
− | * [[Sysadmin:NEWUser Management|NEW User Management]]
| + | ===Common tasks=== |
− | * [[Sysadmin: NEWcupssetup|NEW CUPS/Printer Adiministration]]
| + | * [[Sysadmin:Recurring Tasks | Recurring tasks - e.g. software updates, hardware replacements]] |
− | * [[Sysadmin: NEWAddComputer|NEW Add a computer]]
| |
− | * [[Sysadmin:NEWStart/Shutdown|NEW Shutdown/Start]]
| |
− | * [[Sysadmin:NEWMailman|NEW Mailman]]
| |
− | * [[Sysadmin:NEWNagios|NEW Nagios]]
| |
− | * [[Sysadmin:Backup|Backup]] (needs to be updated after new setup) | |
| * [[Sysadmin:Contacting all users|Contacting all users]] | | * [[Sysadmin:Contacting all users|Contacting all users]] |
− | * [[Sysadmin:New Sysadmins|Welcoming a new sysadmin to the fold]] | + | * [[Reset password]] |
− | * [[Sysadmin:RT Ticketing|RT Ticketing]] | + | * [[Sysadmin:Software installation | Software installation]] |
− | * [[Sysadmin:AddComputer|Add a computer]] | + | * [[Modules | Installing software under modules ]] |
− | | + | * [[Sysadmin:AddComputer|Add a computer to CS or cluster domains]] |
− | | + | * [[Senior projects|Supporting senior projects]] |
− | <!-- This has to stay as part of the formatting -->
| + | * [[ShutdownProcedure|How to do a planned shutdown and reboot of the system]] |
− | </div>
| + | ** [[Sysadmin:TestingServices | Testing services]] (after a reboot, upgrade, change in the phase of the moon, etc.) |
− | |}
| + | * [[Sysadmin:Upgrading SSL Certificate | Upgrading SSL Certificates ]] |
− | | + | * [[Sysadmin:Launch at startup|Launch a process at startup]] |
− | | + | * [[Sysadmin:Psql-setup | setup psql for cs430 students]] |
− | {|
| |
− | |- valign="top"
| |
− | |
| |
− | | |
− | <div style="border:10px solid #FFDFFF; padding:5px;">
| |
− | <div style="background-color:#FFCEFF; padding:5px;">
| |
− | | |
− | === Services ===
| |
− | </div>
| |
− | * [[Sysadmin:Services:Apache2|Apache2]] | |
− | * [[Sysadmin:Services:Databases|Databases]] | |
− | * [[Sysadmin:Services:DNS and DHCP|NEW DNS and DHCP]] | |
− | * [[Sysadmin:Services:Email|Email]]
| |
− | * [[Sysadmin:Services:LVM|LVM]]
| |
− | * [[Sysadmin:User Management|User Management]]
| |
− | * [[Sysadmin:positron|NFS]]
| |
− | * [[Sysadmin:Services:Printers|Printers]]
| |
− | * [[Sysadmin:services:Sage|NEW Sage]]
| |
− | * [[Sysadmin:Services:SystemImager|System Imager]]
| |
− | * [[Sysadmin:Services:TracSVN|Trac + svn]]
| |
− | * [[Sysadmin:Services:Virtualization | Virtualization]]
| |
− | * [[Sysadmin:Services:ZFS | ZFS]]
| |
− | * [[Sysadmin:Services:XenServerSetup | NEW New Xen Server]]
| |
− | | |
− | <!-- This has to stay as part of the formatting -->
| |
− | </div>
| |
− | | style="width:50px;" |
| |
− | |
| |
− | | |
− | <div style="border:10px solid #DBF0F7; padding:5px;">
| |
− | <div style="background-color:#C9EAF3; padding:5px;">
| |
− | | |
− | === Servers ===
| |
− | </div>
| |
− | * [[Sysadmin:PhysicalServers | Physical Servers]]
| |
− | * [[Sysadmin:VirtualServersAndJails | Virtual Servers and Jails]] | |
− | * [[Sysadmin:SvcChart|Service Chart]] | |
− | * [[Sysadmin:Monitoring|Monitoring]]
| |
− | * [[Sysadmin:Quark | Quark]]
| |
− | * [[Sysadmin:Forty-Two | Forty-two]]
| |
− | * [[Sysadmin:Lovelace | Lovelace]]
| |
− | * [[Sysadmin:Proto | Proto]]
| |
− | * [[Sysadmin:RetiredServers | Retired Servers]]
| |
− | | |
− | <!-- This has to stay as part of the formatting -->
| |
− | </div>
| |
− | | style="width:50px;" |
| |
− | |
| |
− | <div style="border:10px solid #FFFFC8; padding:5px;">
| |
− | <div style="background-color:#FFFFB5; padding:5px;">
| |
− | | |
− | === ACL Workstations ===
| |
− | </div>
| |
− | * [[Sysadmin:ACL:Installation|ACL Installation procedure]]
| |
− | * [[Sysadmin:AclImage|ACL Package Information]]
| |
− | * [[Sysadmin:Acl Locations|ACL Locations]]
| |
− | * [[Sysadmin:Software for Chemistry ACLs|Software for Chemistry ACLs]]
| |
− | * [[Sysadmin:ACL:UpProp|Proposed ACL Update policy]]
| |
− | * [[Sysadmin:ACL:ACLParallelCommands|NEW Run Command on all ACLS]]
| |
− | | |
− | | |
− | <!-- This has to stay as part of the formatting -->
| |
− | </div>
| |
− | |}
| |
− | | |
− | | |
− | {|
| |
− | |- valign="top"
| |
− | |
| |
− | <div style="border:10px solid #D6F8DE; padding:5px;">
| |
− | <div style="background-color:#BDF4CB; padding:5px;">
| |
− | | |
− | === Networking ===
| |
− | </div>
| |
− | * [[Sysadmin:Networking:NetworkLayout|Network Layout (as of 08/2006)]]
| |
− | * [[Sysadmin:Networking:D224 cable plant|D224 cable plant]] | |
− | * [[Sysadmin:Networking:Fiber plans|Fiber plans]]
| |
− | * [[Sysadmin:Networking:Switches|Switches]]
| |
− | * [[Sysadmin:Networking:Rack notes|Rack notes]]
| |
− | * [[Sysadmin:Networking:Public|Public Network]]
| |
− | * [[Sysadmin:Networking:NetworkTopo|Old Network Topo Figures]]
| |
− | * [[Sysadmin:Networking:NetworkDiagram|Network layout (May 2007)]]
| |
− | * [[Sysadmin:Networking:Alternate Network Path|Alt Network path]]
| |
− | * [[Sysadmin:UPS Setup]]
| |
− | | |
− | <!-- This has to stay as part of the formatting -->
| |
− | </div>
| |
− | | style="width:50px;" |
| |
− | |
| |
− | <div style="border:10px solid #F0DDD5; padding:5px;">
| |
− | <div style="background-color:#E4C0B1; padding:5px;">
| |
− | | |
− | === Miscellaneous ===
| |
− | </div>
| |
− | * [[SysadminContactInfo|Contact Information]]
| |
− | * [[Sysadmin:ImportantInfo:PhoneNumbers|Phone Numbers]]
| |
− | * [[Sysadmin:ImportantInfo:WebSites|Web Sites]]
| |
− | * [[Sysadmin:ImportantInfo:AuthenticationInfo|Authentication Information]]
| |
− | * [[Sysadmin:ImportantInfo:PowerFailure|Power Failure]]
| |
− | * [[Sysadmin:ImportantInfo:UPS|UPS]]
| |
− | * [[Sysadmin:ImportantInfo:SSLcerts|Generating SSL Certificates]]
| |
− | * [[Sysadmin:Power draws|Power draws]] | |
− | * [[Sysadmin:ImportantInfo:SunHardware|Working with Sun Hardware]]
| |
− | * [[Sysadmin:Passwords]]
| |
− | * Patching
| |
− | ** [[LinuxKernelPatching|Linux Kernel Patching]]
| |
− | ** [[FreeBSDKernelPatching|FreeBSD Kernel Patching]]
| |
− | * [[Sysadmin:SerialConsoleCableEnds|Cable Ends]] | |
− | * [[Sysadmin:VirtualizationComparison|NEW Virtualization Comparison]]
| |
− | | |
− | <!-- This has to stay as part of the formatting -->
| |
− | </div>
| |
− | |} | |
− | | |
− | === Old ===
| |
− | | |
− | Important Notes:
| |
− | * '''''ALL of the admin ''''' '''CVS/SVN stuff has been centralized to trac.cs.earlham.edu/admin'''. You'll need to create a username/password for yourself by running (from quark):
| |
− | :<code>htpasswd /usr/local/trac/adminontrac.htpasswd <username></code>
| |
− | * To check out the repository, run (from quark):
| |
− | :<code>svn checkout file:///clients/users/svn/admin</code>
| |
− | * [[Sysadmin:IRC|Chatting on IRC]]
| |
| | | |
− | '''Curent Sysadmins 2013:'''
| + | ===Group and institution information=== |
− | {| class="wikitable"
| + | * [[Sysadmin:CS-ITS Interoperability|Working with ITS]] |
− | |- | + | * [[Sysadmin:Recurring spending | Recurring spending ]] |
− | ! SysAdmin Name !! Year !! Working time !! Progress notes
| + | * [[Sysadmin:SlackAndGitLab | Slack and GitLab integration]] |
− | |- | |
− | | Wilson || SO || 100% || link to notes
| |
− | |-
| |
− | | Demise || SR || 100% || link to notes
| |
− | |-
| |
− | | Craig || FR || 100% || link to notes
| |
− | |-
| |
− | | Zane || SO || 100% || link to notes
| |
− | |-
| |
− | | Jordan || SO || 100% || link to notes
| |
− | |-
| |
− | | Sonny || JU || 100% || link to notes
| |
− | |-
| |
− | | Elena || SR || 40% || link to notes
| |
− | |-
| |
− | | Kristin || JU || 40% || link to notes
| |
− | |-
| |
− | | Aaron || SR || 20% || link to notes
| |
− | |-
| |
− | | Michael || SR || 0% || link to notes
| |
− | |} | |