Difference between revisions of "Sysadmin"

From Earlham CS Department
Jump to navigation Jump to search
(Systems Administration Documentation)
 
(752 intermediate revisions by 28 users not shown)
Line 1: Line 1:
__NOTOC__
+
This is the hub for the CS sysadmins on the wiki.
== Systems Administration Documentation ==
 
  
 +
= Overview =
  
{|
+
[https://docs.google.com/drawings/d/1XaULz5IxXV_BZQjrko3QJ8wV5aXsSTYcSWxxT49OyZk/edit If you're visually inclined, we have a colorful and easy-to-edit map of our servers here!]
|- valign="top"
 
|
 
<div style="border:10px solid #E3E0FA; padding:5px">
 
<div style="background-color:#D7D1F8; padding:5px;">
 
=== Works in Progress ===
 
</div>
 
  
* [[Sysadmin:handbook|Handbook (WIP)]]
+
== Server room ==
* [[Sysadmin:Looking at DNS and DHCP|Looking at DNS and DHCP]]
 
* [[Sysadmin:Temporary Page | Temporary Page for Wiki Adjustment]]
 
* [[Sysadmin: Upgrading FreeBSD | Upgrading FreeBSD]]
 
* [[Sysadmin:Fail2Ban on FreeBSD | Fail2Ban on FreeBSD]]
 
* [[Sysadmin:Rebuilding the lovelace kernel | Rebuilding the Lovelace Kernel]]
 
* [[Sysadmin:UpdatingACLs|Procedure for updating ACLs]]
 
  
<!-- This has to stay as part of the formatting -->
+
Our servers are in Noyes, the science building that predates the CST. For general information about the server room and how to use it, check out [[Sysadmin:Server Room|this page]].
</div>
 
| style="width:50px;" |
 
|
 
<div style="border:10px solid #E0EAF8; padding:5px;">
 
<div style="background-color:#CEDEF4; padding:5px;">
 
  
=== Regular Stuff ===
+
Columns: machine name, IPs, type (virtual, metal), purpose, dies, cores, RAM
</div>
 
  
* [[Sysadmin:Backup|Backup]] (needs to be updated after new setup)
+
== Compute Resources ==
* [[Sysadmin:Contacting all users|Contacting all users]]
+
 
* [[Sysadmin:AddComputer|Add a computer]]
+
[https://wiki.cs.earlham.edu/index.php/Sysadmin:Computer_Resources Machines and VMs related information here!]
* [[Sysadmin:New Sysadmins|Welcoming a new sysadmin to the fold]]
+
 
 +
== Network ==
 +
 
 +
We have two network fabrics linking the machines together. There are three subdomains.
 +
 
 +
=== 10 Gb ===
 +
 
 +
We have 10Gb fabric to mount files over NFS. Machines with 10Gb support have an IP address in the class C range 10.10.10.0/24 and we want to add DNS to these addresses.
 +
 
 +
=== 1 Gb (cluster, cs) ===
 +
 
 +
We have two class C subnets on the 1Gb fabric: 159.28.22.0/24 (CS) and 159.28.23.0/24 (cluster). This means we have double the IP addresses on the 1Gb fabric that we have on the 10Gb fabric.
 +
 
 +
Any user accessing *.cluster.earlham.edu and *.cs.earlham.edu is making calls on a 1Gb network.
 +
 
 +
=== Intra-cluster fabrics ===
 +
 
 +
The layout cluster has an Infiniband infrastructure. Wachowski has only a 1Gb infrastructure.
 +
 
 +
== Power ==
 +
 
 +
We have a backup power supply, with batteries last upgraded in 2019 (?). We’ve had a few outages since then and power has held up well.
 +
 
 +
== HVAC ==
 +
 
 +
HVAC systems are static and are largely managed by Facilities.
  
<!-- This has to stay as part of the formatting -->
+
[[Topology|See full topology diagrams here.]]
</div>
 
|}
 
  
 +
[[Sysadmin:Layers of abstraction for filesystems|A word about what's happening between files and the drives they live on.]]
  
{|
+
= New sysadmins =
|- valign="top"
 
|
 
  
<div style="border:10px solid #FFDFFF; padding:5px;">
+
These pages will be helpful for you if you're just starting in the group:
<div style="background-color:#FFCEFF; padding:5px;">
 
=== Services ===
 
</div>
 
* [[Sysadmin:User Management|User Management]]
 
* [[Sysadmin:Services:Databases|Databases]]
 
* [[Sysadmin:Services:Email|Email]]
 
* [[Sysadmin:Services:Apache2|Apache2]]
 
* [[Sysadmin:Services:SystemImager|System Imager]]
 
* [[Sysadmin:Services:TracSVN|Trac + svn]]
 
* [[Sysadmin:Services:DNS and DHCP|DNS and DHCP]]
 
* [[Sysadmin:Services:Virtualization | Virtualization]]
 
* [[Sysadmin:Services:LVM|LVM]]
 
* [[Sysadmin:Services:Printers|Printers]]
 
  
<!-- This has to stay as part of the formatting -->
+
* [[Sysadmin:New Sysadmins | Welcoming a new sysadmin ]]
</div>
+
* [[Sysadmin:Troubleshooting|General troubleshooting tips for admins]]
| style="width:50px;" |
+
* [[Sandbox Notes|Sandbox Notes]]
|
+
* [[Password managers]]
 +
* [[Server safety]]
 +
* [https://code.cs.earlham.edu/sysadmin/ticket-tracker Ticket tracking for current projects]
  
<div style="border:10px solid #DBF0F7; padding:5px;">
+
Note: you'll need to log in with wiki credentials to see most Sysadmin pages.
<div style="background-color:#C9EAF3; padding:5px;">
 
  
=== Servers ===
+
= Additional information =
</div>
 
* [[Sysadmin:SvcChart|Service Chart]]
 
* [[Sysadmin:Quark | Quark]]
 
* [[Sysadmin:Forty-Two | Forty-two]]
 
* [[Sysadmin:Lovelace | Lovelace]]
 
* [[Sysadmin:Proto | Proto]]
 
* [[Sysadmin:RetiredServers | Retired Servers]]
 
  
<!-- This has to stay as part of the formatting -->
+
These pages contain a lot of the most important information about our systems and how we operate.
</div>
 
| style="width:50px;" |
 
|
 
<div style="border:10px solid #FFFFC8; padding:5px;">
 
<div style="background-color:#FFFFB5; padding:5px;">
 
=== ACL Workstations ===
 
</div>
 
* [[Sysadmin:ACL:Installation|ACL Installation procedure]]
 
* [[Sysadmin:AclImage|ACL Package Information]]
 
* [[Sysadmin:Acl Locations|ACL Locations]]
 
* [[Sysadmin:Software for Chemistry ACLs|Software for Chemistry ACLs]]
 
* [[Sysadmin:ACL:UpProp|Proposed ACL Update policy]]
 
  
<!-- This has to stay as part of the formatting -->
+
===Handy Tools===
</div>
+
* [http://monitor.cluster.earlham.edu:8088/packages Porter's Package Explorer]
|}
 
  
 +
===Technical docs===
  
{|
+
* [https://code.cs.earlham.edu/sysadmin/ticket-tracker Ticket tracking for current projects]
|- valign="top"
+
* [[Server safety]]
|
+
* [[Sysadmin:Backup|Backup]]
<div style="border:10px solid #D6F8DE; padding:5px;">
+
* [[Sysadmin:Monitoring | Monitoring ]]
<div style="background-color:#BDF4CB; padding:5px;">
+
* [[Sysadmin:SSH|SSH info relevant to admins]]
=== Networking ===
+
* [[Sysadmin:User Management | User Management]] and [[Sysadmin:LDAP|LDAP]] generally
</div>
+
* [[Sysadmin:Jupyterhub Notebook Server|Jupyterhub]] and [[Nbgrader notes|NBGrader]]
* [[Sysadmin:Nagios|Nagios]]
+
* [[Sysadmin:MailStack|Email service]]
* [[Sysadmin:Networking:NetworkLayout|Network Layout (as of 08/2006)]]
+
* [[Sysadmin:XenDocs | Xen Server]]
* [[Sysadmin:Networking:D224 cable plant|D224 cable plant]]
+
* [[Sysadmin:NFS|Network File System (NFS)]]
* [[Sysadmin:Networking:Fiber plans|Fiber plans]]
+
* [[Sysadmin:Web Servers|Web Servers and Websites]]
* [[Sysadmin:Networking:Machine_room|Machine room]]
+
* [[Sysadmin:Services:Databases|Databases]]
* [[Sysadmin:Networking:Rack notes|Rack notes]]
+
* [[Sysadmin:DNS & DHCP|DNS and DHCP]]
* [[Sysadmin:Networking:Public|Public Network]]
+
* [[Sysadmin:AWS|AWS]]
* [[Sysadmin:Networking:NetworkTopo|Old Network Topo Figures]]
+
* [[Bash_start_up_script|Bash startup scripts]]
* [[Sysadmin:Networking:NetworkDiagram|Network layout (May 2007)]]
+
* [[Sysadmin:VirtualBox | VirtualBox]]
* [[Sysadmin:Networking:Alternate Network Path|Alt Network path]]
+
* [[X Applications]]
* [[Sysadmin:Networking:Updating Proto's Timezone Rules| Timezone Rules on Proto]]
+
* [[Sysadmin:Services:ClusterOverview|Cluster Overview]] and [[Sysadmin:Ccg-admin|additional details]]
* [[Sysadmin:UPS Setup]]
+
* [[Sysadmin:Firewall|Firewall]] running on babbage.cs.e.e
 +
* [[Sysadmin:Setting_up_Lovelace_Lab_Machines|Setting up Lab Machines]]
  
<!-- This has to stay as part of the formatting -->
+
===Common tasks===
</div>
+
* [[Sysadmin:Recurring Tasks | Recurring tasks - e.g. software updates, hardware replacements]]
| style="width:50px;" |
+
* [[Sysadmin:Contacting all users|Contacting all users]]
|
+
* [[Reset password]]
<div style="border:10px solid #F0DDD5; padding:5px;">
+
* [[Sysadmin:Software installation | Software installation]]
<div style="background-color:#E4C0B1; padding:5px;">
+
* [[Modules | Installing software under modules ]]  
=== Miscellaneous ===
+
* [[Sysadmin:AddComputer|Add a computer to CS or cluster domains]]
</div>
+
* [[Senior projects|Supporting senior projects]]
* [[SysadminContactInfo|Contact Information]]
+
* [[ShutdownProcedure|How to do a planned shutdown and reboot of the system]]
* [[Sysadmin:ImportantInfo:PhoneNumbers|Phone Numbers]]
+
** [[Sysadmin:TestingServices | Testing services]] (after a reboot, upgrade, change in the phase of the moon, etc.)
* [[Sysadmin:ImportantInfo:WebSites|Web Sites]]
+
* [[Sysadmin:Upgrading SSL Certificate | Upgrading SSL Certificates ]]
* [[Sysadmin:ImportantInfo:AuthenticationInfo|Authentication Information]]
+
* [[Sysadmin:Launch at startup|Launch a process at startup]]
* [[Sysadmin:ImportantInfo:PowerFailure|Power Failure]]
+
* [[Sysadmin:Psql-setup | setup psql for cs430 students]]
* [[Sysadmin:ImportantInfo:UPS|UPS]]
 
* [[Sysadmin:ImportantInfo:SSLcerts|Generating SSL Certificates]]
 
* [[Sysadmin:Power draws|Power draws]]
 
* [[Sysadmin:ImportantInfo:SunHardware|Working with Sun Hardware]]
 
* [[Sysadmin:Passwords]]
 
* Patching
 
** [[LinuxKernelPatching|Linux Kernel Patching]]
 
** [[FreeBSDKernelPatching|FreeBSD Kernel Patching]]
 
* [[Sysadmin:SerialConsoleCableEnds|Cable Ends]]
 
  
<!-- This has to stay as part of the formatting -->
+
===Group and institution information===
</div>
+
* [[Sysadmin:CS-ITS Interoperability|Working with ITS]]
|}
+
* [[Sysadmin:Recurring spending | Recurring spending ]]
 +
* [[Sysadmin:SlackAndGitLab | Slack and GitLab integration]]

Latest revision as of 08:32, 20 March 2024

This is the hub for the CS sysadmins on the wiki.

Overview

If you're visually inclined, we have a colorful and easy-to-edit map of our servers here!

Server room

Our servers are in Noyes, the science building that predates the CST. For general information about the server room and how to use it, check out this page.

Columns: machine name, IPs, type (virtual, metal), purpose, dies, cores, RAM

Compute Resources

Machines and VMs related information here!

Network

We have two network fabrics linking the machines together. There are three subdomains.

10 Gb

We have 10Gb fabric to mount files over NFS. Machines with 10Gb support have an IP address in the class C range 10.10.10.0/24 and we want to add DNS to these addresses.

1 Gb (cluster, cs)

We have two class C subnets on the 1Gb fabric: 159.28.22.0/24 (CS) and 159.28.23.0/24 (cluster). This means we have double the IP addresses on the 1Gb fabric that we have on the 10Gb fabric.

Any user accessing *.cluster.earlham.edu and *.cs.earlham.edu is making calls on a 1Gb network.

Intra-cluster fabrics

The layout cluster has an Infiniband infrastructure. Wachowski has only a 1Gb infrastructure.

Power

We have a backup power supply, with batteries last upgraded in 2019 (?). We’ve had a few outages since then and power has held up well.

HVAC

HVAC systems are static and are largely managed by Facilities.

See full topology diagrams here.

A word about what's happening between files and the drives they live on.

New sysadmins

These pages will be helpful for you if you're just starting in the group:

Note: you'll need to log in with wiki credentials to see most Sysadmin pages.

Additional information

These pages contain a lot of the most important information about our systems and how we operate.

Handy Tools

Technical docs

Common tasks

Group and institution information