Sysadmin: Difference between revisions
Jump to navigation
Jump to search
| Line 153: | Line 153: | ||
{| style="float:left; margin-right:2px;" | {| style="float:left; margin-right:2px;" | ||
| style="height:55px; width: | | style="height:55px; width:175px; text-align:center; background-color:#0099cc; border-left:solid 5px #0099cc; border-top:solid 5px #0099cc; border-bottom:solid 1px white; border-right:solid 5px #0099cc; font-size:120%;" | SG538SF02J | ||
|- | |- | ||
| style="height:200px; width: | | style="height:200px; width:175px; background-color:#0099cc; border-left:solid 5px #0099cc; border-bottom:solid 5px #0099cc; border-right:solid 5px #0099cc; font-size:80%;" | | ||
*88 Gbps | *Model: HP Procurve 3400cl | ||
*64 million pps | *Ports: 24 | ||
Memory: | *Backplane bandwidth: | ||
*2MB packet buffer | **88 Gbps | ||
*16 MB dual flash | **64 million pps | ||
*128 MB SDRAM | *Memory: | ||
Cut-through switching: No | **2MB packet buffer | ||
Unused as of May 12, 2017 | **16 MB dual flash | ||
**128 MB SDRAM | |||
*Cut-through switching: No | |||
*Unused as of May 12, 2017 | |||
|} | |} | ||
{| style="float:left; margin-right:2px;" | {| style="float:left; margin-right:2px;" | ||
| style="height:55px; width: | | style="height:55px; width:175px; text-align:center; background-color:#ffdb4d; border-left:solid 5px #ffdb4d; border-top:solid 5px #ffdb4d; border-bottom:solid 1px white; border-right:solid 5px #ffdb4d; font-size:120%;" | CN63FP762S | ||
|- | |- | ||
| style="height:200px; width: | | style="height:200px; width:175px; background-color:#ffdb4d; border-left:solid 5px #ffdb4d; border-bottom:solid 5px #ffdb4d; border-right:solid 5px #ffdb4d;font-size:80%;" | | ||
*56 Gbps | *Model: HP 2530-24G | ||
*41.6 million pps | *Ports: 24 | ||
Memory: | *Switching Capacity: | ||
*1.5 MB packet buffer | **56 Gbps | ||
*256 MB flash | **41.6 million pps | ||
*128 MB DDR3 DIMM | *Memory: | ||
Cut-through switching: No | **1.5 MB packet buffer | ||
Connected to Al-Salam as of May 12, 2017 | **256 MB flash | ||
**128 MB DDR3 DIMM | |||
*Cut-through switching: No | |||
*Connected to Al-Salam as of May 12, 2017 | |||
|} | |} | ||
{| style="float:left; margin-right:2px;" | {| style="float:left; margin-right:2px;" | ||
| style="height:55px; width: | | style="height:55px; width:175px; text-align:center; background-color:#ff4d94; border-left:solid 5px #ff4d94; border-top:solid 5px #ff4d94; border-bottom:solid 1px white; border-right:solid 5px #ff4d94; font-size:120%;" | SG525SG025 | ||
|- | |- | ||
| style="height:200px; width: | | style="height:200px; width:175px; background-color:#ff4d94; border-left:solid 5px #ff4d94; border-bottom:solid 5px #ff4d94; border-right:solid 5px #ff4d94;font-size:80%;" | | ||
*88 Gbps | *Model: HP Procurve 3400cl | ||
*64 million pps | *Ports: 24 | ||
Memory: | *Backplane bandwidth: | ||
*2MB packet buffer | **88 Gbps | ||
*16 MB dual flash | **64 million pps | ||
*128 MB SDRAM | *Memory: | ||
Cut-through switching: No | **2MB packet buffer | ||
Connected to layout and whedon as of May 12, 2017 | **16 MB dual flash | ||
**128 MB SDRAM | |||
*Cut-through switching: No | |||
*Connected to layout and whedon as of May 12, 2017 | |||
|} | |} | ||
{| style="float:left; margin-right:2px;" | {| style="float:left; margin-right:2px;" | ||
| style="height:55px; width: | | style="height:55px; width:175px; text-align:center; background-color:#39ad39; border-left:solid 5px #39ad39; border-top:solid 5px #39ad39; border-bottom:solid 1px white; border-right:solid 5px #39ad39; font-size:120%;" | Netgear JGS524 | ||
|- | |- | ||
| style="height:200px; width: | | style="height:200px; width:175px; background-color:#39ad39; border-left:solid 5px #39ad39; border-bottom:solid 5px #39ad39; border-right:solid 5px #39ad39;font-size:80%;" | | ||
*48 Gbps | *Current cluster head-node | ||
*1.5 million pps | *Unmanaged (no console/configuration) | ||
Memory: | *Ports: 24 | ||
*2MB packet buffer | *Switching bandwidth: | ||
Cut-through switching: No | **48 Gbps | ||
Connected to Al-Salam, Hopper, Pollock, Nagios, Dali, Kahlo, Bronte as of May 12, 2017 | **1.5 million pps | ||
*Memory: | |||
**2MB packet buffer | |||
*Cut-through switching: No | |||
*Connected to Al-Salam, Hopper, Pollock, Nagios, Dali, Kahlo, Bronte as of May 12, 2017 | |||
|} | |} | ||
{| style="float:left; margin-right:2px;" | {| style="float:left; margin-right:2px;" | ||
| style="height:55px; width: | | style="height:55px; width:175px; text-align:center; background-color:#0099cc; border-left:solid 5px #0099cc; border-top:solid 5px #0099cc; border-bottom:solid 1px white; border-right:solid 5px #0099cc; font-size:120%;" | HP 5920 | ||
|- | |- | ||
| style="height:200px; width: | | style="height:200px; width:175px; background-color:#0099cc; border-left:solid 5px #0099cc; border-bottom:solid 5px #0099cc; border-right:solid 5px #0099cc;font-size:80%;" | | ||
*480 Gbps | *Ports: 24 | ||
*367 million pps | *Backplane bandwidth: | ||
Memory: | **480 Gbps | ||
*3.6 GB packet buffer | **367 million pps | ||
*256 MB dual flash | *Memory: | ||
*2 GB SDRAM | **3.6 GB packet buffer | ||
Cut-through switching: Yes | **256 MB dual flash | ||
Connected to layout, kahlo, and dali as of May 12, 2017 | **2 GB SDRAM | ||
*Cut-through switching: Yes | |||
*Connected to layout, kahlo, and dali as of May 12, 2017 | |||
|} | |} | ||
{| style="float:left; margin-right:2px;" | {| style="float:left; margin-right:2px;" | ||
| style="height:55px; width: | | style="height:55px; width:175px; text-align:center; background-color:#0099cc; border-left:solid 5px #0099cc; border-top:solid 5px #0099cc; border-bottom:solid 1px white; border-right:solid 5px #0099cc; font-size:120%;" | HP 5500 | ||
|- | |- | ||
| style="height:200px; width: | | style="height:200px; width:175px; background-color:#0099cc; border-left:solid 5px #0099cc; border-bottom:solid 5px #0099cc; border-right:solid 5px #0099cc;font-size:80%;" | | ||
*224 Gbps | *Model: JG542A | ||
*166.6 million pps | *Ports: 24 | ||
Memory: | *Backplane bandwidth: | ||
*6 MB packet buffer | **224 Gbps | ||
*512 MB dual flash | **166.6 million pps | ||
*1 GB SDRAM | *Memory: | ||
Cut-through switching: No | **6 MB packet buffer | ||
Connected to Babbage, Control, Nagios, and the netgear switch as of May 12, 2017 | **512 MB dual flash | ||
**1 GB SDRAM | |||
*Cut-through switching: No | |||
*Connected to Babbage, Control, Nagios, and the netgear switch as of May 12, 2017 | |||
|} | |} | ||
Revision as of 16:42, 13 May 2017
Machines and Brief Descriptions of Services
CS Machines
| HOME (vm0) |
| Users SSH NFS |
| NET (vm1) |
| LDAP server DNS DHCP |
| WEB (vm2) |
| Mailman Mail Stack Apache2 PostgresQL MySQL Wiki |
| TOOLS (vm3) |
| SageNB Server Jupyterhub Server Software Modules NginX |
| BABBAGE |
| Firewall |
| PROTO |
| Weather Monitoring GPS/NTP Energy Monitoring |
| CONTROL |
| Users SSH |
| SHINKEN |
| Users SSH Add machines |
| MURPHY |
| Users SSH |
Cluster Machines
| HOPPER |
| Users SSH NFS Software Modules PostgresQL Wiki Apache2 DNS DHCP |
| DALI |
| Gitlab Backups NginX |
| AL-SALAM |
| WebMO Software Modules Apache2 |
| LAYOUT |
| Jupyterhub Server Software Modules NginX Apache2 WebMO |
| BRONTE |
| Software Modules |
| POLLOCK |
| Software Modules WebMO NginX |
| KAHLO |
| Backups NginX |
| BIGFE |
| Software Modules |
| T-VOC |
| Software Modules |
| ELWOOD |
| Software Modules |
Switches
| SG538SF02J |
|
| CN63FP762S |
|
| SG525SG025 |
|
| Netgear JGS524 |
|
| HP 5920 |
|
| HP 5500 |
|
Systems Administration Documentation
For old documentation, see: Old Wiki Information
Services |
Current Projects (updated 2017-04-27)
TODO
- Layout infiniband subnet manager
- Layout disk swap, new lo0
- HP Al-Salam switch enable jumboframes
Ongoing Projects (Spring 2017)
TODO
- EMAILING ALL THE USERS https://wiki.cs.earlham.edu/index.php/Sysadmin:Old:Contacting_All_Users
- SHUTDOWN SCHEDULED FOR SUNDAY (APRIL 16)
- Check/update instructions - one version is at https://wiki.cs.earlham.edu/index.php/Sysadmin:ImportantInfo:PowerFailure, there are others too
- Notify users
- Fix certs for gitlab, etc.
- Secure 1-2 admins for the summer
- Prep layout for May-June usage
- Practice shutdown-startup procedure (with Michael)
- Nsswitch consistency across all machines
- Document tools: startup / shutdown - Charlie
- Use Sysadmin namespace for all our pages - All
- Testing usefulness of documentation - Dave
- Al Salam: configure switch, re-rack. - Vitalii
- HP switch should be reset and tested.
- LDAP cleanup of system users / old groups - James
- Layout - Nirdesh
- Lo0 RAID (mdadm)
- 10GB from Dali to lo0 (adding rules on compute node routing tables as a possible fix)
- BIOS reset
- 10Gb, perfsonar, ...
- Monitoring: (Ganglia, Shinken)
- Getting consistency among all the machines(check_nrpe regularly stops working).
- Whedon: configured and available
- Change passwords (on everything). Postgres, shenken, ...
- Webcam on office whiteboard (new office location?)
- Learn virtual machine architecture and modules - Dave
- Document in a format for future admin training?
- Find existing introduction material
- Mirror control for testing, swapping, etc.
DONE (19 Jan 2017)
- Examine extra "layout" node. - Adam
- Differences are: Single PSU, Single GPGPU, No VGA.
- It has Infiniband and 10GB cards installed.
- Networking - Adam, Charlie
- IP over Infiniband working on layout
- Resolved by resetting IB switch configuration:
ibwarn: [3349] mad_rpc_rmpp: _do_madrpc failed; dport (Lid 1)
- Resolved by resetting IB switch configuration:
- IP over Infiniband working on layout
FUTURE
- Centralized password database / manager / location
Current Projects (updated 13 Oct 16)
- Groups and LDAP and sudo - James
Amber - JamesEdward's setup - VitalliWebDev access - Nirdesh- Puppet - James and Vitalii
- Bacula - Nirdesh
- SSL certificate upgrade and documentation - Kristin
Listserv merging with archives preserved - Nirdesh- Ganglia - Bret
- Shenken - Vitalii
- latency, UPS
- New Layout node - ? and ?
- Provision Sappho (compute) - after Puppet
- Provision Kahlo (storage) -
- replace broken drive
- I2 setup
- DTN, storage nodes, head nodes, ports in CST
- Provision Whedon (compute) - after Puppet
- Shutdown and startup test - scheduled for Sunday 27 November
- Disk cleaning - Charlie
Password changing in the CS and cluster domains - Vitalii and James- Proto setup and maintenance with HIP/Green Science