|
|
|
To connect to the `h1digivideo3` IPMI port:
|
|
|
|
|
|
|
|
```
|
|
|
|
albert.einstein@opslogin0:~$ cd /ligo/home/jonathan.hanks/ipmi/
|
|
|
|
albert.einstein@opslogin0:/ligo/home/jonathan.hanks/ipmi$ ls
|
|
|
|
SMCIPMITool SMCIPMITool_2.23.0_build.191216_bundleJRE_Linux_x64 smc_stuff.tar
|
|
|
|
albert.einstein@opslogin0:/ligo/home/jonathan.hanks/ipmi$ ./SMCIPMITool h1digivideo3-mgmt ADMIN ADMIN ukvm
|
|
|
|
Starting iKVM Process...Done
|
|
|
|
Please wait for iKVM window
|
|
|
|
```
|
|
|
|
|
|
|
|
**Setup**
|
|
|
|
|
|
|
|
1. Remove `h1digivideo3` from Puppet control:
|
|
|
|
|
|
|
|
```
|
|
|
|
albert.einstein@opslogin0:~$ ssh cdsmanager
|
|
|
|
albert.einstein@cdsmanager:~$ ssh root@cdspuppet
|
|
|
|
root@cdspuppet:~# ./clean-node.sh h1digivideo3.cds.ligo-wa.caltech.edu
|
|
|
|
```
|
|
|
|
|
|
|
|
2. Reboot `h1digivideo3` and install the OS using PXE:
|
|
|
|
|
|
|
|
Hit F11 to get the boot menu. Select network boot (IBA GE Slot).
|
|
|
|
|
|
|
|
```
|
|
|
|
There are two 256 GB SSDs installed.
|
|
|
|
Select the primary network interface.
|
|
|
|
Select 'Debian Package Bullseye Preseed'.
|
|
|
|
Use the password from https://secrets.ligo.org/secrets/355/
|
|
|
|
Select 'manual' for the disk partitioning method.
|
|
|
|
Set the partition on RAID1 device #0 to Format, ext4, /boot
|
|
|
|
Set the partition on RAID1 device #1 to Format, ext4, /
|
|
|
|
Install Grub on '/dev/sda'.
|
|
|
|
```
|
|
|
|
|
|
|
|
3. Put `h1digivideo3` back under Puppet control:
|
|
|
|
|
|
|
|
_Terminal 1_
|
|
|
|
```
|
|
|
|
albert.einstein@opslogin0:~$ ssh cdsmanager
|
|
|
|
albert.einstein@cdsmanager:~$ ssh root@h1digivideo3
|
|
|
|
root@h1digivideo3:~# puppet agent --fingerprint
|
|
|
|
```
|
|
|
|
|
|
|
|
_Terminal 2_
|
|
|
|
```
|
|
|
|
albert.einstein@opslogin0:~$ ssh cdsmanager
|
|
|
|
albert.einstein@cdsmanager:~$ ssh root@cdspuppet
|
|
|
|
root@cdspuppet:~# puppetserver ca list
|
|
|
|
```
|
|
|
|
|
|
|
|
Check that the SHA256 checksum for the requested certificate matches the one given by the last command in Terminal 1. If it matches then sign the certificate:
|
|
|
|
|
|
|
|
_Terminal 2_
|
|
|
|
```
|
|
|
|
root@cdspuppet:~# puppetserver ca sign --certname h1digivideo3.cds.ligo-wa.caltech.edu
|
|
|
|
```
|
|
|
|
|
|
|
|
4. Update the configuration from Puppet:
|
|
|
|
|
|
|
|
_Terminal 1_
|
|
|
|
```
|
|
|
|
root@h1digivideo3:~# puppet agent --test --verbose
|
|
|
|
```
|
|
|
|
|
|
|
|
5. Configure the network interface:
|
|
|
|
|
|
|
|
In the IPMI interface:
|
|
|
|
|
|
|
|
- `root@h1digivideo3:/etc/network# ifdown eno1`
|
|
|
|
- Change the `/etc/network/interfaces` file to bond eno1 and eno2
|
|
|
|
|
|
|
|
```
|
|
|
|
root@h1digivideo3:/etc/network# cat interfaces
|
|
|
|
# This file describes the network interfaces available on your system
|
|
|
|
# and how to activate them. For more information, see interfaces(5).
|
|
|
|
|
|
|
|
source interfaces.d/machine-dependent
|
|
|
|
source-directory interfaces.d
|
|
|
|
|
|
|
|
# The loopback network interface
|
|
|
|
auto lo
|
|
|
|
iface lo inet loopback
|
|
|
|
|
|
|
|
# The primary network interface
|
|
|
|
#allow-hotplug eno1
|
|
|
|
#iface eno1 inet dhcp
|
|
|
|
# This is an autoconfigured IPv6 interface
|
|
|
|
#iface eno1 inet6 auto
|
|
|
|
|
|
|
|
#auto eno1
|
|
|
|
#iface eno1 inet static
|
|
|
|
# address 10.106.0.13
|
|
|
|
# netmask 255.255.255.0
|
|
|
|
# gateway 10.106.0.1
|
|
|
|
# dns-search cds.ligo-wa.caltech.edu
|
|
|
|
# dns-nameservers 10.20.0.20 10.20.0.21
|
|
|
|
|
|
|
|
auto eno1
|
|
|
|
iface eno1 inet manual
|
|
|
|
bond-master bond0
|
|
|
|
|
|
|
|
auto eno2
|
|
|
|
iface eno2 inet manual
|
|
|
|
bond-master bond0
|
|
|
|
|
|
|
|
# Bonded network interface
|
|
|
|
auto bond0
|
|
|
|
iface bond0 inet static
|
|
|
|
mtu 9000
|
|
|
|
address 10.106.0.13
|
|
|
|
netmask 255.255.255.0
|
|
|
|
gateway 10.106.0.1
|
|
|
|
# LACP configuration
|
|
|
|
bond-mode 802.3ad
|
|
|
|
bond-miimon 100
|
|
|
|
bond-lacp-rate 1
|
|
|
|
bond-slaves none
|
|
|
|
# dns
|
|
|
|
dns-search cds.ligo-wa.caltech.edu
|
|
|
|
dns-nameservers 10.20.0.20 10.20.0.21
|
|
|
|
```
|
|
|
|
|
|
|
|
- `root@h1digivideo3:/etc/network# ifup eno1`
|
|
|
|
|
|
|
|
- `root@h1digivideo3:/etc/network# ifup eno2`
|
|
|
|
|
|
|
|
6. Run the Pylon configuration program.
|
|
|
|
|
|
|
|
`root@h1digivideo3:/opt/pylon/bin# ./PylonGigEConfigurator auto-opt`
|
|
|
|
|
|
|
|
Example output:
|
|
|
|
```
|
|
|
|
******************************************************************
|
|
|
|
* PylonGigEConfigurator 1.0.0.0 - Copyright (c) 2022 Basler AG *
|
|
|
|
******************************************************************
|
|
|
|
Optimizes system and network settings for Basler GigE cameras.
|
|
|
|
Note: Before using this tool, make sure only cameras are connected to your network adapter(s).
|
|
|
|
|
|
|
|
|
|
|
|
Assigning temporary IP address 192.168.3.2 to adapter "eno1" to allow camera discovery.
|
|
|
|
nm_client_activate_connection_finish() failed with message 'Connection '0C-C4-7A-4B-28-96' is not available on device eno1 because device is strictly unmanaged'.
|
|
|
|
Assigning temporary IP address 192.168.4.2 to adapter "eno2" to allow camera discovery.
|
|
|
|
nm_client_activate_connection_finish() failed with message 'Connection '0C-C4-7A-4B-28-96' is not available on device eno2 because device is strictly unmanaged'.
|
|
|
|
Auto configuration is looking for network adapters and cameras ...
|
|
|
|
Problems occurred discovering devices on adapter eno1 (e1000006):Invalid Parameter.
|
|
|
|
Problems occurred discovering devices on adapter eno2 (e1000006):Invalid Parameter.
|
|
|
|
Adapter "eno1" (192.168.3.2) (82574L Gigabit Network Connection) has no camera attached. Excluding adapter from optimization.
|
|
|
|
Adapter "eno2" (192.168.4.2) (82574L Gigabit Network Connection) has no camera attached. Excluding adapter from optimization.
|
|
|
|
Adapter "bond0" (10.106.0.13):
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:95:AF)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:BE:79)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E3:2F)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E3:31)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:90)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:91)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:92)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:95)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:9B)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:9F)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:A5)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:A6)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:A8)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:A9)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:AB)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:B4)
|
|
|
|
Found device: Basler acA640-100gm (00:30:53:12:E4:B9)
|
|
|
|
Found device: Basler acA640-120gm (00:30:53:16:3F:E1)
|
|
|
|
Found device: Basler acA640-120gm (00:30:53:16:3F:E3)
|
|
|
|
Found device: Basler acA640-120gm (00:30:53:16:3F:E8)
|
|
|
|
Found device: Basler acA640-120gm (00:30:53:16:3F:EB)
|
|
|
|
Found device: Basler acA640-120gm (00:30:53:16:3F:EC)
|
|
|
|
Found device: Basler acA640-120gm (00:30:53:17:CE:74)
|
|
|
|
Found device: Basler acA640-90gm (00:30:53:22:94:9F)
|
|
|
|
Found device: Basler acA640-90gm (00:30:53:22:94:A0)
|
|
|
|
Found device: Basler acA640-90gm (00:30:53:22:94:A3)
|
|
|
|
Found device: Basler acA720-290gm (00:30:53:35:C3:B8)
|
|
|
|
*** Optimize system settings ***
|
|
|
|
Adjusted rtprio to 99 in /etc/security/limits.conf.
|
|
|
|
Disabled rp_filter for network bond0.
|
|
|
|
Added 'net.ipv4.conf.bond0.rp_filter=0' to /etc/sysctl.conf.
|
|
|
|
Disabled rp_filter for network all.
|
|
|
|
Added 'net.ipv4.conf.all.rp_filter=0' to /etc/sysctl.conf.
|
|
|
|
Adjusted net.core.rmem_max value to 32 MB.
|
|
|
|
Added 'net.core.rmem_max=33554432' to /etc/sysctl.conf.
|
|
|
|
Created a new config file '/etc/NetworkManager/dispatcher.d/pre-up.d/basler-network-config' to adjust network parameters at startup.
|
|
|
|
Adjusted adapter bond0 with ring buffer = 4096.
|
|
|
|
Adjusted adapter bond0 with IMR = 84.
|
|
|
|
Reboot the system to make the parameter change permanent.
|
|
|
|
``` |
