Merge pull request #1318 from Zarquan/20240229-zrq-handover-notes

Handover notes ...

notes/zrq/20240227-01-handover-notes.txt

@@ -0,0 +1,134 @@
+#
+# <meta:header>
+# <meta:licence>
+# Copyright (c) 2024, ROE (https://www.roe.ac.uk/)
+#
+# This information is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This information is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program. If not, see <https://www.gnu.org/licenses/>.
+# </meta:licence>
+# </meta:header>
+#
+#zrq-notes-time
+#zrq-notes-indent
+#zrq-notes-crypto
+#zrq-notes-ansible
+#zrq-notes-osformat
+#zrq-notes-zeppelin
+#
+
+ Target:
+
+ Answer Malcolm's questions ...
+
+ Result:
+
+ Work in progress ...
+
+# -----------------------------------------------------
+
+ How do I add and remove users from the live systems without having to do a redeploy?
+
+ https://github.com/wfau/gaia-dmp/blob/master/notes/zrq/20230704-01-new-users.txt
+ https://github.com/wfau/gaia-dmp/blob/master/notes/stv/20240228-new-user.txt
+
+ How do I backup user data and notebooks?
+
+ Backup notebooks live->data and live->offsite
+ https://github.com/wfau/gaia-dmp/blob/master/notes/zrq/20230123-01-backup-notebooks.txt
+ https://github.com/wfau/gaia-dmp/blob/master/notes/zrq/20230323-01-backup-notebooks.txt
+ https://github.com/wfau/gaia-dmp/blob/master/notes/zrq/20230517-01-backup-notebooks.txt
+
+ Backup notebooks live->offsite AND secrets data->offsite
+ https://github.com/wfau/gaia-dmp/blob/master/notes/zrq/20230912-03-backups.txt
+
+ Relatioship between data and the other projects ?
+
+ Data VM contains the SSL certificates from Let's Encrypt
+ Check with Stelios for details on these.
+
+ Data VM contains the secrets, including the DuckDNS token
+ Used to updated the IP address of colours, and live.
+
+ Data VM contains the passhashes
+ Used to populate the MariaDB database table for Zepelin accounts.
+
+ Data VM contains the backup of the notebooks
+ /var/local/backups/notebooks
+
+ New deploy will copy notebooks from data
+
+ It is up to us to pull a new backup from live->data manually.
+ We _could_ have a cron job on data that pulled backups.
+
+ Data project holds the home shares for live users
+ Data project holds the user shares for live users
+ Data project holds the science data shares
+
+ These are all mounted via kernel mount entries in /etc/fstab in each VM.
+ https://github.com/wfau/gaia-dmp/blob/master/deployments/hadoop-yarn/bin/cephfs-mount.sh
+ https://github.com/wfau/gaia-dmp/blob/master/deployments/hadoop-yarn/ansible/51-cephfs-mount.yml
+
+ How do I change the “live” gaia dns to point at green,blue,red respectively?
+
+ Use the DuckDNS token from secrets to update the live.
+ https://github.com/wfau/gaia-dmp/blob/a44fe52505b52c0d84501a3c0b9daebc02a9fb28/notes/zrq/20231027-01-new-deploy.txt#L574-L584
+
+ host live.gaia-dmp.uk
+ > live.gaia-dmp.uk is an alias for aglais-live.duckdns.org.
+ > aglais-live.duckdns.org has address 128.232.227.27
+
+ host dmp.gaia.ac.uk
+ > dmp.gaia.ac.uk is an alias for aglais-live.duckdns.org.
+ > aglais-live.duckdns.org has address 128.232.227.27
+
+
+ DNS ownership
+
+ gaia-dmp.uk is owned by Dave
+ Renewed for 1year in January 2024
+ Need a plan to move away from this - your choice.
+ Registered via LCN https://www.lcn.com
+
+ whois gaia-dmp.uk
+
+ Expiry date: 20-Jan-2025
+ Last updated: 20-Jan-2024
+
+ gaia.ac.uk is owned by Cambridge
+ Need to make a support request to change dmp.gaia.ac.uk
+
+ Point me at a list of known issues or a troubleshooting guide.
+
+ Cambridge CepFS mounts
+ cephfs mount fails
+ shares stuck in deleting
+ openstack is foobar
+
+
+ Discuss the best way to resolve the versions issue that’s preventing deploying the current main branch, as this will presumably be the first issue for me to resolve
+
+ Check with Stelios.
+
+ TODO
+
+ Go through a checklist that I’m on all the necessary mailing lists and have access to everything I should have access to.
+
+
+ Go through Resource request details
+ email in to with deniza
+ summary of where we are
+ details of next year's allocation
+
+
+
+