• Upgrading server

    From Digital Man@VERT to All on Wed Aug 24 12:44:02 2022
    The server currently-known-as 'cvs.synchro.net' is an aging quad-core AMD (A10 PRO-7800B) based HP workstation with 16GB of DDR3 RAM running Debian Linux 10.9 on a SATA SSD. This server has a lot of duties, including the hosting of [www].synchro.net, ftp.synchro.net, cvs.synchro.net, wiki.synchro.net, git.synchro.net, gitlab.synchro.net and provides the primary domain name services for *.synchro.net.

    I'm in the process of upgrading this system to an new Intel i7-17200 based HP workstation with 32GB of DDR4 RAM running Debian Linux 11.4 on an NVMe SSD (bought it on sale for $800 from costco.com). This should speed-up a lot of Git-related things quite a bit (e.g. CI pipeline/builds) when the upgrade is complete.

    Since the old system was upgraded several times over many years from whatever was the current Debian Linux 10+ years ago (pre-systemd), I'm starting with a fresh install and migrating all the services and data over piece meal.

    Starting with GitLab, I had to have the same version running on each server before I could migrate the data, so I upgraded the GitLab install on cvs.synchro.net first from 13.12.15 to 14.0.12 then to 14.7.2.

    I'll be working on other migration tasks over the next week+ before making the final switch-over. Other than the upgrade to GitLab, you probably won't notice anything until the migration is done and I'll give some head's up when I'm about to do that (like I said, in several days), and then I won't be surprised if there are some hiccups at that time.

    I'll look into upgrading to the current GitLab (15.x) after the migration is complete.
    --
    digital man (rob)

    Rush quote #49:
    Some will sell their dreams for small desires or lose the race to rats
    Norco, CA WX: 90.4øF, 48.0% humidity, 4 mph ESE wind, 0.00 inches rain/24hrs ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From Ragnarok@VERT/DOCKSUD to Digital Man on Fri Aug 26 00:16:54 2022
    Hi,

    Please find the latest report on new defect(s) introduced to Synchronet found with Coverity Scan.

    2 new defect(s) introduced to Synchronet found with Coverity Scan.


    New defect(s) Reported-by: Coverity Scan
    Showing 2 of 2 defect(s)


    ** CID 319807: Memory - illegal accesses (UNINIT) /tmp/sbbs-Aug-26-2022/3rdp/src/mozjs/js-1.8.5/js/src/configure: 9243 in main()


    ________________________________________________________________________________________________________
    *** CID 319807: Memory - illegal accesses (UNINIT) /tmp/sbbs-Aug-26-2022/3rdp/src/mozjs/js-1.8.5/js/src/configure: 9243 in main() 9237 cat > conftest.$ac_ext <<EOF
    9238 #line 9239 "configure"
    9239 #include "confdefs.h"
    9240 #include <sys/utsname.h>
    9241 int main() {
    9242 struct utsname *res; char *domain;
    CID 319807: Memory - illegal accesses (UNINIT)
    Using uninitialized value "res" when calling "uname".
    9243 (void)uname(res); if (res != 0) { domain = res->domainname; }
    9244 ; return 0; }
    9245 EOF
    9246 if { (eval echo configure:9247: \"$ac_compile\") 1>&5; (eval $ac_compile) 2>&5; }; then
    9247 rm -rf conftest*
    9248 ac_cv_have_uname_domainname_field=true

    ** CID 319786: Null pointer dereferences (REVERSE_INULL) /tmp/sbbs-Aug-26-2022/3rdp/src/mozjs/js-1.8.5/js/src/configure: 9243 in main()


    ________________________________________________________________________________________________________
    *** CID 319786: Null pointer dereferences (REVERSE_INULL) /tmp/sbbs-Aug-26-2022/3rdp/src/mozjs/js-1.8.5/js/src/configure: 9243 in main() 9237 cat > conftest.$ac_ext <<EOF
    9238 #line 9239 "configure"
    9239
  • From Digital Man@VERT to Ragnarok on Thu Aug 25 23:59:27 2022
    Hi,

    Please find the latest report on new defect(s) introduced to Synchronet found with Coverity Scan.

    2 new defect(s) introduced to Synchronet found with Coverity Scan.


    New defect(s) Reported-by: Coverity Scan
    Showing 2 of 2 defect(s)

  • From Digital Man@VERT to All on Sat Nov 5 15:31:18 2022
    Re: Upgrading server
    By: Digital Man to All on Wed Aug 24 2022 12:44 pm

    The server currently-known-as 'cvs.synchro.net' is an aging quad-core AMD (A10 PRO-7800B) based HP workstation with 16GB of DDR3 RAM running Debian Linux 10.9 on a SATA SSD. This server has a lot of duties, including the hosting of [www].synchro.net, ftp.synchro.net, cvs.synchro.net, wiki.synchro.net, git.synchro.net, gitlab.synchro.net and provides the primary domain name services for *.synchro.net.

    I'm in the process of upgrading this system to an new Intel i7-17200 based HP workstation with 32GB of DDR4 RAM running Debian Linux 11.4 on an NVMe SSD (bought it on sale for $800 from costco.com). This should speed-up a lot of Git-related things quite a bit (e.g. CI pipeline/builds) when the upgrade is complete.

    Okay, the migration is finally going to happen today, so there will be some down time.

    Wish me luck,
    --
    digital man (rob)

    Sling Blade quote #19:
    Doyle: I can't so much as drink a damn glass of water around a midget
    Norco, CA WX: 71.0øF, 29.0% humidity, 5 mph E wind, 0.00 inches rain/24hrs
    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From Digital Man@VERT to All on Tue Nov 8 11:34:19 2022
    Re: Upgrading server
    By: Digital Man to All on Sat Nov 05 2022 03:31 pm

    Re: Upgrading server
    By: Digital Man to All on Wed Aug 24 2022 12:44 pm

    The server currently-known-as 'cvs.synchro.net' is an aging quad-core AMD (A10 PRO-7800B) based HP workstation with 16GB of DDR3 RAM running Debian Linux 10.9 on a SATA SSD. This server has a lot of duties, including the hosting of [www].synchro.net, ftp.synchro.net, cvs.synchro.net, wiki.synchro.net, git.synchro.net, gitlab.synchro.net and provides the primary domain name services for *.synchro.net.

    I'm in the process of upgrading this system to an new Intel i7-17200 based HP workstation with 32GB of DDR4 RAM running Debian Linux 11.4 on an NVMe SSD (bought it on sale for $800 from costco.com). This should speed-up a lot of Git-related things quite a bit (e.g. CI pipeline/builds) when the upgrade is complete.

    Okay, the migration is finally going to happen today, so there will be some down time.

    Update/status:

    - Bind/Dynamic-DNS service migrated successfully
    *.synchro.net hostnames are resolving and dynamically updated
    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon
    - DokuWiki/PHP-FPM migrated successfully
    Upgraded to latest PHP-FPM and DokuWiki
    - Synchronet migrated successfully
    still resolving lingering broken symlinks and permissions
    - proFTPd migrated (ftp.synchro.net) successfully
    - SpamAssassin migrated successfully (new spam db)
    - CVS/cvsweb/viewcvs *not* migrated and probably not going to bother
    (will need to continue to find and fix any links to cvsweb/viewcvs)

    Still yet to do: ZNC, Murmur, automated backups, more stuff I'm forgetting
    --
    digital man (rob)

    This Is Spinal Tap quote #36:
    Bobbi Flekman: Money talks, and bullshit walks.
    Norco, CA WX: 64.7øF, 69.0% humidity, 7 mph ESE wind, 0.32 inches rain/24hrs ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From Ragnarok@VERT/DOCKSUD to Digital Man on Wed Nov 9 19:17:17 2022
    El 8/11/22 a las 16:34, Digital Man escribi¢:

    Update/status:

    - Bind/Dynamic-DNS service migrated successfully
    *.synchro.net hostnames are resolving and dynamically updated
    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon
    - DokuWiki/PHP-FPM migrated successfully
    Upgraded to latest PHP-FPM and DokuWiki
    - Synchronet migrated successfully
    still resolving lingering broken symlinks and permissions
    - proFTPd migrated (ftp.synchro.net) successfully
    - SpamAssassin migrated successfully (new spam db)
    - CVS/cvsweb/viewcvs *not* migrated and probably not going to bother
    (will need to continue to find and fix any links to cvsweb/viewcvs)

    Still yet to do: ZNC, Murmur, automated backups, more stuff I'm forgetting

    Great job! always.. thanks for your work!

    ---
    þ Synchronet þ Dock Sud BBS TLD 24 HS - bbs.docksud.com.ar
  • From Angel Ripoll@VERT to Digital Man on Thu Nov 10 17:35:42 2022
    Hola Digital!

    09 Nov 22 19:17, Ragnarok dijo a Digital Man:

    El 8/11/22 a las 16:34, Digital Man escribi¢:

    Update/status:

    - Bind/Dynamic-DNS service migrated successfully
    *.synchro.net hostnames are resolving and dynamically updated
    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon
    - DokuWiki/PHP-FPM migrated successfully
    Upgraded to latest PHP-FPM and DokuWiki
    - Synchronet migrated successfully
    still resolving lingering broken symlinks and permissions
    - proFTPd migrated (ftp.synchro.net) successfully
    - SpamAssassin migrated successfully (new spam db)
    - CVS/cvsweb/viewcvs *not* migrated and probably not going to bother
    (will need to continue to find and fix any links to cvsweb/viewcvs)

    Still yet to do: ZNC, Murmur, automated backups, more stuff I'm forgetting

    Great job! always.. thanks for your work!

    +1

    Thanks Rob

    Un saludo,
    Angel Ripoll
    aripoll @ zruspas.org

    --- GoldED+/LNX 1.1.5-b20220504 + HPT 1.9 + Binkd 1.1 en Debian
    * Origin: Synchronet - bbs.zruspas.org - Zruspa's BBS - (2:341/66)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From Digital Man@VERT to Angel Ripoll on Thu Nov 10 11:07:13 2022
    Re: Upgrading server
    By: Angel Ripoll to Digital Man on Thu Nov 10 2022 05:35 pm

    Hola Digital!

    09 Nov 22 19:17, Ragnarok dijo a Digital Man:

    El 8/11/22 a las 16:34, Digital Man escribi¢:

    Update/status:

    - Bind/Dynamic-DNS service migrated successfully
    *.synchro.net hostnames are resolving and dynamically updated
    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon
    - DokuWiki/PHP-FPM migrated successfully
    Upgraded to latest PHP-FPM and DokuWiki
    - Synchronet migrated successfully
    still resolving lingering broken symlinks and permissions
    - proFTPd migrated (ftp.synchro.net) successfully
    - SpamAssassin migrated successfully (new spam db)
    - CVS/cvsweb/viewcvs *not* migrated and probably not going to bother
    (will need to continue to find and fix any links to cvsweb/viewcvs)

    Still yet to do: ZNC, Murmur, automated backups, more stuff I'm forgetting

    Great job! always.. thanks for your work!

    +1

    Thanks Rob

    Hopefully you've noticed the wiki and gitlab web UI are snappier (the wiki was already pretty fast), but builds are *way* fater now:

    BEFORE the upgrade:
    System: cvs - Linux 4.19.0-16-amd64 x86_64

    00:00 - src/sbbs3 make git_branch.h git_hash.h
    00:02 - tar --exclude=*output.txt --exclude=node1 --exclude=ctrl --exclude=docs --exclude=exec --exclude=install --exclude=text --exclude=web --exclude=webv4 --exclude=xtrn --exclude=src/crt --exclude=src/doors --exclude=src/odoors --exclude=src/sbbs2 --exclude=src/syncterm --exclude=src/ZuulTerm --exclude=3rdp/win32.release --exclude-vcs --exclude-vcs-ignores --dereference -czvf sbbs_src.tgz *
    21:51 - src/sbbs3 cov-build --dir ../../cov-int make RELEASE=1 all
    00:18 - src/sbbs3 make RELEASE=1 gtkutils
    -----
    22:11 - total

    AFTER the upgrade:
    System: git - Linux 5.19.0-1-amd64 x86_64

    00:00 - src/sbbs3 make git_branch.h git_hash.h
    00:01 - tar --exclude=*output.txt --exclude=node1 --exclude=ctrl --exclude=docs --exclude=exec --exclude=install --exclude=text --exclude=web --exclude=webv4 --exclude=xtrn --exclude=src/crt --exclude=src/doors --exclude=src/odoors --exclude=src/sbbs2 --exclude=src/syncterm --exclude=src/ZuulTerm --exclude=3rdp/win32.release --exclude-vcs --exclude-vcs-ignores --dereference -czvf sbbs_src.tgz *
    07:08 - src/sbbs3 cov-build --dir ../../cov-int make RELEASE=1 all
    00:06 - src/sbbs3 make RELEASE=1 gtkutils
    -----
    07:15 - total

    And that's a single-threaded build/analysis!

    For gitlab-CI builds, the improvement for just the sbbs-linux build job went from 09:33 to 2:57. That was the slowest job (among many, which *are* parallelized), so you that's approximately the improvement you should see now when waiting for CI to complete (e.g. for a merge request).

    So all the expense, work and hassle was worthwhile to me. :-)
    --
    digital man (rob)

    Synchronet "Real Fact" #16:
    Synchronet first supported FidoNet networking (with SBBSFIDO) in 1992
    Norco, CA WX: 65.0øF, 34.0% humidity, 0 mph ENE wind, 0.00 inches rain/24hrs ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From Digital Man@VERT to All on Fri Nov 11 23:49:57 2022
    Re: Upgrading server
    By: Digital Man to All on Tue Nov 08 2022 11:34 am

    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon

    Upgraded to GitLab 15.5.3 (the latest available for Debian bookworm/sid right now). Seems to be working fine so far. Let me know if you encounter any issues.
    --
    digital man (rob)

    Synchronet/BBS Terminology Definition #25:
    DSL = Digital Subscriber Line
    Norco, CA WX: 55.0øF, 34.0% humidity, 0 mph ENE wind, 0.00 inches rain/24hrs ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net