HPC Community Configuration RS - some advice
HPC High performance computing clusters for supercomputer and web servers : Linux and windows compatible! - Improves efficiency of national compute resources
RS
https://docs.microsoft.com/en-gb/azure/virtual-machines/linux/high-performance-computing
https://docs.microsoft.com/en-us/powershell/high-performance-computing/overview?view=hpc16-ps
https://go.microsoft.com/fwlink/p/?linkid=837709
HPC Resources :
CCP_CONNECTIONSTRING=0.0.0.0,127.0.0.0,dn.n-helix.com,hpc.worldcommunitygrid.org,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,work.charityengine.com,boinc.berkeley.edu,berkeley.edu,usc.edu,boinc.bakerlab.org,8.8.4.4
CCP_SCHEDULER=0.0.0.0,127.0.0.0,dn.n-helix.com,hpc.worldcommunitygrid.org,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,work.charityengine.com,boinc.berkeley.edu,berkeley.edu,usc.edu,boinc.bakerlab.org,8.8.4.4
0.0.0.0,127.0.0.0,dn.n-helix.com,hpc.worldcommunitygrid.org,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,work.charityengine.com,boinc.berkeley.edu,berkeley.edu,usc.edu,boinc.bakerlab.org,8.8.4.4
Rupert S
Copyright © 2024 Einstein@Home. All rights reserved.
you will need a server
)
you will need a server certificate such as a comodo or digicert or microsoft > https://www.gogetssl.com/compare-domain-sslcertificates/
CCP_CONNECTIONSTRING=dn.n-helix.com,localhost,127.0.0.0,1.1.1.1,hpc.worldcommunitygrid.org,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,work.charityengine.com,boinc.berkeley.edu,berkeley.edu,boinc.bakerlab.org,8.8.4.4
CCP_SCHEDULER=dn.n-helix.com,localhost,127.0.0.0,1.1.1.1,hpc.worldcommunitygrid.org,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,work.charityengine.com,boinc.berkeley.edu,berkeley.edu,boinc.bakerlab.org,8.8.4.4
Simple Final
)
Simple Final 4
CCP_CONNECTIONSTRING=dn2.n-helix.com,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,8.8.4.4,localhost,noshost,cloudflareworkers.com,cloudflare.com,34.225.23.59,52.42.7.116,208.67,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch
CCP_SCHEDULER=dn2.n-helix.com,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,8.8.4.4,localhost,noshost,cloudflareworkers.com,cloudflare.com,34.225.23.59,52.42.7.116,208.67,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch
***
HPC Pack 2016 Update 1 fixes
https://www.microsoft.com/en-us/download/details.aspx?id=56964
https://www.microsoft.com/en-us/download/details.aspx?id=54507 Microsoft HPC Pack 2016 including linux
https://technet.microsoft.com/en-us/library/cc514029(v=ws.11).aspx all HPC Packs 2016,2012 to 2008 info and download
https://msdn.microsoft.com/en-us/library/ff976568.aspx Microsoft High Performance Computing for Developers - info and downloads
https://docs.microsoft.com/en-us/azure/virtual-machines/windows/hpcpack-cluster-active-directory - information and virtualisation
https://docs.microsoft.com/en-us/azure/virtual-machines/windows/hpcpack-cluster-options
Azura win+linux+iso
https://docs.microsoft.com/en-gb/azure/virtual-machines/linux/high-performance-computing
Instructions
https://docs.microsoft.com/en-us/powershell/high-performance-computing/overview?view=hpc16-ps
https://docs.microsoft.com/en-us/azure/cloud-services/cloud-services-setup-hybrid-hpcpack-cluster
Netport Clarity HPC
https://docs.microsoft.com/en-us/powershell/high-performance-computing/appendix-1-hpc-cluster-networking?view=hpc16-ps
https://docs.microsoft.com/en-us/powershell/high-performance-computing/microsoft-hpc-pack-node-deployment?view=hpc16-ps
Appendix A: KMS Client Setup Keys
https://docs.microsoft.com/en-us/previous-versions/windows/it-pro/windows-server-2012-R2-and-2012/jj612867(v=ws.11)
The certificate needs to be
)
The certificate needs to be verifiable like digicert or commodo would be...
Some Alternative HPC
)
Some Alternative HPC Paths
Kubernets K8's Docker comes with a version for local clusters
https://kubernetes.io/docs/concepts/
https://kubernetes.io/docs/setup/pick-right-solution/
https://kubernetes.io/docs/setup/pick-right-solution/#local-machine-solutions
*docker containers of use*
docker pull evancui/hpcacm
docker pull kubernets/spinnaker-clouddriver
docker pull cloudnativelabs/kube-router
docker pull alpine
docker pull whatwedo/cloudflare-railgun
docker pull rungeict/cloudflare-railgun
docker run --name railgun-memcached -d --restart=always memcached:latest
docker run --name=binddns-resolver -d -p 53:53/udp -p 53:53 -d -p 5353:5353/udp -p 5353:5353 -d --restart=always unixtastic/bind-dnssec-resolver
docker run -d --name=railgun -p 2408:2408 -e RG_ACT_TOKEN=ENTERTOKENHERE -e RG_ACT_HOST=127.0.0.0 -e RG_LOG_LEVEL=1 -e RG_WAN_PORT=2408 --link railgun-memcached:memcached --restart=always rungeict/cloudflare-railgun
https://github.com/BOINC/boinc-client-docker
https://github.com/marius311/boinc-server-docker/blob/master/docs/cookbook.md
https://cosmicmar.com/2016/02/14/boinc-server-docker-1/
https://azure.microsoft.com/en-us/resources/templates/slurm/
https://wikis.nyu.edu/display/NYUHPC/Slurm+Tutorial
https://wiki.hpc.uconn.edu/index.php/SLURM_Guide
Linux, Windows excetera HTCondor
https://research.cs.wisc.edu/htcondor/
Platform LSF will do everything you need. It runs on Windows. It is commercial, and can be purchased with support. https://www.ibm.com/it-infrastructure
https://stackoverflow.com/questions/3149131/please-recommend-an-alternative-to-microsoft-hpc
at the bottom is a
)
at the bottom is a configuration that makes boinc installing on a cloud easily achievable,
ttps://github.com/BOINC/boinc
)
ttps://github.com/BOINC/boinc-client-docker
https://github.com/marius311/boinc-server-docker/blob/master/docs/cookbook.md
https://cosmicmar.com/2016/02/14/boinc-server-docker-1/
"Our suggestion of boinc detection of docker (docker launch takes 15 seconds plus so boinc would have to wait for the process to initiate in the windows task manager before..
The initial detection system would launch for Container VM; Of special note is the use of Linux containers; In particular Science Linux and Alpine (for size and usability) (science kernel version is possible)
docker pull alpine - check this out! RS"
the top link is
)
the top link is : https://github.com/BOINC/boinc-client-docker
Clarified : HPC Compute
)
Clarified : HPC Compute Network - Advise install - Windows & Linux Server by RS
Spread the word : Operation Liberate the Node - High performance computation for beneficial means of complimentary use to the future & survival.
Ways and means of obtaining scientific worth and usage though the usage of High Performance Computing or HPC that can indeed solve many of the humanitarian objectives of our worlds.
Boinc VM's are a specific objective of worth to the charitable science community and field research..
http://science.n-helix.com/2017/04/boinc.html
HPC Pack 2016 Update 1 fixes - install one after the other - after installing HPC Pack 2016 Update 1
https://www.microsoft.com/en-us/download/details.aspx?id=56964
https://www.microsoft.com/en-us/download/details.aspx?id=57174
https://www.microsoft.com/en-us/download/details.aspx?id=54507 Microsoft HPC Pack 2016 including linux
https://technet.microsoft.com/en-us/library/cc514029(v=ws.11).aspx all HPC Packs 2016,2012 to 2008 info and download
https://msdn.microsoft.com/en-us/library/ff976568.aspx Microsoft High Performance Computing for Developers - info and downloads
https://docs.microsoft.com/en-us/azure/virtual-machines/windows/hpcpack-cluster-active-directory - information and virtualisation
https://docs.microsoft.com/en-us/azure/virtual-machines/windows/hpcpack-cluster-options
Azura win+linux+iso
https://docs.microsoft.com/en-gb/azure/virtual-machines/linux/high-performance-computing
Instructions
https://docs.microsoft.com/en-us/powershell/high-performance-computing/overview?view=hpc16-ps
https://docs.microsoft.com/en-us/azure/cloud-services/cloud-services-setup-hybrid-hpcpack-cluster
Netport Clarity HPC
https://docs.microsoft.com/en-us/powershell/high-performance-computing/appendix-1-hpc-cluster-networking?view=hpc16-ps
https://docs.microsoft.com/en-us/powershell/high-performance-computing/microsoft-hpc-pack-node-deployment?view=hpc16-ps
Appendix A: KMS Client Setup Keys
https://docs.microsoft.com/en-us/previous-versions/windows/it-pro/windows-server-2012-R2-and-2012/jj612867(v=ws.11)
Operational achievement & field testing of HPC configuration.
You will need a server certificate such as a comodo or digicert or microsoft > https://www.gogetssl.com/compare-domain-sslcertificates/
Simple Final 4 - Test configuration - Operation : Help https://worldcommunitygrid.org , Boinc , Cloudflare , HPC & SFR SA .. Achieve dreams of computation that will exceed expectations of science today.
Install Microsoft HPC Pack 2016 or higher , performance HPC pro users ! including linux , for host settings of HPC Pack,
For CCP_CONNECTIONSTRING & CCP_SCHEDULER ; Set in the install setup when installed.
The node address you enter for HPC pack for the nodes, load the certificate into the next page of install & root certificate!
CCP_CONNECTIONSTRING=127.0.0.1,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,cloudflare.com,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch
CCP_SCHEDULER=127.0.0.1,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,cloudflare.com,8.8.4.4,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch
**** Some Alternative HPC Paths that compliment Microsoft HPC Pack
https://docs.docker.com/get-started/
Kubernets K8's Docker comes with a version for local clusters
https://kubernetes.io/docs/concepts/
https://kubernetes.io/docs/setup/pick-right-solution/
https://kubernetes.io/docs/setup/pick-right-solution/#local-machine-solutions
*docker containers of use* & BOINC Host/Client VM Cloud Configuration.
docker pull kubernets/spinnaker-clouddriver
docker pull cloudnativelabs/kube-router
docker pull alpine
docker pull whatwedo/cloudflare-railgun
docker pull rungeict/cloudflare-railgun
docker run --name railgun-memcached -d --restart=always memcached:latest
docker run --name=binddns-resolver -d -p 53:53/udp -p 53:53 -d -p 5353:5353/udp -p 5353:5353 -d --restart=always unixtastic/bind-dnssec-resolver
docker run -d --name=railgun -p 2408:2408 -e RG_ACT_TOKEN=ENTERTOKENHERE -e RG_ACT_HOST=127.0.0.0 -e RG_LOG_LEVEL=1 -e RG_WAN_PORT=2408 --link railgun-memcached:memcached --restart=always rungeict/cloudflare-railgun
https://github.com/BOINC/boinc-client-docker
https://github.com/marius311/boinc-server-docker/blob/master/docs/cookbook.md
https://cosmicmar.com/2016/02/14/boinc-server-docker-1/
Our suggestion of boinc detection of docker (docker launch takes 15 seconds plus so boinc would have to wait for the process to initiate in the windows task manager before..
The initial detection system would launch for Container VM; Of special note is the use of Linux containers; In particular Science Linux and Alpine (for size and usability) (science kernel version is possible)
docker pull alpine - check this out!
In other notes :
https://www.openfabrics.org/
http://www.opencompute.org/
https://openhpc.community/downloads/
https://azure.microsoft.com/en-us/resources/templates/slurm/
https://wikis.nyu.edu/display/NYUHPC/Slurm+Tutorial
https://wiki.hpc.uconn.edu/index.php/SLURM_Guide
Linux, Windows excetera HTCondor
https://research.cs.wisc.edu/htcondor/
Platform LSF will do much you can utilise, It runs on Windows. It is commercial, and can be purchased with support. https://www.ibm.com/it-infrastructure
If you are wondering what putty is in windows hpc pack,
Appearing to be SSH Shell client (console)
https://www.putty.org/
https://research.computing.yale.edu/support/hpc/user-guide/connect-windows-putty
http://inside.mines.edu/HPC-SSH-Putty
(C)RS
Our suggestion of boinc
)
Our suggestion of boinc detection of docker (docker launch takes 15 seconds plus so boinc would have to wait for the process to initiate in the windows task manager before..
The initial detection system would launch for Container VM & also pull user data into the VM (the necessary ID from project add device & also set the VM and OS use for special case use and non generic project data,
Of special note is the use of Linux containers; This container potentially could batch multiple projects with finesse; In particular Science Linux and Alpine (for size and usability) (science kernel version is possible)
docker pull alpine - check this out!
Finally special contained secure environments for HPC Boinc Networking science is realised with relative technical aplume & thusly easily usable by the average; Non average user.
RS