All public logs

Jump to navigation Jump to search

Combined display of all available logs of HPCWIKI. You can narrow down the view by selecting a log type, the username (case-sensitive), or the affected page (also case-sensitive).

Logs
(newest | oldest) View ( | ) (20 | 50 | 100 | 250 | 500)
  • 10:48, 2 January 2024 Admin talk contribs created page Mount vs bind mount (Created page with "In Linux systems, '''we can mount a device in a directory using the ''mount'' command'''. This allows us to access the device’s filesystem<syntaxhighlight lang="bash"> $ findmnt --real TARGET SOURCE FSTYPE OPTIONS / /dev/sda5 ext4 rw,relatime,errors=remount-ro ├─/sys/kernel/tracing tracefs tracefs rw,nosuid,nodev,noexec,relatime └─/boot/efi /dev/sda1 vfat rw,relatime,fmask=0077,dmask=0077,codepage=437,ioc...") Tag: Visual edit
  • 10:27, 2 January 2024 Admin talk contribs created page SSHFS (Created page with "SSHFS (SSH Filesystem) is a filesystem client based on FUSE for mounting remote directories over an SSH connection. SSHFS is using the SFTP protocol, which is a subsystem of SSH and it is enabled by default on most SSH servers. When compared to other network file system protocols such as NFS and Samba the advantage of SSHFS is that it does not require any additional configuration on the server side. To use SSHFS you only need SSH access to the remote server via SFTP,...") Tag: Visual edit: Switched
  • 09:53, 2 January 2024 Admin talk contribs created page NFS tips and tricks (Created page with " == nfsd: too many open connections, consider increasing the number of threads == NFS uses threads on the server to handle incoming and outgoing I/O requests. Using threads helps NFS scale to handle large numbers of clients and large numbers of I/O requests. dmesg display when reach some high number of clients. should increase Number of NFS daemons (''nfsd'') by changing the RPCNFSDCOUNT variable in <code>/etc/default/nfs-kernel-server</code> on a Debian-based machine....") Tag: Visual edit
  • 09:04, 2 January 2024 Admin talk contribs created page Fstab (Created page with "In linux, fstab (aka, ''file systems table'') is a configuration table designed to mount and unmount file systems to a machine. The fstab file is read by the <code>mount</code> command, which happens automatically at boot time to determine the overall file system structure, and thereafter when a user executes the <code>mount</code> command to modify that structure == Fstab syntax == fstab is a 6 column structure, where each column designates a specific parameter and m...") Tag: Visual edit
  • 16:01, 31 December 2023 Admin talk contribs moved page ZFS to Private:ZFS
  • 15:55, 31 December 2023 Admin talk contribs created page Linux File System Types (Created page with "A file system on Linux is responsible for organizing and managing data on storage devices such as hard drives, solid-state drives (SSDs), and USB drives. Linux offers a diverse range of file system types, each tailored to specific use cases and scenarios. == Common Linux file system types == {| class="wikitable" |+ !Type !Description !Partition & mount |- |Ext4 |The most widely used and default file system. * High performance for most workloads. * Reliable journaling...") Tag: Visual edit
  • 15:07, 31 December 2023 Admin talk contribs created page USB connector (Created page with "== USB 3.x Spec. == The naming convention of USB has become really messy. Here’s how it breaks down.<ref>https://www.cined.com/storage-explained-configure-raid-file-system-pros-cons/</ref> * USB 3.2 Gen 1, is USB 3.0. It has a maximum throughput of 5Gbps. This is also known as SuperSpeed USB. * USB 3.2 Gen 2, is USB 3.1. It has a maximum throughput of 10Gbps. This is also known as SuperSpeed USB 10Gbps. * USB 3.2 Gen 2×2, is USB 3.2. It has a maximum throughput of 20...") Tag: Visual edit
  • 15:04, 31 December 2023 Admin talk contribs created page File:Type of USB connector .png
  • 15:04, 31 December 2023 Admin talk contribs uploaded File:Type of USB connector .png
  • 11:34, 29 December 2023 Admin talk contribs created page File:RAID table.png
  • 11:34, 29 December 2023 Admin talk contribs uploaded File:RAID table.png
  • 11:21, 29 December 2023 Admin talk contribs created page CacheCade drive (Created page with "LSI is offering CacheCade features that is similar to Adaptec's maxCache technology to to maximize transactional I/O performance through fast SSD as a cache device. CacheCade Pro 2.0 is available and only SSDs approved by LSI should be used together with CacheCade<ref>https://docs.broadcom.com/doc/12350215</ref> == CacheCade work flow == * One or more SSDs will be connected to the RAID controller in addition to the normal hard disks, when using CacheCade. * Thereby, t...") Tag: Visual edit
  • 14:03, 28 December 2023 Admin talk contribs created page SED (Self-Encrypting Drives) (Created page with "A self-encrypting drive (SED) is a hard disk drive (HDD) or solid-state drive (SSD) designed to automatically encrypt and decrypt drive data without the need for user input or disk encryption software. Samsung, Seagate, and Toshiba, have SEDs on the market today. center|frameless|536x536px|SEDs works - Trusted Computing Group Many self-encrypting drives available today implement the OPAL and Enterprise standards developed b...") Tag: Visual edit
  • 13:35, 28 December 2023 Admin talk contribs created page File:SEDs works-Trusted Computing Group.png
  • 13:35, 28 December 2023 Admin talk contribs uploaded File:SEDs works-Trusted Computing Group.png
  • 11:09, 23 December 2023 Admin talk contribs created page CheckInstall (Created page with "Have you ever want to build your own .deb package for distribution ? Ubuntu's checkinstall<ref>https://help.ubuntu.com/community/CheckInstall</ref> helps us to make custom .deb package. CheckInstall keeps track of all files installed by a "make install" or equivalent, creates a Slackware, RPM, or Debian package with those files, and adds it to the installed packages database, allowing for easy package removal or distribution. with checkinstall we can create Debian, RP...") Tag: Visual edit
  • 09:43, 23 December 2023 Admin talk contribs created page Private:Inhouse compile/OpenSSL (Created page with "== OpenSSL == OpenSSL<ref>https://github.com/openssl</ref> is a software library for applications that secure communications over computer networks against eavesdropping or need to identify the party at the other end. It is widely used by Internet servers, including the majority of HTTPS websites.<ref>https://endoflife.date/openssl</ref> This guide intends to teach you to '''Install the Latest version of OpenSSL on Ubuntu 20.04'''. OpenSSL is an open-source command line...") Tag: Visual edit
  • 09:32, 23 December 2023 Admin talk contribs created page RPATH (Created page with "'''rpath''' designates the run-time search path hard-coded in an executable file or library. Dynamic linking loaders use the rpath to find required libraries. <ref>https://en.wikipedia.org/wiki/Rpath</ref> When you are '''compiling''' a program, you create object files and then '''link''' them together. You may use GNU ld(1) to link them, there are also other linkers, LLVM linker. A linker combines object files into executable. After then when you '''execute''' an alre...") Tag: Visual edit
  • 10:13, 21 December 2023 Admin talk contribs created page Setup nbconvert (Created page with "== nbconvert == The '''nbconvert''' tool<ref>https://github.com/jupyter/nbconvert</ref> (jupyter nbconvert) converts notebooks to various other formats via Jinja templates. The nbconvert tool allows you to convert an .ipynb into * HTML * LaTeX * PDF * Reveal JS * Markdown (md) * ReStructured Text (rst) * executable script * etc == Setup nvconvert on Ubuntu == <syntaxhighlight lang="bash"> #Install pandoc sudo apt-get install pandoc # install nbconvert with webpdf su...") Tag: Visual edit
  • 14:00, 20 December 2023 Admin talk contribs deleted page Manual:DLSSystem/perl (content was: "== Perl in conda environment == Activate conda environment then install cpanm to manage further perl modules<syntaxhighlight lang="bash"> # install perl packages managemer cpanm inside conda environment mamba install perl-app-cpanminus # Using cpanm, we can install various perl module cpanm List::Util XML::Simple DBD::SQLite CGI.pm # perl jupyter connector cpanm Devel::IPerl </s...", and the only contributor was "Admin" (talk))
  • 13:58, 20 December 2023 Admin talk contribs created page Manual:DLSSystem/perl (Created page with "== Perl in conda environment == Activate conda environment then install cpanm to manage further perl modules<syntaxhighlight lang="bash"> # install perl packages managemer cpanm inside conda environment mamba install perl-app-cpanminus # Using cpanm, we can install various perl module cpanm List::Util XML::Simple DBD::SQLite CGI.pm # perl jupyter connector cpanm Devel::IPerl </syntaxhighlight> == References == <references />") Tag: Visual edit
  • 11:17, 20 December 2023 Admin talk contribs created page Manual:DLSsystem/network example (Created page with "== DLS Network bonding example == Pre-configured standalone DLS system shipped with link aggregation and the configuration file looks like following,<syntaxhighlight lang="bash"> $ cat /etc/netplan/01-netcfg.yaml # This file describes the network interfaces available on your system # For more information, see netplan(5). network: version: 2 renderer: networkd # example of DHCP # ethernets: # eno1: # dhcp4: yes # example of static # ethernets: #...") Tag: Visual edit
  • 10:49, 20 December 2023 Admin talk contribs created page Manual:UCM/PAHEcontrol (Created page with " == Control PA/HE on Master == PA and HE can be controlled from master node<syntaxhighlight lang="bash"> pahecontrol service is at /etc/systemd/system/pahecontrol.service which actually reference pahecontrol.py and config.json.schedule at /opt/hpcmate/cux $sudo systemctl disable pahecontrol.service $sudo systemctl enable pahecontrol.service $sudo systemctl start pahecontrol.service $sudo systemctl stop pahecontrol.service $sudo systemctl status pahecontrol.service </...") Tag: Visual edit
  • 08:16, 20 December 2023 Admin talk contribs created page Conda vs Mamba comparision (Created page with "{| class="wikitable" |+ !Type !Mamba !Conda !Notes |- |clone env |Export the contents of the existing environment to a YAML file. <code>micromamba env export -n oldenv > oldenv.yaml</code> Create a new environment from the YAML file. <code>micromamba env create -n newenv -f oldenv.yaml</code> |conda create --name CLONE_ENV_NAME --clone ENV_NAME | |- | | | | |- | | | | |} == References == <references />") Tag: Visual edit
  • 08:26, 19 December 2023 Admin talk contribs created page Manual:DLSSystem/dlsmodules (Created page with "== Preset modules and libraries == HPCMATE DLS has two type of systems - standalone and UCM cluster version Following table is a summary of preconfigured DLS modules {| class="wikitable" |+ !Module !Version !DLS !DLSBI !UCM clients !UCM master !Path |- |Polyphen |v2 | |O | | |/opt/hpcmate/tools/libs/pph2 |- |ncbi-blast |v2.15.0, v2.9.0 | |O | | |/opt/hpcmate/tools/libs/blast+-{version} |- | | | | | | | |} == References == <references />") Tag: Visual edit
  • 07:41, 19 December 2023 Admin talk contribs created page Manual:DLSSystem/Conda configuration (Created page with " == HMDLS_PATH == $HMDLS_PATH activates when user ativate pre-setting dls or dlsbi environment and deactivate. $HMDLS_PATH variable will be added to default conda $PATH on bash environment and be removed on deactivation. <ref>https://stackoverflow.com/questions/63721599/conda-activate-d-and-deactivate-d-do-not-behave-what-i-expect</ref> <syntaxhighlight lang="bash"> # activate environment script is at $CONDA_PREFIX/etc/conda/activate.d/activate-hmdls.sh #!/bin/bash ex...") Tag: Visual edit
  • 15:04, 17 December 2023 Admin talk contribs created page HMG493-SB1 (Created page with "center|frameless|726x726px|HMG493-SB1 ==Application[edit | edit source]== *Artificial intelligence *Heavy scientific computation *High-performance computing *Research lab/national lab *Astrophysics, business intelligence ==Features[edit | edit source]== #2 Intel Gen 4<sup>th</sup> Sockets, 10-GPUs, 4U Accelerator Server for HPC and Storage # 4U formfactor, 10 double-width full-height GPUs over PCIe 5.0, Dual ROM Architecture # Dual processor, LGA...") Tag: Visual edit: Switched
  • 14:51, 17 December 2023 Admin talk contribs created page File:HMG493-SB1.png
  • 14:51, 17 December 2023 Admin talk contribs uploaded File:HMG493-SB1.png
  • 10:48, 17 December 2023 Admin talk contribs created page Compile tips and tricks (Created page with "== GSL-config not found == <code>sudo apt install libgsl-dev</code><ref>https://askubuntu.com/questions/913493/gsl-config-not-found</ref> == References == <references />") Tag: Visual edit
  • 13:54, 16 December 2023 Admin talk contribs created page File:Cable connector pinout2.png
  • 13:54, 16 December 2023 Admin talk contribs uploaded File:Cable connector pinout2.png
  • 13:52, 16 December 2023 Admin talk contribs deleted page File:Cable connector pinout.png (replace image)
  • 13:38, 16 December 2023 Admin talk contribs created page File:EPS12 4+4.png
  • 13:38, 16 December 2023 Admin talk contribs uploaded File:EPS12 4+4.png
  • 13:37, 16 December 2023 Admin talk contribs created page File:Cable connector pinout.png
  • 13:37, 16 December 2023 Admin talk contribs uploaded File:Cable connector pinout.png
  • 13:22, 16 December 2023 Admin talk contribs created page File:GPU cable pinout.png
  • 13:22, 16 December 2023 Admin talk contribs uploaded File:GPU cable pinout.png
  • 10:42, 13 December 2023 Admin talk contribs created page Manual:DLSSystem/MultipleR (Created page with "As an optional pre-installed software package, DLS ship with multiple R versions modules. TODO == Automated setup scripts == * [https://support.posit.co/hc/en-us/articles/215488098-Installing-multiple-versions-of-R-on-Linux Installing multiple versions of R on Unbunt] == References == <references />") Tag: Visual edit
  • 07:42, 12 December 2023 Admin talk contribs created page Setup logwatch on Ubuntu (Created page with " A log file is a collection of events and activities that have occurred over a specified period of time. The containing too much detailed and repeated information make system administrator very difficult to go through all logs. Logwatch is a customizable tool that analyzes system log files based on areas you specify. It then generates the report of what is happening on the server and email it to the specified address if you want == Setup logwatch == <syntaxhighlight l...") Tag: Visual edit
  • 05:18, 12 December 2023 Admin talk contribs created page Hyper-V GPU passthrough (Created page with "Hyper-V supports is GPU passthrough, a feature that allows virtual machines to access the host’s GPU directly. this feature allows graphics intensive workloads like gaming or video editing on Hyper-V guest. == Requirements == * Need a GPU that supports GPU virtualization, such as NVIDIA GRID or AMD MxGPU technology * Your CPU needs to support IOMMU (Input-Output Memory Management Unit) virtualization, which is required for GPU passthrough * GPU passthrough is not sup...") Tag: Visual edit
  • 04:50, 12 December 2023 Admin talk contribs moved page Manual:DLSSystem/Validation to Manual:DLSSystem/stress-ng
  • 11:59, 10 December 2023 Admin talk contribs created page Smartctl (Created page with "The smartctl Command Line Tool of Smartmontools is primarily used to query SMART attributes of hard drives and SSDs.<ref>https://www.thomas-krenn.com/en/wiki/Smartmontools_with_MegaRAID_Controller</ref> == Check RAID array list == can display which disks of the RAID controller are accessible. cat /proc/scsi/scsi == smartctl over LSI array == smartctl provides integrated support for MegaRAID controller sudo smartctl -a -d megaraid,N /dev/sdX Where <N> stands for the...") Tag: Visual edit
  • 11:56, 10 December 2023 Admin talk contribs created page Hardware RAID information on Linux (Created page with "== Detect hardware RAID information == <syntaxhighlight lang="bash"> #Detect HW RAID controller information $lspci -knn | grep -i raid # install apt-get install lsscsi then list up HW raid manufacturer and model $lsscsi # Display the details about harddrives $lshw -class disk # 1 Find defined raid arrays then get device information $dmesg | grep -i scsi $smartctl --all /dev/<raid array> # To check physical disk health values smartctl --all -d <driver> command $ su...") Tag: Visual edit
  • 11:51, 10 December 2023 Admin talk contribs created page S.M.A.R.T. Attributes (Created page with "'''S.M.A.R.T.''' ('''Self-Monitoring, Analysis and Reporting Technology'''; written as SMART) is a system for monitoring and early detection of errors of storage media such as hard disks or SSDs.  <ref>https://www.thomas-krenn.com/en/wiki/SMART_Attributes_documentation#SMART_Tests</ref> Most hard drives and SSDs have SMART functionality. However, the data provided by SMART, (SMART attributes), are different from manufacturer to manufacturer. == General reference only...") Tag: Visual edit
  • 14:20, 9 December 2023 Admin talk contribs created page Page cache in Linux (Created page with "== cached vs buffers == Linux is a general purpose operating system instead of having specific code paths to perform what is right for a single specific task. Linux uses all excess memory for its page cache. The linux page cache can be seen in /proc/meminfo with the statistic “Cached.” while The “Buffers” memory area is a memory area that holds raw disk data, meant as an intermediate buffer between processes, the kernel, and disk == Tuning the Page Cache == Pag...") Tag: Visual edit
  • 14:12, 9 December 2023 Admin talk contribs created page Tunable kernel params (Created page with " == vm.min_free_kbytes == vm.min_free_kbytes is used to force the Linux VM to keep a minimum number of kilobytes free. if this value to lower than 1024KB, the system will become subtly broken, and prone to deadlock under high loads. Setting this value too high will OOM your machine instantly. vm.min_free_kbytes effect to the amount of available memory display output from the command $free -m. Linux Wolfman described how vm.min_free_kbytes impact to system.<ref>https:/...") Tag: Visual edit
  • 14:00, 9 December 2023 Admin talk contribs moved page Kernel boot param to Kernel kernel param
  • 11:44, 7 December 2023 Admin talk contribs created page Iostat (Created page with "iostat<ref>https://github.com/i4oolish/iostat/tree/master</ref> is a command-line utility that reports CPU statistics and input/output statistics for devices and partitions. == iostat command == <syntaxhighlight lang="bash"> #The basic syntax of the iostat command $iostat [options] [interval [count]] #options: options can be used to specify the type of statistics to be displayed, such as disk statistics, CPU utilization statistics, etc. #interval: The interval paramete...") Tag: Visual edit
(newest | oldest) View ( | ) (20 | 50 | 100 | 250 | 500)
Retrieved from "http://wiki.hpcmate.com/index.php/Special:Log"