All public logs
Jump to navigation
Jump to search
Combined display of all available logs of HPCWIKI. You can narrow down the view by selecting a log type, the username (case-sensitive), or the affected page (also case-sensitive).
- 13:37, 16 December 2023 Admin talk contribs created page File:Cable connector pinout.png
- 13:37, 16 December 2023 Admin talk contribs uploaded File:Cable connector pinout.png
- 13:22, 16 December 2023 Admin talk contribs created page File:GPU cable pinout.png
- 13:22, 16 December 2023 Admin talk contribs uploaded File:GPU cable pinout.png
- 10:42, 13 December 2023 Admin talk contribs created page Manual:DLSSystem/MultipleR (Created page with "As an optional pre-installed software package, DLS ship with multiple R versions modules. TODO == Automated setup scripts == * [https://support.posit.co/hc/en-us/articles/215488098-Installing-multiple-versions-of-R-on-Linux Installing multiple versions of R on Unbunt] == References == <references />") Tag: Visual edit
- 07:42, 12 December 2023 Admin talk contribs created page Setup logwatch on Ubuntu (Created page with " A log file is a collection of events and activities that have occurred over a specified period of time. The containing too much detailed and repeated information make system administrator very difficult to go through all logs. Logwatch is a customizable tool that analyzes system log files based on areas you specify. It then generates the report of what is happening on the server and email it to the specified address if you want == Setup logwatch == <syntaxhighlight l...") Tag: Visual edit
- 05:18, 12 December 2023 Admin talk contribs created page Hyper-V GPU passthrough (Created page with "Hyper-V supports is GPU passthrough, a feature that allows virtual machines to access the host’s GPU directly. this feature allows graphics intensive workloads like gaming or video editing on Hyper-V guest. == Requirements == * Need a GPU that supports GPU virtualization, such as NVIDIA GRID or AMD MxGPU technology * Your CPU needs to support IOMMU (Input-Output Memory Management Unit) virtualization, which is required for GPU passthrough * GPU passthrough is not sup...") Tag: Visual edit
- 04:50, 12 December 2023 Admin talk contribs moved page Manual:DLSSystem/Validation to Manual:DLSSystem/stress-ng
- 11:59, 10 December 2023 Admin talk contribs created page Smartctl (Created page with "The smartctl Command Line Tool of Smartmontools is primarily used to query SMART attributes of hard drives and SSDs.<ref>https://www.thomas-krenn.com/en/wiki/Smartmontools_with_MegaRAID_Controller</ref> == Check RAID array list == can display which disks of the RAID controller are accessible. cat /proc/scsi/scsi == smartctl over LSI array == smartctl provides integrated support for MegaRAID controller sudo smartctl -a -d megaraid,N /dev/sdX Where <N> stands for the...") Tag: Visual edit
- 11:56, 10 December 2023 Admin talk contribs created page Hardware RAID information on Linux (Created page with "== Detect hardware RAID information == <syntaxhighlight lang="bash"> #Detect HW RAID controller information $lspci -knn | grep -i raid # install apt-get install lsscsi then list up HW raid manufacturer and model $lsscsi # Display the details about harddrives $lshw -class disk # 1 Find defined raid arrays then get device information $dmesg | grep -i scsi $smartctl --all /dev/<raid array> # To check physical disk health values smartctl --all -d <driver> command $ su...") Tag: Visual edit
- 11:51, 10 December 2023 Admin talk contribs created page S.M.A.R.T. Attributes (Created page with "'''S.M.A.R.T.''' ('''Self-Monitoring, Analysis and Reporting Technology'''; written as SMART) is a system for monitoring and early detection of errors of storage media such as hard disks or SSDs. <ref>https://www.thomas-krenn.com/en/wiki/SMART_Attributes_documentation#SMART_Tests</ref> Most hard drives and SSDs have SMART functionality. However, the data provided by SMART, (SMART attributes), are different from manufacturer to manufacturer. == General reference only...") Tag: Visual edit
- 14:20, 9 December 2023 Admin talk contribs created page Page cache in Linux (Created page with "== cached vs buffers == Linux is a general purpose operating system instead of having specific code paths to perform what is right for a single specific task. Linux uses all excess memory for its page cache. The linux page cache can be seen in /proc/meminfo with the statistic “Cached.” while The “Buffers” memory area is a memory area that holds raw disk data, meant as an intermediate buffer between processes, the kernel, and disk == Tuning the Page Cache == Pag...") Tag: Visual edit
- 14:12, 9 December 2023 Admin talk contribs created page Tunable kernel params (Created page with " == vm.min_free_kbytes == vm.min_free_kbytes is used to force the Linux VM to keep a minimum number of kilobytes free. if this value to lower than 1024KB, the system will become subtly broken, and prone to deadlock under high loads. Setting this value too high will OOM your machine instantly. vm.min_free_kbytes effect to the amount of available memory display output from the command $free -m. Linux Wolfman described how vm.min_free_kbytes impact to system.<ref>https:/...") Tag: Visual edit
- 14:00, 9 December 2023 Admin talk contribs moved page Kernel boot param to Kernel kernel param
- 11:44, 7 December 2023 Admin talk contribs created page Iostat (Created page with "iostat<ref>https://github.com/i4oolish/iostat/tree/master</ref> is a command-line utility that reports CPU statistics and input/output statistics for devices and partitions. == iostat command == <syntaxhighlight lang="bash"> #The basic syntax of the iostat command $iostat [options] [interval [count]] #options: options can be used to specify the type of statistics to be displayed, such as disk statistics, CPU utilization statistics, etc. #interval: The interval paramete...") Tag: Visual edit
- 11:24, 7 December 2023 Admin talk contribs created page IOPS (Created page with "“IOPS” stands for “Input/Output Operations Per Second.” IOPS is an important performance metric for storage devices that shows number of read/write operations that a storage device can perform per second. A high IOPS number means that a storage device is capable of performing a large number of read and write operations in a very short amount of time. This can be beneficial for applications and systems that require fast and efficient access to storage resources....") Tag: Visual edit
- 09:44, 5 December 2023 Admin talk contribs created page File:4th gen intel packages.png
- 09:44, 5 December 2023 Admin talk contribs uploaded File:4th gen intel packages.png
- 09:37, 5 December 2023 Admin talk contribs created page File:4th gen intel config.png
- 09:37, 5 December 2023 Admin talk contribs uploaded File:4th gen intel config.png
- 17:26, 28 November 2023 Admin talk contribs created page Apache Spark (Created page with "== Apache Spark == Apache Spark<ref>https://spark.apache.org/</ref> is an open-source developed at UC Berkeley in Scala, Spark is a multi-language unified engine for large-scale data analytics, data science, and machine learning on single-node machines or clusters. Spark can easily support multiple workloads ranging from batch processing, interactive querying, real-time analytics to machine learning and graph processing. Unlike many other platforms with limited option...") Tag: Visual edit
- 13:07, 28 November 2023 Admin talk contribs created page Jupyter (Created page with "== Project Jupyter == [https://jupyter.org/ Project Jupyter] is a non-profit, open-source project, born out of the IPython Project in 2014 as it evolved to support interactive data science and scientific computing across all programming languages. Jupyter will always be 100% open-source software, free for all to use and released under the liberal terms of the modified BSD license. Jupyter would be one of the great platform in education for [https://jupyter4edu.github.io...") Tag: Visual edit
- 12:00, 28 November 2023 Admin talk contribs created page IPython (Created page with "IPython IPython provides a rich architecture for interactive computing. IPython itself is focused on interactive Python, part of which is providing a Python kernel for Jupyter. [https://ipython.readthedocs.io/en/stable/index.html This URL] describes more about features by version of IPython == IPython and Python version compatiblity == Beginning with version 6.0, IPython '''<u>stopped supporting compatibility with Python versions lower than 3.3 including all versions...") Tag: Visual edit
- 17:41, 27 November 2023 Admin talk contribs created page Private:DLS jupyter conda (Created page with "== How to set PATH and LD_LIBRARY_PATH from conda to Jupyter note == Using this method, we can share whatever env vironment variables from host to Jupyter node === start up code === <syntaxhighlight lang="bash"> # Create shell script that will start and exports what we need @ /opt/anaconda/envs/bi310/bin/startup.sh # following example is export R home and library for R #!/bin/bash export R_HOME=/opt/anaconda/envs/bi310/lib/R export PATH=/opt/anaconda/envs/bi310/bin:$R...") Tag: Visual edit
- 10:16, 24 November 2023 Admin talk contribs created page Private:PAHE firmware (Created page with " == Step to step to generate PA/HE == # Create pigen image at 192.168.1.61:/opt/imp/home/prj/pigen/pi-gen # Deployment image comes out at /opt/imp/home/prj/pigen/pi-gen/deploy # Create bootable image using Rufus # Tunning ## Disable logo ## Disable wifi ## Enable PA or HE software # Lock SD Card ## make readonly SD card and overlay file system<ref>https://core-electronics.com.au/guides/read-only-raspberry-pi/</ref> == Issues == # SD card curruption by disconnecting...") Tag: Visual edit
- 09:26, 19 November 2023 Admin talk contribs created page Privatre:bioinfomatics (Created page with "{| class="wikitable" |+ !Libraries !Description !References |- |Samtools |SAM (Sequence Alignment/Map) format is a generic format for storing large nucleotide sequence alignments | * https://samtools.sourceforge.net/ * https://sourceforge.net/projects/samtools/files/samtools/ * https://github.com/samtools/samtools/blob/develop/INSTALL |- | | | |- | | | |} == References == <references />") Tag: Visual edit
- 09:55, 17 November 2023 Admin talk contribs created page AMD Bergamo (97x4) (Created page with "AMD announced high density “Bergamo” server CPU series based on AMD’s density-optimized Zen 4c architecture, the new EPYC 97x4 chips offer up to 128 CPU cores in Jun, 2023. == Bergamo (97x4) SKU<ref>https://www.amd.com/en/products/processors/server/epyc/4th-generation-9004-and-8004-series.html#tabs-4380fde236-item-5551f74ba6-tab</ref> == {| class="wikitable" | colspan="9" |AMD EPYC 97x4 Bergamo Processors |- |''AnandTech'' | colspan="2" rowspan="1" |Core/ Thread |...") Tag: Visual edit
- 12:13, 16 November 2023 Admin talk contribs created page Private:Feed and speed (Created page with " == Fliction drill <ref>https://montfort-international.com/en/flowdrill-tool/</ref> == {| class="wikitable" ! rowspan="2" |Thread Size ! colspan="4" |Flowdrill !Flowtap |- !Flowdrill Ø (mm) !Spindle Speed (min-1) !Motor Power (Kw) !Process Time (s) !Spindle Speed (min-1) |- |M2 |1.8 |3200 |0.5 |2 |1600 |- |M3 |2.7 |3000 |0.6 |2 |1350 |- |M4 |3.7 |2600 |0.7 |2 |1000 |- |M5 |4.5 |2500 |0.8 |2 |800 |- |M6 |5.4 |2400 |1.0 |2 |650 |- |M8 |7.3 |2200 |1.3 |2 |500 |- |M10 |9.2...") Tag: Visual edit
- 16:10, 15 November 2023 Admin talk contribs moved page Private:UCM overleaf to Manual:UCM overleaf
- 12:20, 15 November 2023 Admin talk contribs created page Container tips and tricks (Created page with " == Find container root folder in host == <syntaxhighlight lang="bash"> # Get container root directory path $ container_root=$(sudo docker inspect --format '{{.GraphDriver.Data.MergedDir}}' <container_id>) # Then we can access by creating a symlink to any subdirectory or file within the container $ sudo ln -s "$container_root/</path/to/mount>" <symlink_name> </syntaxhighlight> == References == <references />") Tag: Visual edit
- 13:49, 12 November 2023 Admin talk contribs moved page Manual:Standalone Overleaf to Private:Standalone Overleaf
- 13:49, 12 November 2023 Admin talk contribs created page Manual:Standalone Overleaf (Created page with "== About Overleaf == Overleaf is an open-source online real-time collaborative LaTeX editor that by merged ShareLaTeX in 2017<ref>https://www.overleaf.com/blog/sharelatex-joins-overleaf-2017-07-20</ref>. So there is no ShareLaTex standalone version anymore. == Setup Private Overleaf == Overleaf community edition comes with pretty simple installation toolkit through the [https://github.com/overleaf/toolkit/blob/master/doc/quick-start-guide.md quick-start-guide] === 0....") Tag: Visual edit
- 15:55, 11 November 2023 Admin talk contribs created page Swap partition (Created page with "== What is swap ? == Swap partition acts as a disk memory in Linux when the RAM is exhausted, your Linux system uses part of the hard disk memory and allocates it to the running application. Although Linux can run without swap partition if the system has plenty of RAM, a little amount of swap is always advisable. In fact, a distribution like Ubuntu automatically creates a swap file of 2 GB in size. This should give you an indication that having some swap space is recomm...") Tag: Visual edit
- 15:39, 11 November 2023 Admin talk contribs created page Private:UCM overleaf (Created page with "== Overleaf == Overleaf is An open-source online real-time collaborative LaTeX editor<ref>https://github.com/overleaf/overleaf</ref> == UCM integration == Among multiple UCM plugin, HPCMATE provides Overleaf docker container for UCM or DLS customers. registry.hpcmate.com >>>> TODO == References == <references />") Tag: Visual edit
- 09:55, 11 November 2023 Admin talk contribs created page Private:CNC (Created page with " == Current running version information == LinuxCNC 2.8.2 $ probe_basic -v QtPyVCP v0.3.19, Probe Basic v0.4.0 == References == <references />") Tag: Visual edit
- 13:13, 29 October 2023 Admin talk contribs created page Bazel (Created page with "Bazel is a tool that '''automates software builds and tests'''. Supported build tasks include running compilers and linkers to produce executable programs and libraries, and assembling deployable packages for Android, iOS and other target environments<ref>https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=2ahUKEwix_f67rJqCAxUErlYBHc29CNkQFnoECAkQAw&url=https%3A%2F%2Fbazel.build%2Fabout%2Ffaq&usg=AOvVaw2LTedC5jnCi-zPHaBwVp9D&opi=89978449</re...") Tag: Visual edit
- 14:36, 27 October 2023 Admin talk contribs created page Find PCIe device location in system (Created page with "In GPGPU system for AI, it is common to install multiple same model of GPU on multiple PCIe bus in one system. When one or more specific located GPU needs to replace or maintaining, how to identify the location of specific GPU in the sytem? In Linux, there is a way to find out which PCI card is plugged into which PCI slot. For example, if there is two identical GPUs in a system we can identify where they are located with following step<syntaxhighlight lang="bash...") Tag: Visual edit
- 19:29, 26 October 2023 Admin talk contribs created page File:DLS-multiversion-compilers.png
- 19:29, 26 October 2023 Admin talk contribs uploaded File:DLS-multiversion-compilers.png
- 19:45, 22 October 2023 Admin talk contribs created page Types of VRAM (Created page with "When discussing AI using GPU, training is very compute-intensive and requires the highest system bandwidth possible. while inference is more common and not quite as bandwidth hungry as training. in both case, VRAM ('''V'''ideo '''R'''andom '''A'''ccess '''M'''emory) is one of the key component along with GPU processor for better performance. == VRAM Performance == Artificial intelligence (AI), machine learning (ML), deep learning (DL), autonomous driving, high-perfo...") Tag: Visual edit
- 18:40, 22 October 2023 Admin talk contribs created page File:PCIe-12pin-cable.png
- 18:40, 22 October 2023 Admin talk contribs uploaded File:PCIe-12pin-cable.png
- 18:39, 22 October 2023 Admin talk contribs created page File:PCIe-8pin-cable.png
- 18:39, 22 October 2023 Admin talk contribs uploaded File:PCIe-8pin-cable.png
- 18:38, 22 October 2023 Admin talk contribs created page File:Pcie-6pin-cable.png
- 18:38, 22 October 2023 Admin talk contribs uploaded File:Pcie-6pin-cable.png
- 13:51, 22 October 2023 Admin talk contribs created page File:PCIe Spec.png
- 13:51, 22 October 2023 Admin talk contribs uploaded File:PCIe Spec.png
- 13:41, 22 October 2023 Admin talk contribs created page Power cables and connectors (Created page with "Whether you are a seasoned veteran or a newcomer to the the server system building it is essential to understand the various power cables and connectors required to safely power PCIe computing units such as GPU. So we made an summary to ensure that the system runs smoothly without any crashes, and will also prevent potential disasters like electrical fires or damaged hardware. == Different Types Of Gpu Power Connectors == GPU consume power from PCIe and power cables,...") Tag: Visual edit
- 13:16, 16 October 2023 Admin talk contribs created page Samba (Created page with "== SMB (Samba) == SMB - "Server Message Block" - is a file sharing protocol that was invented by IBM and has been around since the mid-eighties. SMB is a protocol meaning an agreed upon way of communicating between systems. The SMB protocol was designed to allow computers to read and write files to a remote host over a local area network (LAN). == CIFS == CIFS - “Common Internet File System.”- is a ''particular implementation'' of the Server Message Block prot...") Tag: Visual edit