 |
|
You are here: Foswiki>WebDocumentation Web>WebChanges (28 Oct 2024, AdminUser)Edit Attach
50 recent changes in WebDocumentation Web retrieved at 15:35 (GMT)
UsingTensorflowWithMultipleGPUs
With GPU support, you can significantly improve the performance of a Deep Learning model built with Tensorflow. Running a model with a single GPU is very simple. ...
r3 - 28 Oct 2024 - 21:35 by AdminUser
UsingVectorEnginesOnArc
Using NEC SX Aurora Vector Engines On Arc This guide provides an overview of the NEC SX Aurora TSUBASA Vector Engines (VE) nodes available on the Arc HPC Cluster....
r9 - 28 Oct 2024 - 21:35 by AdminUser
AboutArcCluster
About Arc Cluster Arc is UTSA's primary high performance (HPC) resource; utilized by researchers, students, faculty and staff from a broad range of disciplines. C...
r6 - 28 Oct 2024 - 21:35 by TrevorNash
ApplicationCheckpointingAndRestartOnArc
Checkpointing is the process of saving the execution state of an application such that this saved state can be used to continue the execution at a later time. Typ...
r11 - 28 Oct 2024 - 21:35 by AdminUser
ArcFairUsePolicy
Arc Fair Use Policy Active Jobs Compute nodes are not shared among multiple users. Instead, when a user grabs a compute node, they will be the only user allowed ...
NEW - 28 Oct 2024 - 21:35 by AdminUser
CProgrammingWithSelf-DefinedCheckpoint-and-Restart
Checkpoint and restart with DMTCP or tools can create large disk images, and the checkpoint details are controlled by the third party system. To avoid the problem...
r3 - 28 Oct 2024 - 21:35 by AdminUser
Checkpoint-and-RestartForR
If your R script is expected to run beyond the 72 hour limit on Arc, we suggest implementing a checkpointing and restart mechanism in your script. This will help ...
r3 - 28 Oct 2024 - 21:35 by AdminUser
FAQ
Frequently Asked Questions Who can use Arc? The Arc research cluster is available at no charge to all University of Texas at San Antonio students, faculty and st...
NEW - 28 Oct 2024 - 21:35 by AdminUser
FOSWikiVersion-LoggingIntoArcAndSubmittingJobs
Table of Contents LOGGING INTO ARC. 1 ACCESSING COMPUTE NODES ON ARC. 1 RUNNING JOBS INTERACTIVELY WITH THE SRUN COMMAND.. 3 SUBMITTING BATCH JOBS WITH THE SBATCH...
NEW - 28 Oct 2024 - 21:35 by AdminUser
Faculty
How to request an account on Arc for Faculty Faculty members who wish to have an account on Arc must submit their request via the form at https://utsa.az1.qualtri...
NEW - 28 Oct 2024 - 21:35 by AdminUser
GPU
Sample GPU submit script using the Caffe training network Using the Tesla K80 cards: #SBATCH partition="gpu" #SBATCH nodes=1 #SBATCH gres=gpu:k80:1 . /etc/pr...
NEW - 28 Oct 2024 - 21:35 by AdminUser
GettingHelp
Getting Help Submit a Service Request Follow this link to access your ServiceNow portal. At the homepage, select the Research tile and select the category for ...
NEW - 28 Oct 2024 - 21:35 by AdminUser
HTMLVersion-LoggingIntoArcAndSubmittingJobs
Table of Contents LOGGING INTO ARC. 1 ACCESSING COMPUTE NODES ON ARC. 1 RUNNING JOBS INTERACTIVELY WITH THE SRUN COMMAND.. 3 SUBMITTING BATCH JOBS WITH THE SBATCH...
r2 - 28 Oct 2024 - 21:35 by AdminUser
JavaEnvironment
JAVA Environment JAVA is a high level object oriented programming language that is designed to minimize implementation dependencies. It is a class based general p...
r5 - 28 Oct 2024 - 21:35 by AdminUser
LoggingIntoArcAndSubmittingJobs
Table of Contents LOGGING INTO ARC. 1 ACCESSING COMPUTE NODES ON ARC. 1 RUNNING JOBS INTERACTIVELY WITH THE SRUN COMMAND.. 3 SUBMITTING BATCH JOBS WITH THE SBATCH...
NEW - 28 Oct 2024 - 21:35 by AdminUser
ManagingYourFiles
Managing your Files Users on Arc are automatically granted several locations to store their files. Most users will be storing their files in one of two locations,...
r4 - 28 Oct 2024 - 21:35 by AdminUser
MigratingDataToArc
Migrating Data From Shamu to Arc This guide provides several tools for migrating data from the legacy Shamu HPC environment to the new Arc HPC environment. In som...
r11 - 28 Oct 2024 - 21:35 by AdminUser
ModuleEnvironments
Module Environments A module system helps in managing access to the software packages and versions that you need. If there are multiple versions of a software ava...
r6 - 28 Oct 2024 - 21:35 by AdminUser
MonitoringYourJobs
Monitoring your jobs Using the squeue Command Check the status of all jobs on Arc using the squeue command (this is just an example compute names may be differe...
r2 - 28 Oct 2024 - 21:35 by AdminUser
OpenMPI
OpenMPI Submit Script #!/bin/bash # #$ S /bin/bash export MYAPP=./test_openmpi export MYAPP_FLAGS='' #$ N TEST_OPENMPI #$ pe openmpi 4 . /etc/profile.d/...
NEW - 28 Oct 2024 - 21:35 by AdminUser
PythonDependencyJob
If you have a Python script that is expected to run more than 72 hours on Arc, we suggest you break it into a few smaller tasks, so that each of the tasks runs le...
r3 - 28 Oct 2024 - 21:35 by AdminUser
PythonVMsInAnaconda
If you need to install your own programs/modules in python you can do it via creating vms. Some programs may need specific versions of modules to work correctly a...
r2 - 28 Oct 2024 - 21:35 by AdminUser
QueueDefinitions
Main.AdminUser 29 Jun 2021
NEW - 28 Oct 2024 - 21:35 by AdminUser
RTroubleshooting-FixingACorruptedLibraryDirectoryUsingBioconductor
If the user uses bioconductor for biology projects in R and their R library becomes corrupted you can do this command in the R prompt. BiocManager::valid() At t...
NEW - 28 Oct 2024 - 21:35 by AdminUser
RestartScriptGenerationExample
Here's a simple example of a checkpointing program being run with a slurm job script that will automatically generate a restart script for when you need to restar...
r3 - 28 Oct 2024 - 21:35 by AdminUser
RunningJobs
Running jobs on Arc * Submitting your Batch Job Submit your code to run on the compute nodes. Create a submission script and specify options for better j...
NEW - 28 Oct 2024 - 21:35 by AdminUser
SavingAndImportingPythonEnvironments
It's handy to make a package list from your conda virtual environment in case you install something that breaks it or you want to replicate the packages exactly o...
r2 - 28 Oct 2024 - 21:35 by AdminUser
SavingTheEnvironmentInWorkDirectory
Python virtual environments (VE )are saved in your home directory by default. However, in case you are running out of space in your home directory, you can save t...
r2 - 28 Oct 2024 - 21:35 by AdminUser
SavingTheRLibrariesInWorkDirectory
The base R package is provided on Arc via modules on the compute nodes. First, start an interactive session on a compute node by tpying: srun p compute1 n 1 t ...
r2 - 28 Oct 2024 - 21:35 by AdminUser
ShamuFairUsePolicy
Arc Fair Use Policy Active Jobs Compute nodes will no longer be shared among multiple users. Instead, when a user grabs a compute node, they will be the only use...
NEW - 28 Oct 2024 - 21:35 by AdminUser
SimpleCheckpointAndRestartForPythonUsingAClass
This is a simple example of a program that checkpoints using python and the pickle class. It will run for 15 minutes. The script checks for a file called "countin...
r4 - 28 Oct 2024 - 21:35 by AdminUser
SoftwareAvailable
Pasted below is the list of software packages that are available on Arc (as of August 23, 2021) through system wide modules. This list will likely change over tim...
NEW - 28 Oct 2024 - 21:35 by AdminUser
TechSupport
Technical Support * For technical support, you can submit a support request for Arc at the following link: https://support.utsa.edu/myportal. Instructions for ...
NEW - 28 Oct 2024 - 21:35 by AdminUser
UseSlurmOnArc
Slurm (Simple Linux Utility for Resource Management) is a highly configurable workload manager and job scheduler for an HPC cluster. It is open source software ba...
r2 - 28 Oct 2024 - 21:35 by AdminUser
UsingAbaqusOnArc
ABAQUS on Arc The ABAQUS software suite from Dassault Systems is used for finite element analysis and computer aided engineering. The ABAQUS software is used in t...
r4 - 28 Oct 2024 - 21:35 by AdminUser
UsingContainersOnArc
Singularity is available on Arc for running containerized applications that have images built using Docker or Singularity. Users can access the software via the m...
r3 - 28 Oct 2024 - 21:35 by AdminUser
UsingNamdOnArc
NAMD is a computer software application for molecular dynamics simulation. We have MPI and multiple core versions installed on Arc. The software is accessible via...
r5 - 28 Oct 2024 - 21:35 by AdminUser
UsingPyTorchOnArc
OVERVIEW PyTorch is a Python based scientific computing package. It is an automatic differentiation library that is useful to implement neural networks. Just like...
r2 - 28 Oct 2024 - 21:35 by AdminUser
UsingPyTorchWithMultipleGPUDevicesAcrossMultipleNodes
Here is an article about how to train a PyTorch based Deep Learning model using multiple GPU devices across multiple nodes on an HPC cluster: https://tuni itc.git...
NEW - 28 Oct 2024 - 21:35 by AdminUser
UsingPyTorchWithMultipleGPUs
PyTorch is a Python based machine learning framework that can run on both CPUs and GPUs. It supports options for taking advantage of GPUs on single nodes or multi...
r10 - 28 Oct 2024 - 21:35 by AdminUser
UsingTACCSResources
https://portal.tacc.utexas.edu/user guides To use TACC's Corral system you must request via TACC's User Portal for access: https://portal.tacc.utexas.edu/user g...
NEW - 28 Oct 2024 - 21:35 by AdminUser
UsingTheGPUResources
The GPU resources on Arc have been configured as a "consumable resource". This means you can request individual GPU cards, nodes, etc... We have two types of GPU ...
NEW - 28 Oct 2024 - 21:35 by AdminUser
UsingTheOnDemandPortal
***The OnDemand Portal is Currently not in Production on Arc We will notify users when it has become production ready*** We recently introduced the OnDemand Por...
r3 - 28 Oct 2024 - 21:35 by AdminUser
UsingTheSystems
Using the System * Managing your Files Store, manage and how to transfer files to Arc * Queue Definitions Queue definitions * Module Enviro...
r2 - 28 Oct 2024 - 21:35 by AdminUser
VirtualDesktop
To access the virtual desktop on ARC via the web, you must go to https://portal.arc.utsa.edu/ and log in with your UTSA id, passphrase, and DUO app. Once logged i...
r4 - 28 Oct 2024 - 21:35 by AdminUser
VisualizationUsingParaviewOnArc
ParaView (ParaView Website) is an open source application for visualizing two and three dimensional data sets. It is a multi platform parallel data analysis and ...
r5 - 28 Oct 2024 - 21:35 by AdminUser
WebAtom
Foswiki's WebDocumentation web
NEW - 28 Oct 2024 - 21:35 by AdminUser
NEW - 28 Oct 2024 - 21:35 by AdminUser
WebHome
Arc User Guide 1 Arc is the primary High Performance Computing (HPC) system at The University of Texas at San Antonio (UTSA) that can be used for running data in...
r69 - 28 Oct 2024 - 21:35 by AdminUser
Number of topics: 50
Page 1 of 2 Next >
See also:
RSS feed, recent changes with 50, 100, 200, 500, 1000 topics, all changes Edit | Attach | Print version | History: r1 | Backlinks | View wiki text | Edit wiki text | More topic actions
Topic revision: r1 - 28 Oct 2024, AdminUser
ARC
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding Foswiki? Send feedback