Slurm Scripts and 2013 GPUs
Taki Users:
After this weekend's unscheduled downtime, much of the cluster is back in working order.
Two Important Updates:
1) We took advantage of the unscheduled downtime to make an update to slurm to resolve some issues we were seeing affecting many users. A consequence of this is that users must now specify the slurm account to which they would like to charge their slurm job. For example, a user belonging to UNIX group "pi_professor" would need to add the line:
#SBATCH --account=pi_professor
to their slurm submission scripts. Failure to make this specification will result in a sbatch submission error "sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified".
The HPCF Webpage will be updated to reflect this change.
2) We have to physically investigate the 2013 GPUs before they are brought back online. These should be booting now and available in the next thirty minutes.
]]>
Taki Users: After this weekend's unscheduled downtime, much of the cluster is back in working order. Two Important Updates: 1) We took advantage of the unscheduled downtime to make an...
http://hpcf.umbc.edu
https://beta.my.umbc.edu/api/v0/pixel/news/85941/guest@my.umbc.edu/64dec7810a4684f4e8be9d2833a4a024/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
true
Mon, 19 Aug 2019 09:16:04 -0400
Unscheduled Downtime (taki)
Taki Users:
Earlier today (Sunday, August 18) we noticed many nodes (nearly all) become unavailable. We are currently working to bring these nodes back up and identify the original issue.
A few jobs had to be administratively cancelled in this process.
At the time of this writing, more than half of the nodes are back online and the remaining half are booting. None are exhibiting behaviors indicative of any further issue.
Let us know if you notice any abnormal behavior.
]]>
Taki Users: Earlier today (Sunday, August 18) we noticed many nodes (nearly all) become unavailable. We are currently working to bring these nodes back up and identify the original issue....
https://beta.my.umbc.edu/api/v0/pixel/news/85936/guest@my.umbc.edu/154bf9324b6a100477c25d0c923ee425/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
1
0
true
Sun, 18 Aug 2019 18:12:19 -0400
Scheduled Downtime
Access to the taki cluster will be restricted tomorrow from 5-7pm. Please make every attempt to finish jobs before 5pm. Any progress with jobs after 5pm will be lost.
]]>
Access to the taki cluster will be restricted tomorrow from 5-7pm. Please make every attempt to finish jobs before 5pm. Any progress with jobs after 5pm will be lost.
https://beta.my.umbc.edu/api/v0/pixel/news/85823/guest@my.umbc.edu/89726e67c88a787715f9e40599f94a6c/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
true
Mon, 12 Aug 2019 09:11:33 -0400
Downtime Window (2 parts)
1. For purposes of workflow management, note that the HPCF may have downtime scheduled every Tuesday from 5p-9p. In the event that downtime is scheduled: a posting on this page will be made.
2. We will be taking downtime next Tuesday (July 9, 2019) from 5p-9p. The purpose of this downtime is to put new software packages and file systems in place.
]]>
1. For purposes of workflow management, note that the HPCF may have downtime scheduled every Tuesday from 5p-9p. In the event that downtime is scheduled: a posting on this page will be made....
https://beta.my.umbc.edu/api/v0/pixel/news/85259/guest@my.umbc.edu/cabbd5046cbfc04269922be0b9f87d68/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
true
Wed, 03 Jul 2019 13:18:34 -0400
Taki Online
The taki cluster is recovering from the downtime due to this week’s scheduled power maintenance. As we bring the partitions up, users can now access the log-in node as well as research storage. Note that not all partitions are operational at this time. Therefore, some patience may be required when submitting slurm jobs.
We are making use of the downtime to address lingering inconsistencies between the partitions. As the remaining nodes come online by COB today (Juneteenth), please alert us to any issues you experience via the RT-Research Computing ticket queue.
]]>
The taki cluster is recovering from the downtime due to this week’s scheduled power maintenance. As we bring the partitions up, users can now access the log-in node as well as research storage....
https://beta.my.umbc.edu/api/v0/pixel/news/85041/guest@my.umbc.edu/93a9113c7a302c588b130e55390a9752/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
false
Wed, 19 Jun 2019 08:29:08 -0400
Scheduled Downtime
Due to scheduled maintenance on the HPC power distribution units in the
Research Park Data Center, we will be cancelling all jobs and
powering-off the taki cluster at 5pm on June 17. We plan to have taki
fully operational again by no later than 5pm of June 19th. Thank you for
your understanding and patience as we approach June 17th.
]]>
Due to scheduled maintenance on the HPC power distribution units in the Research Park Data Center, we will be cancelling all jobs and powering-off the taki cluster at 5pm on June 17. We plan to...
https://beta.my.umbc.edu/api/v0/pixel/news/85018/guest@my.umbc.edu/f7bd91545f5aa4e7b525fcab62ba1139/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
true
Tue, 18 Jun 2019 09:40:48 -0400
Tue, 18 Jun 2019 09:41:05 -0400