Intermittent Connections to Storage Servers
To all taki users,
Today many of you experienced connection issues to your home or research directories. While the exact cause of the connection issue is still being worked-out, replacing the cables has resolved the immediate problem of repairing the connection between the taki cluster environment and the storage servers that hold user data and software.
As a result, some jobs relying on these storage locations might have failed. We apologize for any loss of jobs or workflow.
As always, please let us know if you have any questions.
If you notice an issue, please submit a descriptive RT Help Ticket via the following link:
Thank you for your understanding,
Roy Prouty
System Administrator, UMBC HPCF
Starting at around 1:30pm EDT, portions of the taki cluster environment became unavailable.
Staff were able to determine that a portion of our network infrastructure failed. The issue has since been addressed and system administrators are currently in the process of rebooting all machines to ensure a uniform state of all hardware.
At this time, the login nodes are available and portions of the cluster hardware are still powering back on.
We apologize for any loss of running jobs or workflow.
As always, please let us know if you have any questions.
If you notice an issue, please submit a descriptive RT Help Ticket via the following link:
Thank you for your understanding,
Roy Prouty
System Administrator, UMBC HPCF
]]>
To all taki users: Starting at around 1:30pm EDT, portions of the taki cluster environment became unavailable. Staff were able to determine that a portion of our network infrastructure...
https://beta.my.umbc.edu/api/v0/pixel/news/100037/guest@my.umbc.edu/08dd9e9e7330f68286655005d37b5b3d/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
false
Wed, 17 Mar 2021 18:19:10 -0400
Downtime Complete on taki-usr[1-2]
To All Taki Users,
Just a final note on this short downtime.
Both user nodes rebooted successfully.
As always, let us know with a detailed RT ticket if you notice any issue with the taki cluster environment.
Thank you for your patience,
Roy Prouty
HPCF System Administrator
Research Computing Specialist
We are planning a reboot of the login nodes (taki-usr1 and taki-usr2) today at 5pm. Reminders will be sent to all users on these nodes via active sessions starting at 4pm.
We'll stagger the reboots in the following way: taki-usr2 at 5pm, then taki-usr1 and 5:30. Both machines are expected to be back online by 6pm.
Any jobs running through the scheduler will be unaffected.
Thank you for your understanding,
Roy Prouty
HPCF System Administrator
Research Computing Specialist
We are planning a reboot of only the login nodes (taki-usr1 and taki-usr2) this coming Tuesday at 5pm. A reminder will be sent to all users on these nodes via the terminal starting at 4pm on Tuesday.
We'll stagger the reboots in the following way: taki-usr2 at 5pm, then taki-usr1 and 5:30. Both machines are expected to be back online by 6pm.
Any jobs running through the scheduler will be unaffected.
Thank you for your understanding,
Roy Prouty
HPCF System Administrator
Research Computing Specialist
]]>
To All Taki Users, We are planning a reboot of only the login nodes (taki-usr1 and taki-usr2) this coming Tuesday at 5pm. A reminder will be sent to all users on these nodes via the terminal...
https://beta.my.umbc.edu/api/v0/pixel/news/99001/guest@my.umbc.edu/9fc4b3f2155fdd2c7f6333df3ec5053a/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
false
Thu, 04 Feb 2021 12:59:28 -0500
Take Downtime Completed: Update
To All Taki Users,
The taki.rs.umbc.edu cluster environment remains online and accessible after this week's downtime.
The following partitions are active and accessible via slurm jobs: batch, interactive, gpu, high_mem, and develop
Additionally, the second login node is now available at taki-usr2.rs.umbc.edu.
Thank you to all users who have corresponded with us regarding changes and different experiences with the upgraded cluster environment.
Please continue to let us know if you run into any issues or challenges by submitting an RT ticket with as much information as possible. To do this, navigate to hpcf.umbc.edu, then select "HPCF Help Request Form" from the "Forms" dropdown menu.
Thank you for your understanding & patience,
Roy Prouty
HPCF System Administrator
Research Computing Specialist
The taki.rs.umbc.edu cluster is now back online.
User node taki-usr1 is available for users to access the cluster environment.
The batch, interactive, and high_mem partitions are available. The remaining partitions will be brought online in the next day.
Please note that there were updates to various aspects of the cluster environment as a part of this upgrade. Therefore some software packages compiled by groups or individual users may need to be recompiled.
If anyone has issues running jobs, please submit an RT ticket with as much information as possible in the usual way. That is, navigate to hpcf.umbc.edu, then select "HPCF Help Request Form" from the "Forms" dropdown menu.
Thank you for your understanding,
Roy Prouty
HPCF System Administrator
Research Computing Specialist
We are currently experiencing some issues with the upgrade. We continue to work with support services and external consultants to bring the cluster environment back online.
We will send another update later this evening.
Thank you for your understanding,
Roy Prouty
HPCF System Administrator
Research Computing Specialist
This is a reminder that taki is scheduled to be unavailable from 8AM today (Monday, January 25, 2021) to 5PM tomorrow (Tuesday, January 26, 2021).
We expect the system to be available before 5PM tomorrow. Keep an eye on updates from this myUMBC group for the latest news.
Thanks again for your understanding,
Roy Prouty
HPCF System Administrator
Research Computing Specialist
]]>
To All Taki Users, This is a reminder that taki is scheduled to be unavailable from 8AM today (Monday, January 25, 2021) to 5PM tomorrow (Tuesday, January 26, 2021). We expect the system to be...
https://beta.my.umbc.edu/api/v0/pixel/news/98646/guest@my.umbc.edu/8d9cf637ca50e05a602b2d4d9d102393/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
false
Mon, 25 Jan 2021 08:29:35 -0500
Day-long Downtime for HPCF
Downtime for management software upgrades
To All Taki Users,
The Taki cluster will be down from 8AM on Monday, January 25 to 5PM on Tuesday, January 26. This downtime will allow HPCF Administrators and an external consultant to upgrade critical software packages that manage various aspects of the cluster computing environment.
We do not expect that the upgrades will take the entire allotted time. The extra time allows us to navigate any difficulties with the upgrades. We will update the user community when the cluster is back online with a similar posting to this myUMBC Group.
Please note: All running jobs will be terminated, so plan long-running jobs accordingly.
Thank you for your understanding,
Roy Prouty
HPCF System Administrator
Research Computing Specialist
]]>
To All Taki Users, The Taki cluster will be down from 8AM on Monday, January 25 to 5PM on Tuesday, January 26. This downtime will allow HPCF Administrators and an external consultant to...
https://beta.my.umbc.edu/api/v0/pixel/news/98513/guest@my.umbc.edu/b40b00e96f2b2f0b189a9173d27ac65b/api/pixel
HPCF
https://beta.my.umbc.edu/groups/hpcf
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/original.png?1596736674
https://assets4-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxlarge.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xlarge.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/large.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/medium.png?1596736674
https://assets3-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/small.png?1596736674
https://assets2-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xsmall.png?1596736674
https://assets1-beta.my.umbc.edu/system/shared/avatars/groups/000/001/659/63ae3e64663572042ecdd0ef493c16e1/xxsmall.png?1596736674
HPCF
0
0
false
Tue, 19 Jan 2021 08:43:48 -0500