Batch Status

Summary

last updated: 20:48:01 17.02.2020

82 active nodes (60 used, 22 free)

4984 cores (3816 used, 1168 free)

62 running jobs, 197184:00:00 remaining core hours

12 waiting jobs, - waiting core hours

Nodes

toggle node display

Running Jobs (62)

color job queue user #proc #nodes ppn vmem t_remain t_req t_used started jobname hosts
276952 gpu sbhand2s 2 1 2 100GB 1:24:48 3:00:00:00 2:22:35:12 14.02.2020 22:12:49 ds_dc_0.06.sh wr18
276953 gpu sbhand2s 2 1 2 100GB 19:33:43 3:00:00:00 2:04:26:17 15.02.2020 16:21:44 ds_dc_0.08.sh wr16
276954 gpu sbhand2s 2 1 2 100GB 1:00:09:15 3:00:00:00 1:23:50:45 15.02.2020 20:57:16 ds_0.05.sh wr12
277636 any eromer2s 64 2 32 3GB 1:14:34:10 2:00:00:00 9:25:50 11:22:11 t_5_exp_c_200000_n_150000 wr12,wr43
277655 any eromer2s 64 2 32 3GB 1:18:26:14 2:00:00:00 5:33:46 15:14:15 t_5_exp_si_0.0001_sl_0.3 wr12,wr16
277656 any eromer2s 64 1 64 3GB 1:18:47:16 2:00:00:00 5:12:44 15:35:17 t_5_exp_si_0.0001_sl_0.7 wr96
277657 any eromer2s 64 1 64 3GB 1:18:47:16 2:00:00:00 5:12:44 15:35:17 t_5_exp_si_0.0001_sl_1.0 wr97
277663 any eromer2s 64 1 64 3GB 1:19:08:54 2:00:00:00 4:51:06 15:56:55 t_5_exp_si_0.001_sl_0.05 wr75
277664 any eromer2s 64 1 64 3GB 1:19:08:54 2:00:00:00 4:51:06 15:56:55 t_5_exp_si_0.001_sl_0.3 wr82
277665 any eromer2s 64 1 64 3GB 1:19:11:58 2:00:00:00 4:48:02 15:59:59 t_5_exp_si_0.001_sl_0.7 wr54
277666 any eromer2s 64 1 64 3GB 1:19:17:55 2:00:00:00 4:42:05 16:05:56 t_5_exp_si_0.001_sl_1.0 wr52
277670 any eromer2s 64 2 32 3GB 1:19:33:40 2:00:00:00 4:26:20 16:21:41 t_5_exp_si_0.0033_sl_0.0033 wr42,wr43
277671 any eromer2s 64 1 64 3GB 1:19:33:44 2:00:00:00 4:26:16 16:21:45 t_5_exp_si_0.0033_sl_0.01 wr56
277672 any eromer2s 64 1 64 3GB 1:19:35:45 2:00:00:00 4:24:15 16:23:46 t_5_exp_si_0.0033_sl_0.05 wr62
277673 any eromer2s 64 1 64 3GB 1:19:39:52 2:00:00:00 4:20:08 16:27:53 t_5_exp_si_0.0033_sl_0.3 wr70
277674 any eromer2s 64 1 64 3GB 1:19:39:52 2:00:00:00 4:20:08 16:27:53 t_5_exp_si_0.0033_sl_0.7 wr72
277675 any eromer2s 64 1 64 3GB 1:19:39:52 2:00:00:00 4:20:08 16:27:53 t_5_exp_si_0.0033_sl_1.0 wr78
277680 any eromer2s 64 1 64 3GB 1:19:39:52 2:00:00:00 4:20:08 16:27:53 t_5_exp_si_0.01_sl_0.01 wr66
277681 any eromer2s 64 1 64 3GB 1:19:42:24 2:00:00:00 4:17:36 16:30:25 t_5_exp_si_0.01_sl_0.05 wr58
277682 any eromer2s 64 1 64 3GB 1:19:56:09 2:00:00:00 4:03:51 16:44:10 t_5_exp_si_0.01_sl_0.3 wr63
277683 any eromer2s 64 1 64 3GB 1:20:01:39 2:00:00:00 3:58:21 16:49:40 t_5_exp_si_0.01_sl_0.7 wr57
277684 any eromer2s 64 1 64 3GB 1:20:03:20 2:00:00:00 3:56:40 16:51:21 t_5_exp_si_0.01_sl_1.0 wr60
277685 any eromer2s 64 1 64 3GB 1:20:17:23 2:00:00:00 3:42:37 17:05:24 t_5_exp_si_0.05_sl_0 wr64
277686 any eromer2s 64 1 64 3GB 1:20:25:02 2:00:00:00 3:34:58 17:13:03 t_5_exp_si_0.05_sl_0.0001 wr91
277687 any eromer2s 64 1 64 3GB 1:20:34:45 2:00:00:00 3:25:15 17:22:46 t_5_exp_si_0.05_sl_0.001 wr80
277688 any eromer2s 64 1 64 3GB 1:20:48:57 2:00:00:00 3:11:03 17:36:58 t_5_exp_si_0.05_sl_0.0033 wr95
277689 any eromer2s 64 2 32 3GB 1:20:55:42 2:00:00:00 3:04:18 17:43:43 t_5_exp_si_0.05_sl_0.01 wr17,wr43
277690 any eromer2s 64 2 32 3GB 1:20:57:03 2:00:00:00 3:02:57 17:45:04 t_5_exp_si_0.05_sl_0.05 wr18,wr43
277691 any eromer2s 64 1 64 3GB 1:21:05:41 2:00:00:00 2:54:19 17:53:42 t_5_exp_si_0.05_sl_0.3 wr61
277692 any eromer2s 64 1 64 3GB 1:21:16:42 2:00:00:00 2:43:18 18:04:43 t_5_exp_si_0.05_sl_0.7 wr68
277693 any eromer2s 64 1 64 3GB 1:21:17:35 2:00:00:00 2:42:25 18:05:36 t_5_exp_si_0.05_sl_1.0 wr89
277694 any eromer2s 64 1 64 3GB 1:21:21:27 2:00:00:00 2:38:33 18:09:28 t_5_exp_si_0.3_sl_0 wr67
277695 any eromer2s 64 1 64 3GB 1:21:21:45 2:00:00:00 2:38:15 18:09:46 t_5_exp_si_0.3_sl_0.0001 wr59
277696 any eromer2s 64 1 64 3GB 1:21:43:37 2:00:00:00 2:16:23 18:31:38 t_5_exp_si_0.3_sl_0.001 wr43
277697 any eromer2s 64 1 64 3GB 1:21:47:15 2:00:00:00 2:12:45 18:35:16 t_5_exp_si_0.3_sl_0.0033 wr88
277698 any eromer2s 64 1 64 3GB 1:21:53:00 2:00:00:00 2:07:00 18:41:01 t_5_exp_si_0.3_sl_0.01 wr92
277699 any eromer2s 64 1 64 3GB 1:23:05:47 2:00:00:00 54:13 19:53:48 t_5_exp_si_0.3_sl_0.05 wr79
277700 any eromer2s 64 1 64 3GB 1:23:12:08 2:00:00:00 47:52 20:00:09 t_5_exp_si_0.3_sl_0.3 wr90
277701 any eromer2s 64 1 64 3GB 1:23:12:16 2:00:00:00 47:44 20:00:17 t_5_exp_si_0.3_sl_0.7 wr84
277702 any eromer2s 64 1 64 3GB 1:23:21:55 2:00:00:00 38:05 20:09:56 t_5_exp_si_0.3_sl_1.0 wr99
277703 any eromer2s 64 1 64 3GB 1:23:25:08 2:00:00:00 34:52 20:13:09 t_5_exp_si_0.7_sl_0 wr74
277704 any eromer2s 64 2 32 3GB 1:23:27:50 2:00:00:00 32:10 20:15:51 t_5_exp_si_0.7_sl_0.0001 wr14,wr43
277705 any eromer2s 64 1 64 3GB 1:23:30:12 2:00:00:00 29:48 20:18:13 t_5_exp_si_0.7_sl_0.001 wr55
277706 any eromer2s 64 1 64 3GB 1:23:37:38 2:00:00:00 22:22 20:25:39 t_5_exp_si_0.7_sl_0.0033 wr69
277707 any eromer2s 64 1 64 3GB 1:23:38:25 2:00:00:00 21:35 20:26:26 t_5_exp_si_0.7_sl_0.01 wr51
277708 any eromer2s 64 1 64 3GB 1:23:42:19 2:00:00:00 17:41 20:30:20 t_5_exp_si_0.7_sl_0.05 wr53
277709 any eromer2s 64 1 64 3GB 1:23:42:31 2:00:00:00 17:29 20:30:32 t_5_exp_si_0.7_sl_0.3 wr71
277710 any eromer2s 64 1 64 3GB 1:23:45:41 2:00:00:00 14:19 20:33:42 t_5_exp_si_0.7_sl_0.7 wr65
277711 any eromer2s 64 1 64 3GB 1:23:47:53 2:00:00:00 12:07 20:35:54 t_5_exp_si_0.7_sl_1.0 wr50
277712 any eromer2s 64 1 64 3GB 1:23:50:20 2:00:00:00 9:40 20:38:21 t_5_exp_si_1.0_sl_0 wr87
277713 any eromer2s 64 1 64 3GB 1:23:54:35 2:00:00:00 5:25 20:42:36 t_5_exp_si_1.0_sl_0.0001 wr81
277714 any eromer2s 64 1 64 3GB 1:23:57:21 2:00:00:00 2:39 20:45:22 t_5_exp_si_1.0_sl_0.001 wr83
277715 any eromer2s 64 1 64 3GB 1:23:58:35 2:00:00:00 1:25 20:46:36 t_5_exp_si_1.0_sl_0.0033 wr94
277748 any kkirsc3m 32 1 32 110GB 1:23:59:39 2:00:00:00 0:21 20:47:40 conformer-1-psi.run wr41
277611 hpc dgromm3m 128 2 64 96GB 2:10:59:08 3:00:00:00 13:00:52 7:47:09 start_mpi.sh wr85,wr93
277617 hpc dgromm3m 64 1 64 96GB 2:12:45:51 3:00:00:00 11:14:09 9:33:52 start_mpi.sh wr73
277618 hpc dgromm3m 64 1 64 96GB 2:13:02:19 3:00:00:00 10:57:41 9:50:20 start_mpi.sh wr76
277619 hpc dgromm3m 192 3 64 96GB 2:13:06:17 3:00:00:00 10:53:43 9:54:18 start_mpi.sh wr77,wr86,wr98
277133 gpu mwasil2s 64 1 64 64GB 2:15:14:50 3:00:00:00 8:45:10 12:02:51 tf_job wr19
277620 gpu4 mwasil2s 60 1 60 40GB 2:20:55:42 3:00:00:00 3:04:18 17:43:43 tf_job wr15
277508 gpu aprabh2s 2 1 2 170GB 2:20:57:03 3:00:00:00 3:02:57 17:45:04 job_boundary.sh wr17
277722 gpu4 mmuthu2s 4 1 4 100GB 2:22:56:27 3:00:00:00 1:03:33 19:44:28 job_Itr_21_gene5.sh wr15

Waiting/Blocked Jobs (12)

Jobs with any problems are highlighted. Check for these jobs whether your resource request can be satisfied by nodes in the queue (most probably not!).

job queue user state #proc #nodes ppn vmem t_req prio enqueued waiting jobname wait reason
277745 gpu mjohen2s PD 1 1 1 16GB 10:00 18280 18:46:52 2:01:09 Onboarding (Resources)
277723 gpu4 mmuthu2s PD 4 1 4 100GB 3:00:00:00 3271 13:20:45 7:27:16 job_Itr_21_gene2.sh (Resources)
277724 gpu4 mmuthu2s PD 4 1 4 100GB 3:00:00:00 3271 13:20:45 7:27:16 job_Itr_21_gene4.sh (Priority)
277725 gpu4 mmuthu2s PD 4 1 4 100GB 3:00:00:00 3271 13:20:45 7:27:16 job_Itr_21_gene3.sh (Priority)
277726 gpu4 mmuthu2s PD 4 1 4 100GB 3:00:00:00 3271 13:20:45 7:27:16 job_Itr_21_gene1.sh (Priority)
277720 any eromer2s PD 64 1 64 3GB 2:00:00:00 860 12:46:59 8:01:02 t_5_exp_si_1.0_sl_1.0 (Priority)
277716 any eromer2s PD 64 1 64 3GB 2:00:00:00 860 12:46:59 8:01:02 t_5_exp_si_1.0_sl_0.01 (Resources)
277717 any eromer2s PD 64 1 64 3GB 2:00:00:00 860 12:46:59 8:01:02 t_5_exp_si_1.0_sl_0.05 (Priority)
277718 any eromer2s PD 64 1 64 3GB 2:00:00:00 860 12:46:59 8:01:02 t_5_exp_si_1.0_sl_0.3 (Priority)
277719 any eromer2s PD 64 1 64 3GB 2:00:00:00 860 12:46:59 8:01:02 t_5_exp_si_1.0_sl_0.7 (Priority)
277731 hpc dgromm3m PD 32 1 32 96GB 3:00:00:00 547 13:51:56 6:56:05 start_mpi.sh (Nodes required for job are DOWN, DRAINED or reserved for jobs in higher priority partitions)
277732 hpc dgromm3m PD 32 1 32 48GB 3:00:00:00 547 13:52:38 6:55:23 start_mpi.sh (Nodes required for job are DOWN, DRAINED or reserved for jobs in higher priority partitions)