rank0 [2025-10-06 09:43:47,818] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-06 09:43:47,819] INFO : AMD Instinct MI250X
rank0 [2025-10-06 09:43:47,819] INFO : AMD Instinct MI250X
rank0 [2025-10-06 09:43:47,819] INFO : AMD Instinct MI250X
rank0 [2025-10-06 09:43:47,820] INFO : AMD Instinct MI250X
rank0 [2025-10-06 09:43:47,820] INFO : AMD Instinct MI250X
rank0 [2025-10-06 09:43:47,820] INFO : AMD Instinct MI250X
rank0 [2025-10-06 09:43:47,820] INFO : AMD Instinct MI250X
rank0 [2025-10-06 09:43:47,820] INFO : AMD Instinct MI250X
rank0 [2025-10-07 11:18:07,217] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-07 11:18:07,242] INFO : AMD Instinct MI250X
rank0 [2025-10-07 11:18:07,242] INFO : AMD Instinct MI250X
rank0 [2025-10-07 11:18:07,242] INFO : AMD Instinct MI250X
rank0 [2025-10-07 11:18:07,242] INFO : AMD Instinct MI250X
rank0 [2025-10-07 11:18:07,242] INFO : AMD Instinct MI250X
rank0 [2025-10-07 11:18:07,242] INFO : AMD Instinct MI250X
rank0 [2025-10-07 11:18:07,242] INFO : AMD Instinct MI250X
rank0 [2025-10-07 11:18:07,242] INFO : AMD Instinct MI250X
rank0 [2025-10-08 15:38:32,498] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-08 15:38:32,509] INFO : AMD Instinct MI250X
rank0 [2025-10-08 15:38:32,510] INFO : AMD Instinct MI250X
rank0 [2025-10-08 15:38:32,510] INFO : AMD Instinct MI250X
rank0 [2025-10-08 15:38:32,510] INFO : AMD Instinct MI250X
rank0 [2025-10-08 15:38:32,510] INFO : AMD Instinct MI250X
rank0 [2025-10-08 15:38:32,510] INFO : AMD Instinct MI250X
rank0 [2025-10-08 15:38:32,510] INFO : AMD Instinct MI250X
rank0 [2025-10-08 15:38:32,510] INFO : AMD Instinct MI250X
rank0 [2025-10-10 08:11:47,640] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-10 08:11:47,652] INFO : AMD Instinct MI250X
rank0 [2025-10-10 08:11:47,652] INFO : AMD Instinct MI250X
rank0 [2025-10-10 08:11:47,652] INFO : AMD Instinct MI250X
rank0 [2025-10-10 08:11:47,652] INFO : AMD Instinct MI250X
rank0 [2025-10-10 08:11:47,653] INFO : AMD Instinct MI250X
rank0 [2025-10-10 08:11:47,653] INFO : AMD Instinct MI250X
rank0 [2025-10-10 08:11:47,653] INFO : AMD Instinct MI250X
rank0 [2025-10-10 08:11:47,653] INFO : AMD Instinct MI250X
rank0 [2025-10-11 08:53:42,127] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-11 08:53:42,134] INFO : AMD Instinct MI250X
rank0 [2025-10-11 08:53:42,134] INFO : AMD Instinct MI250X
rank0 [2025-10-11 08:53:42,134] INFO : AMD Instinct MI250X
rank0 [2025-10-11 08:53:42,134] INFO : AMD Instinct MI250X
rank0 [2025-10-11 08:53:42,134] INFO : AMD Instinct MI250X
rank0 [2025-10-11 08:53:42,134] INFO : AMD Instinct MI250X
rank0 [2025-10-11 08:53:42,134] INFO : AMD Instinct MI250X
rank0 [2025-10-11 08:53:42,134] INFO : AMD Instinct MI250X
rank0 [2025-10-12 08:57:35,797] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-12 08:57:35,810] INFO : AMD Instinct MI250X
rank0 [2025-10-12 08:57:35,810] INFO : AMD Instinct MI250X
rank0 [2025-10-12 08:57:35,810] INFO : AMD Instinct MI250X
rank0 [2025-10-12 08:57:35,810] INFO : AMD Instinct MI250X
rank0 [2025-10-12 08:57:35,810] INFO : AMD Instinct MI250X
rank0 [2025-10-12 08:57:35,811] INFO : AMD Instinct MI250X
rank0 [2025-10-12 08:57:35,811] INFO : AMD Instinct MI250X
rank0 [2025-10-12 08:57:35,811] INFO : AMD Instinct MI250X
rank0 [2025-10-13 15:02:50,514] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-13 15:02:50,525] INFO : AMD Instinct MI250X
rank0 [2025-10-13 15:02:50,525] INFO : AMD Instinct MI250X
rank0 [2025-10-13 15:02:50,525] INFO : AMD Instinct MI250X
rank0 [2025-10-13 15:02:50,525] INFO : AMD Instinct MI250X
rank0 [2025-10-13 15:02:50,525] INFO : AMD Instinct MI250X
rank0 [2025-10-13 15:02:50,525] INFO : AMD Instinct MI250X
rank0 [2025-10-13 15:02:50,525] INFO : AMD Instinct MI250X
rank0 [2025-10-13 15:02:50,525] INFO : AMD Instinct MI250X
rank0 [2025-10-14 20:25:24,554] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-14 20:25:24,562] INFO : AMD Instinct MI250X
rank0 [2025-10-14 20:25:24,562] INFO : AMD Instinct MI250X
rank0 [2025-10-14 20:25:24,562] INFO : AMD Instinct MI250X
rank0 [2025-10-14 20:25:24,562] INFO : AMD Instinct MI250X
rank0 [2025-10-14 20:25:24,562] INFO : AMD Instinct MI250X
rank0 [2025-10-14 20:25:24,563] INFO : AMD Instinct MI250X
rank0 [2025-10-14 20:25:24,563] INFO : AMD Instinct MI250X
rank0 [2025-10-14 20:25:24,563] INFO : AMD Instinct MI250X
rank0 [2025-10-15 20:48:27,059] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-15 20:48:27,072] INFO : AMD Instinct MI250X
rank0 [2025-10-15 20:48:27,072] INFO : AMD Instinct MI250X
rank0 [2025-10-15 20:48:27,072] INFO : AMD Instinct MI250X
rank0 [2025-10-15 20:48:27,072] INFO : AMD Instinct MI250X
rank0 [2025-10-15 20:48:27,072] INFO : AMD Instinct MI250X
rank0 [2025-10-15 20:48:27,072] INFO : AMD Instinct MI250X
rank0 [2025-10-15 20:48:27,072] INFO : AMD Instinct MI250X
rank0 [2025-10-15 20:48:27,072] INFO : AMD Instinct MI250X
rank0 [2025-10-16 21:32:36,723] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-16 21:32:36,733] INFO : AMD Instinct MI250X
rank0 [2025-10-16 21:32:36,734] INFO : AMD Instinct MI250X
rank0 [2025-10-16 21:32:36,734] INFO : AMD Instinct MI250X
rank0 [2025-10-16 21:32:36,734] INFO : AMD Instinct MI250X
rank0 [2025-10-16 21:32:36,734] INFO : AMD Instinct MI250X
rank0 [2025-10-16 21:32:36,734] INFO : AMD Instinct MI250X
rank0 [2025-10-16 21:32:36,734] INFO : AMD Instinct MI250X
rank0 [2025-10-16 21:32:36,734] INFO : AMD Instinct MI250X
rank0 [2025-10-18 04:43:25,804] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-18 04:43:25,853] INFO : AMD Instinct MI250X
rank0 [2025-10-18 04:43:25,854] INFO : AMD Instinct MI250X
rank0 [2025-10-18 04:43:25,854] INFO : AMD Instinct MI250X
rank0 [2025-10-18 04:43:25,854] INFO : AMD Instinct MI250X
rank0 [2025-10-18 04:43:25,854] INFO : AMD Instinct MI250X
rank0 [2025-10-18 04:43:25,854] INFO : AMD Instinct MI250X
rank0 [2025-10-18 04:43:25,854] INFO : AMD Instinct MI250X
rank0 [2025-10-18 04:43:25,854] INFO : AMD Instinct MI250X
rank0 [2025-10-18 13:41:24,142] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-18 13:41:24,155] INFO : AMD Instinct MI250X
rank0 [2025-10-18 13:41:24,155] INFO : AMD Instinct MI250X
rank0 [2025-10-18 13:41:24,155] INFO : AMD Instinct MI250X
rank0 [2025-10-18 13:41:24,155] INFO : AMD Instinct MI250X
rank0 [2025-10-18 13:41:24,155] INFO : AMD Instinct MI250X
rank0 [2025-10-18 13:41:24,156] INFO : AMD Instinct MI250X
rank0 [2025-10-18 13:41:24,156] INFO : AMD Instinct MI250X
rank0 [2025-10-18 13:41:24,156] INFO : AMD Instinct MI250X
rank0 [2025-10-19 14:04:55,132] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-19 14:04:55,139] INFO : AMD Instinct MI250X
rank0 [2025-10-19 14:04:55,139] INFO : AMD Instinct MI250X
rank0 [2025-10-19 14:04:55,139] INFO : AMD Instinct MI250X
rank0 [2025-10-19 14:04:55,139] INFO : AMD Instinct MI250X
rank0 [2025-10-19 14:04:55,139] INFO : AMD Instinct MI250X
rank0 [2025-10-19 14:04:55,139] INFO : AMD Instinct MI250X
rank0 [2025-10-19 14:04:55,139] INFO : AMD Instinct MI250X
rank0 [2025-10-19 14:04:55,139] INFO : AMD Instinct MI250X
rank0 [2025-10-20 12:05:25,911] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-20 12:05:25,922] INFO : AMD Instinct MI250X
rank0 [2025-10-20 12:05:25,922] INFO : AMD Instinct MI250X
rank0 [2025-10-20 12:05:25,922] INFO : AMD Instinct MI250X
rank0 [2025-10-20 12:05:25,923] INFO : AMD Instinct MI250X
rank0 [2025-10-20 12:05:25,923] INFO : AMD Instinct MI250X
rank0 [2025-10-20 12:05:25,923] INFO : AMD Instinct MI250X
rank0 [2025-10-20 12:05:25,923] INFO : AMD Instinct MI250X
rank0 [2025-10-20 12:05:25,923] INFO : AMD Instinct MI250X
rank0 [2025-10-21 22:16:31,547] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-21 22:16:31,548] INFO : AMD Instinct MI250X
rank0 [2025-10-21 22:16:31,548] INFO : AMD Instinct MI250X
rank0 [2025-10-21 22:16:31,548] INFO : AMD Instinct MI250X
rank0 [2025-10-21 22:16:31,548] INFO : AMD Instinct MI250X
rank0 [2025-10-21 22:16:31,549] INFO : AMD Instinct MI250X
rank0 [2025-10-21 22:16:31,549] INFO : AMD Instinct MI250X
rank0 [2025-10-21 22:16:31,549] INFO : AMD Instinct MI250X
rank0 [2025-10-21 22:16:31,549] INFO : AMD Instinct MI250X
rank0 [2025-10-22 00:28:38,342] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-22 00:28:38,356] INFO : AMD Instinct MI250X
rank0 [2025-10-22 00:28:38,356] INFO : AMD Instinct MI250X
rank0 [2025-10-22 00:28:38,357] INFO : AMD Instinct MI250X
rank0 [2025-10-22 00:28:38,357] INFO : AMD Instinct MI250X
rank0 [2025-10-22 00:28:38,357] INFO : AMD Instinct MI250X
rank0 [2025-10-22 00:28:38,357] INFO : AMD Instinct MI250X
rank0 [2025-10-22 00:28:38,357] INFO : AMD Instinct MI250X
rank0 [2025-10-22 00:28:38,357] INFO : AMD Instinct MI250X
rank0 [2025-10-24 09:27:40,619] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-24 09:27:40,632] INFO : AMD Instinct MI250X
rank0 [2025-10-24 09:27:40,632] INFO : AMD Instinct MI250X
rank0 [2025-10-24 09:27:40,632] INFO : AMD Instinct MI250X
rank0 [2025-10-24 09:27:40,632] INFO : AMD Instinct MI250X
rank0 [2025-10-24 09:27:40,632] INFO : AMD Instinct MI250X
rank0 [2025-10-24 09:27:40,632] INFO : AMD Instinct MI250X
rank0 [2025-10-24 09:27:40,632] INFO : AMD Instinct MI250X
rank0 [2025-10-24 09:27:40,633] INFO : AMD Instinct MI250X
rank0 [2025-10-26 00:39:01,403] INFO : Will use torch.nn.parallel.DistributedDataParallel() and 8 gpus
rank0 [2025-10-26 00:39:01,426] INFO : AMD Instinct MI250X
rank0 [2025-10-26 00:39:01,426] INFO : AMD Instinct MI250X
rank0 [2025-10-26 00:39:01,426] INFO : AMD Instinct MI250X
rank0 [2025-10-26 00:39:01,426] INFO : AMD Instinct MI250X
rank0 [2025-10-26 00:39:01,426] INFO : AMD Instinct MI250X
rank0 [2025-10-26 00:39:01,426] INFO : AMD Instinct MI250X
rank0 [2025-10-26 00:39:01,427] INFO : AMD Instinct MI250X
rank0 [2025-10-26 00:39:01,427] INFO : AMD Instinct MI250X