lucataco / diffusers-dreambooth-lora

FLUX.1-Dev LoRA Training by Huggingface Diffusers

Cold

Public
188 runs
A100 (80GB)
GitHub
License

Run with an API

Playground API Examples README Versions

Input

input_images

file

A zip file containing the images that will be used for training.

instance_prompt

string

Shift + Return to add a new line

Instance prompt to trigger the image generation

Default: "a photo of TOK dog"

resolution

integer

The resolution for input images, all the images in the train/validation dataset will be resized to this

Default: 512

max_train_steps

integer

(minimum: 100, maximum: 6000)

Total number of training steps to perform

Default: 500

rank

integer

(minimum: 4, maximum: 64)

The dimension of the LoRA

Default: 4

optimizer

string

The optimizer type to use

Default: "AdamW"

learning_rate

number

(minimum: 0.0001, maximum: 1)

Initial learning rate to use (1.0 for Prodigy)

Default: 0.0001

Including train_batch_size and 8 more...

Run this model in Node.js with one line of code:

npx create-replicate --model=lucataco/diffusers-dreambooth-lora

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run lucataco/diffusers-dreambooth-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "lucataco/diffusers-dreambooth-lora:fc7489622d50e8dfbd15ed0dea991263613e04180978aac97fb3e9eba7cf36f1",
  {
    input: {
      rank: 4,
      backend: "no",
      optimizer: "prodigy",
      resolution: 512,
      input_images: "https://replicate.delivery/pbxt/LlvEhC2BWWxpMKYYzCHHf2TSdJdZ15on8LEkbLY6evEC9bVd/queso2.zip",
      lr_scheduler: "constant",
      learning_rate: 1,
      instance_prompt: "a photo of QSO dog",
      max_train_steps: 1200,
      train_batch_size: 1,
      gradient_accumulation_steps: 1
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run lucataco/diffusers-dreambooth-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "lucataco/diffusers-dreambooth-lora:fc7489622d50e8dfbd15ed0dea991263613e04180978aac97fb3e9eba7cf36f1",
    input={
        "rank": 4,
        "backend": "no",
        "optimizer": "prodigy",
        "resolution": 512,
        "input_images": "https://replicate.delivery/pbxt/LlvEhC2BWWxpMKYYzCHHf2TSdJdZ15on8LEkbLY6evEC9bVd/queso2.zip",
        "lr_scheduler": "constant",
        "learning_rate": 1,
        "instance_prompt": "a photo of QSO dog",
        "max_train_steps": 1200,
        "train_batch_size": 1,
        "gradient_accumulation_steps": 1
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run lucataco/diffusers-dreambooth-lora using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "fc7489622d50e8dfbd15ed0dea991263613e04180978aac97fb3e9eba7cf36f1",
    "input": {
      "rank": 4,
      "backend": "no",
      "optimizer": "prodigy",
      "resolution": 512,
      "input_images": "https://replicate.delivery/pbxt/LlvEhC2BWWxpMKYYzCHHf2TSdJdZ15on8LEkbLY6evEC9bVd/queso2.zip",
      "lr_scheduler": "constant",
      "learning_rate": 1,
      "instance_prompt": "a photo of QSO dog",
      "max_train_steps": 1200,
      "train_batch_size": 1,
      "gradient_accumulation_steps": 1
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

trained_model.tar

{
  "completed_at": "2024-10-10T18:59:12.808253Z",
  "created_at": "2024-10-10T18:47:33.602000Z",
  "data_removed": false,
  "error": null,
  "id": "gpqzpvzqw9rj60cjez0rtm2604",
  "input": {
    "rank": 4,
    "backend": "no",
    "optimizer": "prodigy",
    "resolution": 512,
    "input_images": "https://replicate.delivery/pbxt/LlvEhC2BWWxpMKYYzCHHf2TSdJdZ15on8LEkbLY6evEC9bVd/queso2.zip",
    "lr_scheduler": "constant",
    "learning_rate": 1,
    "instance_prompt": "a photo of QSO dog",
    "max_train_steps": 1200,
    "train_batch_size": 1,
    "gradient_accumulation_steps": 1
  },
  "logs": "Using seed: 2514880356\nExtracted 12 files from zip to input_images\nUsing params: ['accelerate', 'launch', '--dynamo_backend', 'no', 'train_dreambooth_lora_flux.py', '--pretrained_model_name_or_path', 'FLUX.1-dev', '--instance_data_dir', 'input_images', '--rank', '4', '--output_dir', '/tmp/train/output/flux_train_replicate', '--mixed_precision', 'bf16', '--instance_prompt', 'a photo of QSO dog', '--resolution', '512', '--train_batch_size', '1', '--gradient_accumulation_steps', '1', '--optimizer=prodigy', '--learning_rate', '1.0', '--lr_scheduler', 'constant', '--lr_warmup_steps', '0', '--max_train_steps', '1200', '--checkpointing_steps', '1201', '--seed', '2514880356', '--logging_dir', '/tmp/logs']\n10/10/2024 18:48:24 - INFO - __main__ - Distributed environment: DistributedType.NO\nNum processes: 1\nProcess index: 0\nLocal process index: 0\nDevice: cuda\nMixed precision type: bf16\nYou set `add_prefix_space`. The tokenizer needs to be converted from the slow tokenizers\nYou are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.\nYou are using a model of type t5 to instantiate a model of type . This is not supported for all configurations of models and can yield errors.\nLoading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]\nLoading checkpoint shards:  50%|█████     | 1/2 [00:04<00:04,  4.14s/it]\nLoading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00,  3.82s/it]\nLoading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00,  3.87s/it]\n{'axes_dims_rope'} was not found in config. Values will be initialized to default values.\nUsing decoupled weight decay\n10/10/2024 18:49:19 - INFO - __main__ - ***** Running training *****\n10/10/2024 18:49:19 - INFO - __main__ -   Num examples = 12\n10/10/2024 18:49:19 - INFO - __main__ -   Num batches each epoch = 12\n10/10/2024 18:49:19 - INFO - __main__ -   Num Epochs = 100\n10/10/2024 18:49:19 - INFO - __main__ -   Instantaneous batch size per device = 1\n10/10/2024 18:49:19 - INFO - __main__ -   Total train batch size (w. parallel, distributed & accumulation) = 1\n10/10/2024 18:49:19 - INFO - __main__ -   Gradient Accumulation steps = 1\n10/10/2024 18:49:19 - INFO - __main__ -   Total optimization steps = 1200\nSteps:   0%|          | 0/1200 [00:00<?, ?it/s]\nSteps:   0%|          | 1/1200 [00:00<14:51,  1.35it/s]\nSteps:   0%|          | 1/1200 [00:00<14:51,  1.35it/s, loss=0.66, lr=1]\nSteps:   0%|          | 2/1200 [00:01<11:51,  1.68it/s, loss=0.66, lr=1]\nSteps:   0%|          | 2/1200 [00:01<11:51,  1.68it/s, loss=0.62, lr=1]\nSteps:   0%|          | 3/1200 [00:01<10:53,  1.83it/s, loss=0.62, lr=1]\nSteps:   0%|          | 3/1200 [00:01<10:53,  1.83it/s, loss=0.363, lr=1]\nSteps:   0%|          | 4/1200 [00:02<10:27,  1.91it/s, loss=0.363, lr=1]\nSteps:   0%|          | 4/1200 [00:02<10:27,  1.91it/s, loss=0.442, lr=1]\nSteps:   0%|          | 5/1200 [00:02<10:11,  1.95it/s, loss=0.442, lr=1]\nSteps:   0%|          | 5/1200 [00:02<10:11,  1.95it/s, loss=1.11, lr=1] \nSteps:   0%|          | 6/1200 [00:03<10:01,  1.98it/s, loss=1.11, lr=1]\nSteps:   0%|          | 6/1200 [00:03<10:01,  1.98it/s, loss=0.856, lr=1]\nSteps:   1%|          | 7/1200 [00:03<09:55,  2.00it/s, loss=0.856, lr=1]\nSteps:   1%|          | 7/1200 [00:03<09:55,  2.00it/s, loss=0.584, lr=1]\nSteps:   1%|          | 8/1200 [00:04<09:51,  2.02it/s, loss=0.584, lr=1]\nSteps:   1%|          | 8/1200 [00:04<09:51,  2.02it/s, loss=0.503, lr=1]\nSteps:   1%|          | 9/1200 [00:04<09:49,  2.02it/s, loss=0.503, lr=1]\nSteps:   1%|          | 9/1200 [00:04<09:49,  2.02it/s, loss=0.676, lr=1]\nSteps:   1%|          | 10/1200 [00:05<09:47,  2.03it/s, loss=0.676, lr=1]\nSteps:   1%|          | 10/1200 [00:05<09:47,  2.03it/s, loss=0.797, lr=1]\nSteps:   1%|          | 11/1200 [00:05<09:45,  2.03it/s, loss=0.797, lr=1]\nSteps:   1%|          | 11/1200 [00:05<09:45,  2.03it/s, loss=0.543, lr=1]\nSteps:   1%|          | 12/1200 [00:06<09:43,  2.04it/s, loss=0.543, lr=1]\nSteps:   1%|          | 12/1200 [00:06<09:43,  2.04it/s, loss=0.589, lr=1]\nSteps:   1%|          | 13/1200 [00:06<09:45,  2.03it/s, loss=0.589, lr=1]\nSteps:   1%|          | 13/1200 [00:06<09:45,  2.03it/s, loss=0.629, lr=1]\nSteps:   1%|          | 14/1200 [00:07<09:43,  2.03it/s, loss=0.629, lr=1]\nSteps:   1%|          | 14/1200 [00:07<09:43,  2.03it/s, loss=0.384, lr=1]\nSteps:   1%|▏         | 15/1200 [00:07<09:42,  2.03it/s, loss=0.384, lr=1]\nSteps:   1%|▏         | 15/1200 [00:07<09:42,  2.03it/s, loss=0.651, lr=1]\nSteps:   1%|▏         | 16/1200 [00:08<09:41,  2.04it/s, loss=0.651, lr=1]\nSteps:   1%|▏         | 16/1200 [00:08<09:41,  2.04it/s, loss=0.589, lr=1]\nSteps:   1%|▏         | 17/1200 [00:08<09:40,  2.04it/s, loss=0.589, lr=1]\nSteps:   1%|▏         | 17/1200 [00:08<09:40,  2.04it/s, loss=0.747, lr=1]\nSteps:   2%|▏         | 18/1200 [00:09<09:39,  2.04it/s, loss=0.747, lr=1]\nSteps:   2%|▏         | 18/1200 [00:09<09:39,  2.04it/s, loss=0.566, lr=1]\nSteps:   2%|▏         | 19/1200 [00:09<09:39,  2.04it/s, loss=0.566, lr=1]\nSteps:   2%|▏         | 19/1200 [00:09<09:39,  2.04it/s, loss=0.646, lr=1]\nSteps:   2%|▏         | 20/1200 [00:10<09:38,  2.04it/s, loss=0.646, lr=1]\nSteps:   2%|▏         | 20/1200 [00:10<09:38,  2.04it/s, loss=0.455, lr=1]\nSteps:   2%|▏         | 21/1200 [00:10<09:38,  2.04it/s, loss=0.455, lr=1]\nSteps:   2%|▏         | 21/1200 [00:10<09:38,  2.04it/s, loss=1.01, lr=1] \nSteps:   2%|▏         | 22/1200 [00:11<09:37,  2.04it/s, loss=1.01, lr=1]\nSteps:   2%|▏         | 22/1200 [00:11<09:37,  2.04it/s, loss=0.765, lr=1]\nSteps:   2%|▏         | 23/1200 [00:11<09:37,  2.04it/s, loss=0.765, lr=1]\nSteps:   2%|▏         | 23/1200 [00:11<09:37,  2.04it/s, loss=0.686, lr=1]\nSteps:   2%|▏         | 24/1200 [00:12<09:36,  2.04it/s, loss=0.686, lr=1]\nSteps:   2%|▏         | 24/1200 [00:12<09:36,  2.04it/s, loss=0.392, lr=1]\nSteps:   2%|▏         | 25/1200 [00:12<09:38,  2.03it/s, loss=0.392, lr=1]\nSteps:   2%|▏         | 25/1200 [00:12<09:38,  2.03it/s, loss=0.751, lr=1]\nSteps:   2%|▏         | 26/1200 [00:13<09:37,  2.03it/s, loss=0.751, lr=1]\nSteps:   2%|▏         | 26/1200 [00:13<09:37,  2.03it/s, loss=0.917, lr=1]\nSteps:   2%|▏         | 27/1200 [00:13<09:35,  2.04it/s, loss=0.917, lr=1]\nSteps:   2%|▏         | 27/1200 [00:13<09:35,  2.04it/s, loss=0.658, lr=1]\nSteps:   2%|▏         | 28/1200 [00:13<09:34,  2.04it/s, loss=0.658, lr=1]\nSteps:   2%|▏         | 28/1200 [00:13<09:34,  2.04it/s, loss=0.574, lr=1]\nSteps:   2%|▏         | 29/1200 [00:14<09:34,  2.04it/s, loss=0.574, lr=1]\nSteps:   2%|▏         | 29/1200 [00:14<09:34,  2.04it/s, loss=0.639, lr=1]\nSteps:   2%|▎         | 30/1200 [00:14<09:33,  2.04it/s, loss=0.639, lr=1]\nSteps:   2%|▎         | 30/1200 [00:14<09:33,  2.04it/s, loss=0.637, lr=1]\nSteps:   3%|▎         | 31/1200 [00:15<09:33,  2.04it/s, loss=0.637, lr=1]\nSteps:   3%|▎         | 31/1200 [00:15<09:33,  2.04it/s, loss=0.401, lr=1]\nSteps:   3%|▎         | 32/1200 [00:15<09:32,  2.04it/s, loss=0.401, lr=1]\nSteps:   3%|▎         | 32/1200 [00:15<09:32,  2.04it/s, loss=0.534, lr=1]\nSteps:   3%|▎         | 33/1200 [00:16<09:31,  2.04it/s, loss=0.534, lr=1]\nSteps:   3%|▎         | 33/1200 [00:16<09:31,  2.04it/s, loss=0.667, lr=1]\nSteps:   3%|▎         | 34/1200 [00:16<09:31,  2.04it/s, loss=0.667, lr=1]\nSteps:   3%|▎         | 34/1200 [00:16<09:31,  2.04it/s, loss=0.627, lr=1]\nSteps:   3%|▎         | 35/1200 [00:17<09:31,  2.04it/s, loss=0.627, lr=1]\nSteps:   3%|▎         | 35/1200 [00:17<09:31,  2.04it/s, loss=0.502, lr=1]\nSteps:   3%|▎         | 36/1200 [00:17<09:30,  2.04it/s, loss=0.502, lr=1]\nSteps:   3%|▎         | 36/1200 [00:17<09:30,  2.04it/s, loss=0.402, lr=1]\nSteps:   3%|▎         | 37/1200 [00:18<09:32,  2.03it/s, loss=0.402, lr=1]\nSteps:   3%|▎         | 37/1200 [00:18<09:32,  2.03it/s, loss=0.77, lr=1] \nSteps:   3%|▎         | 38/1200 [00:18<09:31,  2.03it/s, loss=0.77, lr=1]\nSteps:   3%|▎         | 38/1200 [00:18<09:31,  2.03it/s, loss=0.554, lr=1]\nSteps:   3%|▎         | 39/1200 [00:19<09:30,  2.04it/s, loss=0.554, lr=1]\nSteps:   3%|▎         | 39/1200 [00:19<09:30,  2.04it/s, loss=0.437, lr=1]\nSteps:   3%|▎         | 40/1200 [00:19<09:29,  2.04it/s, loss=0.437, lr=1]\nSteps:   3%|▎         | 40/1200 [00:19<09:29,  2.04it/s, loss=0.473, lr=1]\nSteps:   3%|▎         | 41/1200 [00:20<09:28,  2.04it/s, loss=0.473, lr=1]\nSteps:   3%|▎         | 41/1200 [00:20<09:28,  2.04it/s, loss=0.46, lr=1] \nSteps:   4%|▎         | 42/1200 [00:20<09:28,  2.04it/s, loss=0.46, lr=1]\nSteps:   4%|▎         | 42/1200 [00:20<09:28,  2.04it/s, loss=0.381, lr=1]\nSteps:   4%|▎         | 43/1200 [00:21<09:27,  2.04it/s, loss=0.381, lr=1]\nSteps:   4%|▎         | 43/1200 [00:21<09:27,  2.04it/s, loss=0.668, lr=1]\nSteps:   4%|▎         | 44/1200 [00:21<09:26,  2.04it/s, loss=0.668, lr=1]\nSteps:   4%|▎         | 44/1200 [00:21<09:26,  2.04it/s, loss=0.554, lr=1]\nSteps:   4%|▍         | 45/1200 [00:22<09:26,  2.04it/s, loss=0.554, lr=1]\nSteps:   4%|▍         | 45/1200 [00:22<09:26,  2.04it/s, loss=0.555, lr=1]\nSteps:   4%|▍         | 46/1200 [00:22<09:25,  2.04it/s, loss=0.555, lr=1]\nSteps:   4%|▍         | 46/1200 [00:22<09:25,  2.04it/s, loss=0.485, lr=1]\nSteps:   4%|▍         | 47/1200 [00:23<09:24,  2.04it/s, loss=0.485, lr=1]\nSteps:   4%|▍         | 47/1200 [00:23<09:24,  2.04it/s, loss=0.486, lr=1]\nSteps:   4%|▍         | 48/1200 [00:23<09:24,  2.04it/s, loss=0.486, lr=1]\nSteps:   4%|▍         | 48/1200 [00:23<09:24,  2.04it/s, loss=0.551, lr=1]\nSteps:   4%|▍         | 49/1200 [00:24<09:26,  2.03it/s, loss=0.551, lr=1]\nSteps:   4%|▍         | 49/1200 [00:24<09:26,  2.03it/s, loss=0.465, lr=1]\nSteps:   4%|▍         | 50/1200 [00:24<09:24,  2.04it/s, loss=0.465, lr=1]\nSteps:   4%|▍         | 50/1200 [00:24<09:24,  2.04it/s, loss=1.02, lr=1] \nSteps:   4%|▍         | 51/1200 [00:25<09:23,  2.04it/s, loss=1.02, lr=1]\nSteps:   4%|▍         | 51/1200 [00:25<09:23,  2.04it/s, loss=0.563, lr=1]\nSteps:   4%|▍         | 52/1200 [00:25<09:22,  2.04it/s, loss=0.563, lr=1]\nSteps:   4%|▍         | 52/1200 [00:25<09:22,  2.04it/s, loss=0.362, lr=1]\nSteps:   4%|▍         | 53/1200 [00:26<09:22,  2.04it/s, loss=0.362, lr=1]\nSteps:   4%|▍         | 53/1200 [00:26<09:22,  2.04it/s, loss=0.504, lr=1]\nSteps:   4%|▍         | 54/1200 [00:26<09:21,  2.04it/s, loss=0.504, lr=1]\nSteps:   4%|▍         | 54/1200 [00:26<09:21,  2.04it/s, loss=1.05, lr=1] \nSteps:   5%|▍         | 55/1200 [00:27<09:20,  2.04it/s, loss=1.05, lr=1]\nSteps:   5%|▍         | 55/1200 [00:27<09:20,  2.04it/s, loss=0.543, lr=1]\nSteps:   5%|▍         | 56/1200 [00:27<09:20,  2.04it/s, loss=0.543, lr=1]\nSteps:   5%|▍         | 56/1200 [00:27<09:20,  2.04it/s, loss=0.667, lr=1]\nSteps:   5%|▍         | 57/1200 [00:28<09:19,  2.04it/s, loss=0.667, lr=1]\nSteps:   5%|▍         | 57/1200 [00:28<09:19,  2.04it/s, loss=0.418, lr=1]\nSteps:   5%|▍         | 58/1200 [00:28<09:19,  2.04it/s, loss=0.418, lr=1]\nSteps:   5%|▍         | 58/1200 [00:28<09:19,  2.04it/s, loss=0.653, lr=1]\nSteps:   5%|▍         | 59/1200 [00:29<09:18,  2.04it/s, loss=0.653, lr=1]\nSteps:   5%|▍         | 59/1200 [00:29<09:18,  2.04it/s, loss=0.541, lr=1]\nSteps:   5%|▌         | 60/1200 [00:29<09:18,  2.04it/s, loss=0.541, lr=1]\nSteps:   5%|▌         | 60/1200 [00:29<09:18,  2.04it/s, loss=0.688, lr=1]\nSteps:   5%|▌         | 61/1200 [00:30<09:20,  2.03it/s, loss=0.688, lr=1]\nSteps:   5%|▌         | 61/1200 [00:30<09:20,  2.03it/s, loss=0.564, lr=1]\nSteps:   5%|▌         | 62/1200 [00:30<09:19,  2.03it/s, loss=0.564, lr=1]\nSteps:   5%|▌         | 62/1200 [00:30<09:19,  2.03it/s, loss=0.493, lr=1]\nSteps:   5%|▌         | 63/1200 [00:31<09:18,  2.04it/s, loss=0.493, lr=1]\nSteps:   5%|▌         | 63/1200 [00:31<09:18,  2.04it/s, loss=0.456, lr=1]\nSteps:   5%|▌         | 64/1200 [00:31<09:17,  2.04it/s, loss=0.456, lr=1]\nSteps:   5%|▌         | 64/1200 [00:31<09:17,  2.04it/s, loss=1.38, lr=1] \nSteps:   5%|▌         | 65/1200 [00:32<09:16,  2.04it/s, loss=1.38, lr=1]\nSteps:   5%|▌         | 65/1200 [00:32<09:16,  2.04it/s, loss=0.672, lr=1]\nSteps:   6%|▌         | 66/1200 [00:32<09:16,  2.04it/s, loss=0.672, lr=1]\nSteps:   6%|▌         | 66/1200 [00:32<09:16,  2.04it/s, loss=0.809, lr=1]\nSteps:   6%|▌         | 67/1200 [00:33<09:15,  2.04it/s, loss=0.809, lr=1]\nSteps:   6%|▌         | 67/1200 [00:33<09:15,  2.04it/s, loss=0.517, lr=1]\nSteps:   6%|▌         | 68/1200 [00:33<09:15,  2.04it/s, loss=0.517, lr=1]\nSteps:   6%|▌         | 68/1200 [00:33<09:15,  2.04it/s, loss=0.482, lr=1]\nSteps:   6%|▌         | 69/1200 [00:34<09:14,  2.04it/s, loss=0.482, lr=1]\nSteps:   6%|▌         | 69/1200 [00:34<09:14,  2.04it/s, loss=0.499, lr=1]\nSteps:   6%|▌         | 70/1200 [00:34<09:14,  2.04it/s, loss=0.499, lr=1]\nSteps:   6%|▌         | 70/1200 [00:34<09:14,  2.04it/s, loss=0.528, lr=1]\nSteps:   6%|▌         | 71/1200 [00:35<09:13,  2.04it/s, loss=0.528, lr=1]\nSteps:   6%|▌         | 71/1200 [00:35<09:13,  2.04it/s, loss=0.481, lr=1]\nSteps:   6%|▌         | 72/1200 [00:35<09:13,  2.04it/s, loss=0.481, lr=1]\nSteps:   6%|▌         | 72/1200 [00:35<09:13,  2.04it/s, loss=0.531, lr=1]\nSteps:   6%|▌         | 73/1200 [00:36<09:14,  2.03it/s, loss=0.531, lr=1]\nSteps:   6%|▌         | 73/1200 [00:36<09:14,  2.03it/s, loss=0.51, lr=1] \nSteps:   6%|▌         | 74/1200 [00:36<09:13,  2.03it/s, loss=0.51, lr=1]\nSteps:   6%|▌         | 74/1200 [00:36<09:13,  2.03it/s, loss=0.578, lr=1]\nSteps:   6%|▋         | 75/1200 [00:37<09:12,  2.04it/s, loss=0.578, lr=1]\nSteps:   6%|▋         | 75/1200 [00:37<09:12,  2.04it/s, loss=0.601, lr=1]\nSteps:   6%|▋         | 76/1200 [00:37<09:11,  2.04it/s, loss=0.601, lr=1]\nSteps:   6%|▋         | 76/1200 [00:37<09:11,  2.04it/s, loss=0.434, lr=1]\nSteps:   6%|▋         | 77/1200 [00:38<09:10,  2.04it/s, loss=0.434, lr=1]\nSteps:   6%|▋         | 77/1200 [00:38<09:10,  2.04it/s, loss=0.436, lr=1]\nSteps:   6%|▋         | 78/1200 [00:38<09:09,  2.04it/s, loss=0.436, lr=1]\nSteps:   6%|▋         | 78/1200 [00:38<09:09,  2.04it/s, loss=0.62, lr=1] \nSteps:   7%|▋         | 79/1200 [00:39<09:09,  2.04it/s, loss=0.62, lr=1]\nSteps:   7%|▋         | 79/1200 [00:39<09:09,  2.04it/s, loss=0.813, lr=1]\nSteps:   7%|▋         | 80/1200 [00:39<09:08,  2.04it/s, loss=0.813, lr=1]\nSteps:   7%|▋         | 80/1200 [00:39<09:08,  2.04it/s, loss=0.472, lr=1]\nSteps:   7%|▋         | 81/1200 [00:39<09:07,  2.04it/s, loss=0.472, lr=1]\nSteps:   7%|▋         | 81/1200 [00:39<09:07,  2.04it/s, loss=0.439, lr=1]\nSteps:   7%|▋         | 82/1200 [00:40<09:07,  2.04it/s, loss=0.439, lr=1]\nSteps:   7%|▋         | 82/1200 [00:40<09:07,  2.04it/s, loss=0.556, lr=1]\nSteps:   7%|▋         | 83/1200 [00:40<09:06,  2.04it/s, loss=0.556, lr=1]\nSteps:   7%|▋         | 83/1200 [00:40<09:06,  2.04it/s, loss=0.73, lr=1] \nSteps:   7%|▋         | 84/1200 [00:41<09:06,  2.04it/s, loss=0.73, lr=1]\nSteps:   7%|▋         | 84/1200 [00:41<09:06,  2.04it/s, loss=0.503, lr=1]\nSteps:   7%|▋         | 85/1200 [00:41<09:08,  2.03it/s, loss=0.503, lr=1]\nSteps:   7%|▋         | 85/1200 [00:41<09:08,  2.03it/s, loss=0.696, lr=1]\nSteps:   7%|▋         | 86/1200 [00:42<09:07,  2.03it/s, loss=0.696, lr=1]\nSteps:   7%|▋         | 86/1200 [00:42<09:07,  2.03it/s, loss=0.613, lr=1]\nSteps:   7%|▋         | 87/1200 [00:42<09:06,  2.04it/s, loss=0.613, lr=1]\nSteps:   7%|▋         | 87/1200 [00:42<09:06,  2.04it/s, loss=0.468, lr=1]\nSteps:   7%|▋         | 88/1200 [00:43<09:05,  2.04it/s, loss=0.468, lr=1]\nSteps:   7%|▋         | 88/1200 [00:43<09:05,  2.04it/s, loss=0.57, lr=1] \nSteps:   7%|▋         | 89/1200 [00:43<09:04,  2.04it/s, loss=0.57, lr=1]\nSteps:   7%|▋         | 89/1200 [00:43<09:04,  2.04it/s, loss=0.591, lr=1]\nSteps:   8%|▊         | 90/1200 [00:44<09:04,  2.04it/s, loss=0.591, lr=1]\nSteps:   8%|▊         | 90/1200 [00:44<09:04,  2.04it/s, loss=0.529, lr=1]\nSteps:   8%|▊         | 91/1200 [00:44<09:04,  2.04it/s, loss=0.529, lr=1]\nSteps:   8%|▊         | 91/1200 [00:44<09:04,  2.04it/s, loss=0.901, lr=1]\nSteps:   8%|▊         | 92/1200 [00:45<09:03,  2.04it/s, loss=0.901, lr=1]\nSteps:   8%|▊         | 92/1200 [00:45<09:03,  2.04it/s, loss=0.87, lr=1] \nSteps:   8%|▊         | 93/1200 [00:45<09:03,  2.04it/s, loss=0.87, lr=1]\nSteps:   8%|▊         | 93/1200 [00:45<09:03,  2.04it/s, loss=0.423, lr=1]\nSteps:   8%|▊         | 94/1200 [00:46<09:02,  2.04it/s, loss=0.423, lr=1]\nSteps:   8%|▊         | 94/1200 [00:46<09:02,  2.04it/s, loss=0.412, lr=1]\nSteps:   8%|▊         | 95/1200 [00:46<09:02,  2.04it/s, loss=0.412, lr=1]\nSteps:   8%|▊         | 95/1200 [00:46<09:02,  2.04it/s, loss=0.578, lr=1]\nSteps:   8%|▊         | 96/1200 [00:47<09:01,  2.04it/s, loss=0.578, lr=1]\nSteps:   8%|▊         | 96/1200 [00:47<09:01,  2.04it/s, loss=0.641, lr=1]\nSteps:   8%|▊         | 97/1200 [00:47<09:03,  2.03it/s, loss=0.641, lr=1]\nSteps:   8%|▊         | 97/1200 [00:47<09:03,  2.03it/s, loss=0.79, lr=1] \nSteps:   8%|▊         | 98/1200 [00:48<09:02,  2.03it/s, loss=0.79, lr=1]\nSteps:   8%|▊         | 98/1200 [00:48<09:02,  2.03it/s, loss=0.469, lr=1]\nSteps:   8%|▊         | 99/1200 [00:48<09:01,  2.03it/s, loss=0.469, lr=1]\nSteps:   8%|▊         | 99/1200 [00:48<09:01,  2.03it/s, loss=0.844, lr=1]\nSteps:   8%|▊         | 100/1200 [00:49<09:00,  2.04it/s, loss=0.844, lr=1]\nSteps:   8%|▊         | 100/1200 [00:49<09:00,  2.04it/s, loss=0.979, lr=1]\nSteps:   8%|▊         | 101/1200 [00:49<08:59,  2.04it/s, loss=0.979, lr=1]\nSteps:   8%|▊         | 101/1200 [00:49<08:59,  2.04it/s, loss=0.627, lr=1]\nSteps:   8%|▊         | 102/1200 [00:50<08:58,  2.04it/s, loss=0.627, lr=1]\nSteps:   8%|▊         | 102/1200 [00:50<08:58,  2.04it/s, loss=0.407, lr=1]\nSteps:   9%|▊         | 103/1200 [00:50<08:57,  2.04it/s, loss=0.407, lr=1]\nSteps:   9%|▊         | 103/1200 [00:50<08:57,  2.04it/s, loss=0.517, lr=1]\nSteps:   9%|▊         | 104/1200 [00:51<08:57,  2.04it/s, loss=0.517, lr=1]\nSteps:   9%|▊         | 104/1200 [00:51<08:57,  2.04it/s, loss=0.535, lr=1]\nSteps:   9%|▉         | 105/1200 [00:51<08:56,  2.04it/s, loss=0.535, lr=1]\nSteps:   9%|▉         | 105/1200 [00:51<08:56,  2.04it/s, loss=0.906, lr=1]\nSteps:   9%|▉         | 106/1200 [00:52<08:55,  2.04it/s, loss=0.906, lr=1]\nSteps:   9%|▉         | 106/1200 [00:52<08:55,  2.04it/s, loss=0.484, lr=1]\nSteps:   9%|▉         | 107/1200 [00:52<08:55,  2.04it/s, loss=0.484, lr=1]\nSteps:   9%|▉         | 107/1200 [00:52<08:55,  2.04it/s, loss=0.427, lr=1]\nSteps:   9%|▉         | 108/1200 [00:53<08:54,  2.04it/s, loss=0.427, lr=1]\nSteps:   9%|▉         | 108/1200 [00:53<08:54,  2.04it/s, loss=0.633, lr=1]\nSteps:   9%|▉         | 109/1200 [00:53<08:56,  2.04it/s, loss=0.633, lr=1]\nSteps:   9%|▉         | 109/1200 [00:53<08:56,  2.04it/s, loss=0.353, lr=1]\nSteps:   9%|▉         | 110/1200 [00:54<08:54,  2.04it/s, loss=0.353, lr=1]\nSteps:   9%|▉         | 110/1200 [00:54<08:54,  2.04it/s, loss=0.441, lr=1]\nSteps:   9%|▉         | 111/1200 [00:54<08:53,  2.04it/s, loss=0.441, lr=1]\nSteps:   9%|▉         | 111/1200 [00:54<08:53,  2.04it/s, loss=0.484, lr=1]\nSteps:   9%|▉         | 112/1200 [00:55<08:53,  2.04it/s, loss=0.484, lr=1]\nSteps:   9%|▉         | 112/1200 [00:55<08:53,  2.04it/s, loss=0.433, lr=1]\nSteps:   9%|▉         | 113/1200 [00:55<08:52,  2.04it/s, loss=0.433, lr=1]\nSteps:   9%|▉         | 113/1200 [00:55<08:52,  2.04it/s, loss=0.516, lr=1]\nSteps:  10%|▉         | 114/1200 [00:56<08:52,  2.04it/s, loss=0.516, lr=1]\nSteps:  10%|▉         | 114/1200 [00:56<08:52,  2.04it/s, loss=0.659, lr=1]\nSteps:  10%|▉         | 115/1200 [00:56<08:51,  2.04it/s, loss=0.659, lr=1]\nSteps:  10%|▉         | 115/1200 [00:56<08:51,  2.04it/s, loss=0.626, lr=1]\nSteps:  10%|▉         | 116/1200 [00:57<08:51,  2.04it/s, loss=0.626, lr=1]\nSteps:  10%|▉         | 116/1200 [00:57<08:51,  2.04it/s, loss=0.608, lr=1]\nSteps:  10%|▉         | 117/1200 [00:57<08:50,  2.04it/s, loss=0.608, lr=1]\nSteps:  10%|▉         | 117/1200 [00:57<08:50,  2.04it/s, loss=0.656, lr=1]\nSteps:  10%|▉         | 118/1200 [00:58<08:50,  2.04it/s, loss=0.656, lr=1]\nSteps:  10%|▉         | 118/1200 [00:58<08:50,  2.04it/s, loss=0.603, lr=1]\nSteps:  10%|▉         | 119/1200 [00:58<08:49,  2.04it/s, loss=0.603, lr=1]\nSteps:  10%|▉         | 119/1200 [00:58<08:49,  2.04it/s, loss=1.02, lr=1] \nSteps:  10%|█         | 120/1200 [00:59<08:49,  2.04it/s, loss=1.02, lr=1]\nSteps:  10%|█         | 120/1200 [00:59<08:49,  2.04it/s, loss=0.422, lr=1]\nSteps:  10%|█         | 121/1200 [00:59<08:50,  2.03it/s, loss=0.422, lr=1]\nSteps:  10%|█         | 121/1200 [00:59<08:50,  2.03it/s, loss=0.468, lr=1]\nSteps:  10%|█         | 122/1200 [01:00<08:49,  2.03it/s, loss=0.468, lr=1]\nSteps:  10%|█         | 122/1200 [01:00<08:49,  2.03it/s, loss=0.645, lr=1]\nSteps:  10%|█         | 123/1200 [01:00<08:49,  2.04it/s, loss=0.645, lr=1]\nSteps:  10%|█         | 123/1200 [01:00<08:49,  2.04it/s, loss=0.6, lr=1]  \nSteps:  10%|█         | 124/1200 [01:01<08:48,  2.04it/s, loss=0.6, lr=1]\nSteps:  10%|█         | 124/1200 [01:01<08:48,  2.04it/s, loss=0.333, lr=1]\nSteps:  10%|█         | 125/1200 [01:01<08:47,  2.04it/s, loss=0.333, lr=1]\nSteps:  10%|█         | 125/1200 [01:01<08:47,  2.04it/s, loss=0.605, lr=1]\nSteps:  10%|█         | 126/1200 [01:02<08:46,  2.04it/s, loss=0.605, lr=1]\nSteps:  10%|█         | 126/1200 [01:02<08:46,  2.04it/s, loss=0.475, lr=1]\nSteps:  11%|█         | 127/1200 [01:02<08:45,  2.04it/s, loss=0.475, lr=1]\nSteps:  11%|█         | 127/1200 [01:02<08:45,  2.04it/s, loss=0.406, lr=1]\nSteps:  11%|█         | 128/1200 [01:03<08:45,  2.04it/s, loss=0.406, lr=1]\nSteps:  11%|█         | 128/1200 [01:03<08:45,  2.04it/s, loss=0.378, lr=1]\nSteps:  11%|█         | 129/1200 [01:03<08:44,  2.04it/s, loss=0.378, lr=1]\nSteps:  11%|█         | 129/1200 [01:03<08:44,  2.04it/s, loss=0.661, lr=1]\nSteps:  11%|█         | 130/1200 [01:04<08:44,  2.04it/s, loss=0.661, lr=1]\nSteps:  11%|█         | 130/1200 [01:04<08:44,  2.04it/s, loss=0.439, lr=1]\nSteps:  11%|█         | 131/1200 [01:04<08:43,  2.04it/s, loss=0.439, lr=1]\nSteps:  11%|█         | 131/1200 [01:04<08:43,  2.04it/s, loss=0.661, lr=1]\nSteps:  11%|█         | 132/1200 [01:04<08:42,  2.04it/s, loss=0.661, lr=1]\nSteps:  11%|█         | 132/1200 [01:04<08:42,  2.04it/s, loss=0.34, lr=1] \nSteps:  11%|█         | 133/1200 [01:05<08:44,  2.03it/s, loss=0.34, lr=1]\nSteps:  11%|█         | 133/1200 [01:05<08:44,  2.03it/s, loss=0.644, lr=1]\nSteps:  11%|█         | 134/1200 [01:05<08:43,  2.04it/s, loss=0.644, lr=1]\nSteps:  11%|█         | 134/1200 [01:05<08:43,  2.04it/s, loss=0.343, lr=1]\nSteps:  11%|█▏        | 135/1200 [01:06<08:42,  2.04it/s, loss=0.343, lr=1]\nSteps:  11%|█▏        | 135/1200 [01:06<08:42,  2.04it/s, loss=0.427, lr=1]\nSteps:  11%|█▏        | 136/1200 [01:06<08:41,  2.04it/s, loss=0.427, lr=1]\nSteps:  11%|█▏        | 136/1200 [01:06<08:41,  2.04it/s, loss=0.345, lr=1]\nSteps:  11%|█▏        | 137/1200 [01:07<08:40,  2.04it/s, loss=0.345, lr=1]\nSteps:  11%|█▏        | 137/1200 [01:07<08:40,  2.04it/s, loss=0.61, lr=1] \nSteps:  12%|█▏        | 138/1200 [01:07<08:40,  2.04it/s, loss=0.61, lr=1]\nSteps:  12%|█▏        | 138/1200 [01:07<08:40,  2.04it/s, loss=0.668, lr=1]\nSteps:  12%|█▏        | 139/1200 [01:08<08:40,  2.04it/s, loss=0.668, lr=1]\nSteps:  12%|█▏        | 139/1200 [01:08<08:40,  2.04it/s, loss=0.426, lr=1]\nSteps:  12%|█▏        | 140/1200 [01:08<08:39,  2.04it/s, loss=0.426, lr=1]\nSteps:  12%|█▏        | 140/1200 [01:08<08:39,  2.04it/s, loss=0.315, lr=1]\nSteps:  12%|█▏        | 141/1200 [01:09<08:38,  2.04it/s, loss=0.315, lr=1]\nSteps:  12%|█▏        | 141/1200 [01:09<08:38,  2.04it/s, loss=0.64, lr=1] \nSteps:  12%|█▏        | 142/1200 [01:09<08:38,  2.04it/s, loss=0.64, lr=1]\nSteps:  12%|█▏        | 142/1200 [01:09<08:38,  2.04it/s, loss=0.43, lr=1]\nSteps:  12%|█▏        | 143/1200 [01:10<08:37,  2.04it/s, loss=0.43, lr=1]\nSteps:  12%|█▏        | 143/1200 [01:10<08:37,  2.04it/s, loss=0.662, lr=1]\nSteps:  12%|█▏        | 144/1200 [01:10<08:37,  2.04it/s, loss=0.662, lr=1]\nSteps:  12%|█▏        | 144/1200 [01:10<08:37,  2.04it/s, loss=0.419, lr=1]\nSteps:  12%|█▏        | 145/1200 [01:11<08:39,  2.03it/s, loss=0.419, lr=1]\nSteps:  12%|█▏        | 145/1200 [01:11<08:39,  2.03it/s, loss=0.278, lr=1]\nSteps:  12%|█▏        | 146/1200 [01:11<08:38,  2.03it/s, loss=0.278, lr=1]\nSteps:  12%|█▏        | 146/1200 [01:11<08:38,  2.03it/s, loss=0.363, lr=1]\nSteps:  12%|█▏        | 147/1200 [01:12<08:37,  2.04it/s, loss=0.363, lr=1]\nSteps:  12%|█▏        | 147/1200 [01:12<08:37,  2.04it/s, loss=0.343, lr=1]\nSteps:  12%|█▏        | 148/1200 [01:12<08:36,  2.04it/s, loss=0.343, lr=1]\nSteps:  12%|█▏        | 148/1200 [01:12<08:36,  2.04it/s, loss=0.624, lr=1]\nSteps:  12%|█▏        | 149/1200 [01:13<08:35,  2.04it/s, loss=0.624, lr=1]\nSteps:  12%|█▏        | 149/1200 [01:13<08:35,  2.04it/s, loss=0.814, lr=1]\nSteps:  12%|█▎        | 150/1200 [01:13<08:34,  2.04it/s, loss=0.814, lr=1]\nSteps:  12%|█▎        | 150/1200 [01:13<08:34,  2.04it/s, loss=0.875, lr=1]\nSteps:  13%|█▎        | 151/1200 [01:14<08:34,  2.04it/s, loss=0.875, lr=1]\nSteps:  13%|█▎        | 151/1200 [01:14<08:34,  2.04it/s, loss=0.332, lr=1]\nSteps:  13%|█▎        | 152/1200 [01:14<08:33,  2.04it/s, loss=0.332, lr=1]\nSteps:  13%|█▎        | 152/1200 [01:14<08:33,  2.04it/s, loss=0.293, lr=1]\nSteps:  13%|█▎        | 153/1200 [01:15<08:33,  2.04it/s, loss=0.293, lr=1]\nSteps:  13%|█▎        | 153/1200 [01:15<08:33,  2.04it/s, loss=0.339, lr=1]\nSteps:  13%|█▎        | 154/1200 [01:15<08:33,  2.04it/s, loss=0.339, lr=1]\nSteps:  13%|█▎        | 154/1200 [01:15<08:33,  2.04it/s, loss=0.336, lr=1]\nSteps:  13%|█▎        | 155/1200 [01:16<08:32,  2.04it/s, loss=0.336, lr=1]\nSteps:  13%|█▎        | 155/1200 [01:16<08:32,  2.04it/s, loss=0.572, lr=1]\nSteps:  13%|█▎        | 156/1200 [01:16<08:31,  2.04it/s, loss=0.572, lr=1]\nSteps:  13%|█▎        | 156/1200 [01:16<08:31,  2.04it/s, loss=0.528, lr=1]\nSteps:  13%|█▎        | 157/1200 [01:17<08:33,  2.03it/s, loss=0.528, lr=1]\nSteps:  13%|█▎        | 157/1200 [01:17<08:33,  2.03it/s, loss=1.1, lr=1]  \nSteps:  13%|█▎        | 158/1200 [01:17<08:31,  2.04it/s, loss=1.1, lr=1]\nSteps:  13%|█▎        | 158/1200 [01:17<08:31,  2.04it/s, loss=0.652, lr=1]\nSteps:  13%|█▎        | 159/1200 [01:18<08:30,  2.04it/s, loss=0.652, lr=1]\nSteps:  13%|█▎        | 159/1200 [01:18<08:30,  2.04it/s, loss=0.503, lr=1]\nSteps:  13%|█▎        | 160/1200 [01:18<08:30,  2.04it/s, loss=0.503, lr=1]\nSteps:  13%|█▎        | 160/1200 [01:18<08:30,  2.04it/s, loss=0.389, lr=1]\nSteps:  13%|█▎        | 161/1200 [01:19<08:29,  2.04it/s, loss=0.389, lr=1]\nSteps:  13%|█▎        | 161/1200 [01:19<08:29,  2.04it/s, loss=0.384, lr=1]\nSteps:  14%|█▎        | 162/1200 [01:19<08:28,  2.04it/s, loss=0.384, lr=1]\nSteps:  14%|█▎        | 162/1200 [01:19<08:28,  2.04it/s, loss=0.573, lr=1]\nSteps:  14%|█▎        | 163/1200 [01:20<08:27,  2.04it/s, loss=0.573, lr=1]\nSteps:  14%|█▎        | 163/1200 [01:20<08:27,  2.04it/s, loss=0.673, lr=1]\nSteps:  14%|█▎        | 164/1200 [01:20<08:27,  2.04it/s, loss=0.673, lr=1]\nSteps:  14%|█▎        | 164/1200 [01:20<08:27,  2.04it/s, loss=0.431, lr=1]\nSteps:  14%|█▍        | 165/1200 [01:21<08:26,  2.04it/s, loss=0.431, lr=1]\nSteps:  14%|█▍        | 165/1200 [01:21<08:26,  2.04it/s, loss=0.646, lr=1]\nSteps:  14%|█▍        | 166/1200 [01:21<08:26,  2.04it/s, loss=0.646, lr=1]\nSteps:  14%|█▍        | 166/1200 [01:21<08:26,  2.04it/s, loss=0.581, lr=1]\nSteps:  14%|█▍        | 167/1200 [01:22<08:25,  2.04it/s, loss=0.581, lr=1]\nSteps:  14%|█▍        | 167/1200 [01:22<08:25,  2.04it/s, loss=0.576, lr=1]\nSteps:  14%|█▍        | 168/1200 [01:22<08:25,  2.04it/s, loss=0.576, lr=1]\nSteps:  14%|█▍        | 168/1200 [01:22<08:25,  2.04it/s, loss=0.793, lr=1]\nSteps:  14%|█▍        | 169/1200 [01:23<08:27,  2.03it/s, loss=0.793, lr=1]\nSteps:  14%|█▍        | 169/1200 [01:23<08:27,  2.03it/s, loss=0.793, lr=1]\nSteps:  14%|█▍        | 170/1200 [01:23<08:25,  2.04it/s, loss=0.793, lr=1]\nSteps:  14%|█▍        | 170/1200 [01:23<08:25,  2.04it/s, loss=0.345, lr=1]\nSteps:  14%|█▍        | 171/1200 [01:24<08:25,  2.04it/s, loss=0.345, lr=1]\nSteps:  14%|█▍        | 171/1200 [01:24<08:25,  2.04it/s, loss=0.305, lr=1]\nSteps:  14%|█▍        | 172/1200 [01:24<08:24,  2.04it/s, loss=0.305, lr=1]\nSteps:  14%|█▍        | 172/1200 [01:24<08:24,  2.04it/s, loss=0.334, lr=1]\nSteps:  14%|█▍        | 173/1200 [01:25<08:23,  2.04it/s, loss=0.334, lr=1]\nSteps:  14%|█▍        | 173/1200 [01:25<08:23,  2.04it/s, loss=0.296, lr=1]\nSteps:  14%|█▍        | 174/1200 [01:25<08:23,  2.04it/s, loss=0.296, lr=1]\nSteps:  14%|█▍        | 174/1200 [01:25<08:23,  2.04it/s, loss=0.39, lr=1] \nSteps:  15%|█▍        | 175/1200 [01:26<08:22,  2.04it/s, loss=0.39, lr=1]\nSteps:  15%|█▍        | 175/1200 [01:26<08:22,  2.04it/s, loss=0.939, lr=1]\nSteps:  15%|█▍        | 176/1200 [01:26<08:21,  2.04it/s, loss=0.939, lr=1]\nSteps:  15%|█▍        | 176/1200 [01:26<08:21,  2.04it/s, loss=0.605, lr=1]\nSteps:  15%|█▍        | 177/1200 [01:27<08:21,  2.04it/s, loss=0.605, lr=1]\nSteps:  15%|█▍        | 177/1200 [01:27<08:21,  2.04it/s, loss=0.361, lr=1]\nSteps:  15%|█▍        | 178/1200 [01:27<08:20,  2.04it/s, loss=0.361, lr=1]\nSteps:  15%|█▍        | 178/1200 [01:27<08:20,  2.04it/s, loss=0.298, lr=1]\nSteps:  15%|█▍        | 179/1200 [01:28<08:19,  2.04it/s, loss=0.298, lr=1]\nSteps:  15%|█▍        | 179/1200 [01:28<08:19,  2.04it/s, loss=0.691, lr=1]\nSteps:  15%|█▌        | 180/1200 [01:28<08:19,  2.04it/s, loss=0.691, lr=1]\nSteps:  15%|█▌        | 180/1200 [01:28<08:19,  2.04it/s, loss=0.405, lr=1]\nSteps:  15%|█▌        | 181/1200 [01:29<08:21,  2.03it/s, loss=0.405, lr=1]\nSteps:  15%|█▌        | 181/1200 [01:29<08:21,  2.03it/s, loss=0.406, lr=1]\nSteps:  15%|█▌        | 182/1200 [01:29<08:19,  2.04it/s, loss=0.406, lr=1]\nSteps:  15%|█▌        | 182/1200 [01:29<08:19,  2.04it/s, loss=0.398, lr=1]\nSteps:  15%|█▌        | 183/1200 [01:30<08:18,  2.04it/s, loss=0.398, lr=1]\nSteps:  15%|█▌        | 183/1200 [01:30<08:18,  2.04it/s, loss=0.293, lr=1]\nSteps:  15%|█▌        | 184/1200 [01:30<08:18,  2.04it/s, loss=0.293, lr=1]\nSteps:  15%|█▌        | 184/1200 [01:30<08:18,  2.04it/s, loss=0.333, lr=1]\nSteps:  15%|█▌        | 185/1200 [01:30<08:17,  2.04it/s, loss=0.333, lr=1]\nSteps:  15%|█▌        | 185/1200 [01:30<08:17,  2.04it/s, loss=0.367, lr=1]\nSteps:  16%|█▌        | 186/1200 [01:31<08:17,  2.04it/s, loss=0.367, lr=1]\nSteps:  16%|█▌        | 186/1200 [01:31<08:17,  2.04it/s, loss=0.272, lr=1]\nSteps:  16%|█▌        | 187/1200 [01:31<08:16,  2.04it/s, loss=0.272, lr=1]\nSteps:  16%|█▌        | 187/1200 [01:31<08:16,  2.04it/s, loss=0.4, lr=1]  \nSteps:  16%|█▌        | 188/1200 [01:32<08:16,  2.04it/s, loss=0.4, lr=1]\nSteps:  16%|█▌        | 188/1200 [01:32<08:16,  2.04it/s, loss=0.364, lr=1]\nSteps:  16%|█▌        | 189/1200 [01:32<08:15,  2.04it/s, loss=0.364, lr=1]\nSteps:  16%|█▌        | 189/1200 [01:32<08:15,  2.04it/s, loss=0.3, lr=1]  \nSteps:  16%|█▌        | 190/1200 [01:33<08:15,  2.04it/s, loss=0.3, lr=1]\nSteps:  16%|█▌        | 190/1200 [01:33<08:15,  2.04it/s, loss=0.784, lr=1]\nSteps:  16%|█▌        | 191/1200 [01:33<08:14,  2.04it/s, loss=0.784, lr=1]\nSteps:  16%|█▌        | 191/1200 [01:33<08:14,  2.04it/s, loss=0.299, lr=1]\nSteps:  16%|█▌        | 192/1200 [01:34<08:14,  2.04it/s, loss=0.299, lr=1]\nSteps:  16%|█▌        | 192/1200 [01:34<08:14,  2.04it/s, loss=0.63, lr=1] \nSteps:  16%|█▌        | 193/1200 [01:34<08:16,  2.03it/s, loss=0.63, lr=1]\nSteps:  16%|█▌        | 193/1200 [01:34<08:16,  2.03it/s, loss=0.797, lr=1]\nSteps:  16%|█▌        | 194/1200 [01:35<08:14,  2.03it/s, loss=0.797, lr=1]\nSteps:  16%|█▌        | 194/1200 [01:35<08:14,  2.03it/s, loss=0.707, lr=1]\nSteps:  16%|█▋        | 195/1200 [01:35<08:13,  2.04it/s, loss=0.707, lr=1]\nSteps:  16%|█▋        | 195/1200 [01:35<08:13,  2.04it/s, loss=0.369, lr=1]\nSteps:  16%|█▋        | 196/1200 [01:36<08:12,  2.04it/s, loss=0.369, lr=1]\nSteps:  16%|█▋        | 196/1200 [01:36<08:12,  2.04it/s, loss=0.648, lr=1]\nSteps:  16%|█▋        | 197/1200 [01:36<08:12,  2.04it/s, loss=0.648, lr=1]\nSteps:  16%|█▋        | 197/1200 [01:36<08:12,  2.04it/s, loss=0.599, lr=1]\nSteps:  16%|█▋        | 198/1200 [01:37<08:11,  2.04it/s, loss=0.599, lr=1]\nSteps:  16%|█▋        | 198/1200 [01:37<08:11,  2.04it/s, loss=0.423, lr=1]\nSteps:  17%|█▋        | 199/1200 [01:37<08:11,  2.04it/s, loss=0.423, lr=1]\nSteps:  17%|█▋        | 199/1200 [01:37<08:11,  2.04it/s, loss=0.81, lr=1] \nSteps:  17%|█▋        | 200/1200 [01:38<08:10,  2.04it/s, loss=0.81, lr=1]\nSteps:  17%|█▋        | 200/1200 [01:38<08:10,  2.04it/s, loss=0.378, lr=1]\nSteps:  17%|█▋        | 201/1200 [01:38<08:09,  2.04it/s, loss=0.378, lr=1]\nSteps:  17%|█▋        | 201/1200 [01:38<08:09,  2.04it/s, loss=0.522, lr=1]\nSteps:  17%|█▋        | 202/1200 [01:39<08:09,  2.04it/s, loss=0.522, lr=1]\nSteps:  17%|█▋        | 202/1200 [01:39<08:09,  2.04it/s, loss=0.593, lr=1]\nSteps:  17%|█▋        | 203/1200 [01:39<08:08,  2.04it/s, loss=0.593, lr=1]\nSteps:  17%|█▋        | 203/1200 [01:39<08:08,  2.04it/s, loss=0.309, lr=1]\nSteps:  17%|█▋        | 204/1200 [01:40<08:08,  2.04it/s, loss=0.309, lr=1]\nSteps:  17%|█▋        | 204/1200 [01:40<08:08,  2.04it/s, loss=0.312, lr=1]\nSteps:  17%|█▋        | 205/1200 [01:40<08:09,  2.03it/s, loss=0.312, lr=1]\nSteps:  17%|█▋        | 205/1200 [01:40<08:09,  2.03it/s, loss=0.313, lr=1]\nSteps:  17%|█▋        | 206/1200 [01:41<08:08,  2.04it/s, loss=0.313, lr=1]\nSteps:  17%|█▋        | 206/1200 [01:41<08:08,  2.04it/s, loss=0.342, lr=1]\nSteps:  17%|█▋        | 207/1200 [01:41<08:07,  2.04it/s, loss=0.342, lr=1]\nSteps:  17%|█▋        | 207/1200 [01:41<08:07,  2.04it/s, loss=0.568, lr=1]\nSteps:  17%|█▋        | 208/1200 [01:42<08:06,  2.04it/s, loss=0.568, lr=1]\nSteps:  17%|█▋        | 208/1200 [01:42<08:06,  2.04it/s, loss=0.566, lr=1]\nSteps:  17%|█▋        | 209/1200 [01:42<08:05,  2.04it/s, loss=0.566, lr=1]\nSteps:  17%|█▋        | 209/1200 [01:42<08:05,  2.04it/s, loss=0.609, lr=1]\nSteps:  18%|█▊        | 210/1200 [01:43<08:04,  2.04it/s, loss=0.609, lr=1]\nSteps:  18%|█▊        | 210/1200 [01:43<08:04,  2.04it/s, loss=0.561, lr=1]\nSteps:  18%|█▊        | 211/1200 [01:43<08:04,  2.04it/s, loss=0.561, lr=1]\nSteps:  18%|█▊        | 211/1200 [01:43<08:04,  2.04it/s, loss=0.268, lr=1]\nSteps:  18%|█▊        | 212/1200 [01:44<08:03,  2.04it/s, loss=0.268, lr=1]\nSteps:  18%|█▊        | 212/1200 [01:44<08:03,  2.04it/s, loss=0.53, lr=1] \nSteps:  18%|█▊        | 213/1200 [01:44<08:02,  2.04it/s, loss=0.53, lr=1]\nSteps:  18%|█▊        | 213/1200 [01:44<08:02,  2.04it/s, loss=0.477, lr=1]\nSteps:  18%|█▊        | 214/1200 [01:45<08:02,  2.04it/s, loss=0.477, lr=1]\nSteps:  18%|█▊        | 214/1200 [01:45<08:02,  2.04it/s, loss=0.655, lr=1]\nSteps:  18%|█▊        | 215/1200 [01:45<08:02,  2.04it/s, loss=0.655, lr=1]\nSteps:  18%|█▊        | 215/1200 [01:45<08:02,  2.04it/s, loss=0.642, lr=1]\nSteps:  18%|█▊        | 216/1200 [01:46<08:01,  2.04it/s, loss=0.642, lr=1]\nSteps:  18%|█▊        | 216/1200 [01:46<08:01,  2.04it/s, loss=0.655, lr=1]\nSteps:  18%|█▊        | 217/1200 [01:46<08:03,  2.03it/s, loss=0.655, lr=1]\nSteps:  18%|█▊        | 217/1200 [01:46<08:03,  2.03it/s, loss=0.538, lr=1]\nSteps:  18%|█▊        | 218/1200 [01:47<08:01,  2.04it/s, loss=0.538, lr=1]\nSteps:  18%|█▊        | 218/1200 [01:47<08:01,  2.04it/s, loss=0.291, lr=1]\nSteps:  18%|█▊        | 219/1200 [01:47<08:01,  2.04it/s, loss=0.291, lr=1]\nSteps:  18%|█▊        | 219/1200 [01:47<08:01,  2.04it/s, loss=0.554, lr=1]\nSteps:  18%|█▊        | 220/1200 [01:48<08:00,  2.04it/s, loss=0.554, lr=1]\nSteps:  18%|█▊        | 220/1200 [01:48<08:00,  2.04it/s, loss=0.369, lr=1]\nSteps:  18%|█▊        | 221/1200 [01:48<08:00,  2.04it/s, loss=0.369, lr=1]\nSteps:  18%|█▊        | 221/1200 [01:48<08:00,  2.04it/s, loss=0.398, lr=1]\nSteps:  18%|█▊        | 222/1200 [01:49<07:59,  2.04it/s, loss=0.398, lr=1]\nSteps:  18%|█▊        | 222/1200 [01:49<07:59,  2.04it/s, loss=0.327, lr=1]\nSteps:  19%|█▊        | 223/1200 [01:49<07:58,  2.04it/s, loss=0.327, lr=1]\nSteps:  19%|█▊        | 223/1200 [01:49<07:58,  2.04it/s, loss=0.379, lr=1]\nSteps:  19%|█▊        | 224/1200 [01:50<07:57,  2.04it/s, loss=0.379, lr=1]\nSteps:  19%|█▊        | 224/1200 [01:50<07:57,  2.04it/s, loss=0.597, lr=1]\nSteps:  19%|█▉        | 225/1200 [01:50<07:57,  2.04it/s, loss=0.597, lr=1]\nSteps:  19%|█▉        | 225/1200 [01:50<07:57,  2.04it/s, loss=0.677, lr=1]\nSteps:  19%|█▉        | 226/1200 [01:51<07:56,  2.04it/s, loss=0.677, lr=1]\nSteps:  19%|█▉        | 226/1200 [01:51<07:56,  2.04it/s, loss=0.595, lr=1]\nSteps:  19%|█▉        | 227/1200 [01:51<07:56,  2.04it/s, loss=0.595, lr=1]\nSteps:  19%|█▉        | 227/1200 [01:51<07:56,  2.04it/s, loss=0.404, lr=1]\nSteps:  19%|█▉        | 228/1200 [01:52<07:55,  2.04it/s, loss=0.404, lr=1]\nSteps:  19%|█▉        | 228/1200 [01:52<07:55,  2.04it/s, loss=0.314, lr=1]\nSteps:  19%|█▉        | 229/1200 [01:52<07:57,  2.03it/s, loss=0.314, lr=1]\nSteps:  19%|█▉        | 229/1200 [01:52<07:57,  2.03it/s, loss=0.417, lr=1]\nSteps:  19%|█▉        | 230/1200 [01:53<07:55,  2.04it/s, loss=0.417, lr=1]\nSteps:  19%|█▉        | 230/1200 [01:53<07:55,  2.04it/s, loss=0.36, lr=1] \nSteps:  19%|█▉        | 231/1200 [01:53<07:54,  2.04it/s, loss=0.36, lr=1]\nSteps:  19%|█▉        | 231/1200 [01:53<07:54,  2.04it/s, loss=0.333, lr=1]\nSteps:  19%|█▉        | 232/1200 [01:54<07:54,  2.04it/s, loss=0.333, lr=1]\nSteps:  19%|█▉        | 232/1200 [01:54<07:54,  2.04it/s, loss=0.29, lr=1] \nSteps:  19%|█▉        | 233/1200 [01:54<07:53,  2.04it/s, loss=0.29, lr=1]\nSteps:  19%|█▉        | 233/1200 [01:54<07:53,  2.04it/s, loss=0.312, lr=1]\nSteps:  20%|█▉        | 234/1200 [01:55<07:52,  2.04it/s, loss=0.312, lr=1]\nSteps:  20%|█▉        | 234/1200 [01:55<07:52,  2.04it/s, loss=0.507, lr=1]\nSteps:  20%|█▉        | 235/1200 [01:55<07:52,  2.04it/s, loss=0.507, lr=1]\nSteps:  20%|█▉        | 235/1200 [01:55<07:52,  2.04it/s, loss=0.324, lr=1]\nSteps:  20%|█▉        | 236/1200 [01:55<07:51,  2.04it/s, loss=0.324, lr=1]\nSteps:  20%|█▉        | 236/1200 [01:55<07:51,  2.04it/s, loss=0.311, lr=1]\nSteps:  20%|█▉        | 237/1200 [01:56<07:51,  2.04it/s, loss=0.311, lr=1]\nSteps:  20%|█▉        | 237/1200 [01:56<07:51,  2.04it/s, loss=0.357, lr=1]\nSteps:  20%|█▉        | 238/1200 [01:56<07:51,  2.04it/s, loss=0.357, lr=1]\nSteps:  20%|█▉        | 238/1200 [01:56<07:51,  2.04it/s, loss=0.323, lr=1]\nSteps:  20%|█▉        | 239/1200 [01:57<07:51,  2.04it/s, loss=0.323, lr=1]\nSteps:  20%|█▉        | 239/1200 [01:57<07:51,  2.04it/s, loss=0.647, lr=1]\nSteps:  20%|██        | 240/1200 [01:57<07:50,  2.04it/s, loss=0.647, lr=1]\nSteps:  20%|██        | 240/1200 [01:57<07:50,  2.04it/s, loss=0.279, lr=1]\nSteps:  20%|██        | 241/1200 [01:58<07:52,  2.03it/s, loss=0.279, lr=1]\nSteps:  20%|██        | 241/1200 [01:58<07:52,  2.03it/s, loss=0.295, lr=1]\nSteps:  20%|██        | 242/1200 [01:58<07:50,  2.03it/s, loss=0.295, lr=1]\nSteps:  20%|██        | 242/1200 [01:58<07:50,  2.03it/s, loss=0.295, lr=1]\nSteps:  20%|██        | 243/1200 [01:59<07:49,  2.04it/s, loss=0.295, lr=1]\nSteps:  20%|██        | 243/1200 [01:59<07:49,  2.04it/s, loss=0.88, lr=1] \nSteps:  20%|██        | 244/1200 [01:59<07:49,  2.04it/s, loss=0.88, lr=1]\nSteps:  20%|██        | 244/1200 [01:59<07:49,  2.04it/s, loss=0.362, lr=1]\nSteps:  20%|██        | 245/1200 [02:00<07:48,  2.04it/s, loss=0.362, lr=1]\nSteps:  20%|██        | 245/1200 [02:00<07:48,  2.04it/s, loss=0.403, lr=1]\nSteps:  20%|██        | 246/1200 [02:00<07:47,  2.04it/s, loss=0.403, lr=1]\nSteps:  20%|██        | 246/1200 [02:00<07:47,  2.04it/s, loss=0.493, lr=1]\nSteps:  21%|██        | 247/1200 [02:01<07:47,  2.04it/s, loss=0.493, lr=1]\nSteps:  21%|██        | 247/1200 [02:01<07:47,  2.04it/s, loss=0.77, lr=1] \nSteps:  21%|██        | 248/1200 [02:01<07:46,  2.04it/s, loss=0.77, lr=1]\nSteps:  21%|██        | 248/1200 [02:01<07:46,  2.04it/s, loss=0.734, lr=1]\nSteps:  21%|██        | 249/1200 [02:02<07:46,  2.04it/s, loss=0.734, lr=1]\nSteps:  21%|██        | 249/1200 [02:02<07:46,  2.04it/s, loss=0.296, lr=1]\nSteps:  21%|██        | 250/1200 [02:02<07:46,  2.04it/s, loss=0.296, lr=1]\nSteps:  21%|██        | 250/1200 [02:02<07:46,  2.04it/s, loss=0.599, lr=1]\nSteps:  21%|██        | 251/1200 [02:03<07:45,  2.04it/s, loss=0.599, lr=1]\nSteps:  21%|██        | 251/1200 [02:03<07:45,  2.04it/s, loss=0.792, lr=1]\nSteps:  21%|██        | 252/1200 [02:03<07:45,  2.04it/s, loss=0.792, lr=1]\nSteps:  21%|██        | 252/1200 [02:03<07:45,  2.04it/s, loss=0.636, lr=1]\nSteps:  21%|██        | 253/1200 [02:04<07:48,  2.02it/s, loss=0.636, lr=1]\nSteps:  21%|██        | 253/1200 [02:04<07:48,  2.02it/s, loss=0.303, lr=1]\nSteps:  21%|██        | 254/1200 [02:04<07:47,  2.03it/s, loss=0.303, lr=1]\nSteps:  21%|██        | 254/1200 [02:04<07:47,  2.03it/s, loss=0.597, lr=1]\nSteps:  21%|██▏       | 255/1200 [02:05<07:45,  2.03it/s, loss=0.597, lr=1]\nSteps:  21%|██▏       | 255/1200 [02:05<07:45,  2.03it/s, loss=0.587, lr=1]\nSteps:  21%|██▏       | 256/1200 [02:05<07:44,  2.03it/s, loss=0.587, lr=1]\nSteps:  21%|██▏       | 256/1200 [02:05<07:44,  2.03it/s, loss=0.391, lr=1]\nSteps:  21%|██▏       | 257/1200 [02:06<07:43,  2.03it/s, loss=0.391, lr=1]\nSteps:  21%|██▏       | 257/1200 [02:06<07:43,  2.03it/s, loss=0.389, lr=1]\nSteps:  22%|██▏       | 258/1200 [02:06<07:42,  2.04it/s, loss=0.389, lr=1]\nSteps:  22%|██▏       | 258/1200 [02:06<07:42,  2.04it/s, loss=0.786, lr=1]\nSteps:  22%|██▏       | 259/1200 [02:07<07:42,  2.04it/s, loss=0.786, lr=1]\nSteps:  22%|██▏       | 259/1200 [02:07<07:42,  2.04it/s, loss=0.778, lr=1]\nSteps:  22%|██▏       | 260/1200 [02:07<07:41,  2.04it/s, loss=0.778, lr=1]\nSteps:  22%|██▏       | 260/1200 [02:07<07:41,  2.04it/s, loss=0.331, lr=1]\nSteps:  22%|██▏       | 261/1200 [02:08<07:40,  2.04it/s, loss=0.331, lr=1]\nSteps:  22%|██▏       | 261/1200 [02:08<07:40,  2.04it/s, loss=0.326, lr=1]\nSteps:  22%|██▏       | 262/1200 [02:08<07:40,  2.04it/s, loss=0.326, lr=1]\nSteps:  22%|██▏       | 262/1200 [02:08<07:40,  2.04it/s, loss=0.63, lr=1] \nSteps:  22%|██▏       | 263/1200 [02:09<08:21,  1.87it/s, loss=0.63, lr=1]\nSteps:  22%|██▏       | 263/1200 [02:09<08:21,  1.87it/s, loss=0.464, lr=1]\nSteps:  22%|██▏       | 264/1200 [02:09<08:08,  1.92it/s, loss=0.464, lr=1]\nSteps:  22%|██▏       | 264/1200 [02:09<08:08,  1.92it/s, loss=0.96, lr=1] \nSteps:  22%|██▏       | 265/1200 [02:10<08:01,  1.94it/s, loss=0.96, lr=1]\nSteps:  22%|██▏       | 265/1200 [02:10<08:01,  1.94it/s, loss=0.335, lr=1]\nSteps:  22%|██▏       | 266/1200 [02:10<07:54,  1.97it/s, loss=0.335, lr=1]\nSteps:  22%|██▏       | 266/1200 [02:10<07:54,  1.97it/s, loss=0.794, lr=1]\nSteps:  22%|██▏       | 267/1200 [02:11<07:49,  1.99it/s, loss=0.794, lr=1]\nSteps:  22%|██▏       | 267/1200 [02:11<07:49,  1.99it/s, loss=0.604, lr=1]\nSteps:  22%|██▏       | 268/1200 [02:11<07:45,  2.00it/s, loss=0.604, lr=1]\nSteps:  22%|██▏       | 268/1200 [02:11<07:45,  2.00it/s, loss=0.327, lr=1]\nSteps:  22%|██▏       | 269/1200 [02:12<07:42,  2.01it/s, loss=0.327, lr=1]\nSteps:  22%|██▏       | 269/1200 [02:12<07:42,  2.01it/s, loss=0.646, lr=1]\nSteps:  22%|██▎       | 270/1200 [02:12<07:40,  2.02it/s, loss=0.646, lr=1]\nSteps:  22%|██▎       | 270/1200 [02:12<07:40,  2.02it/s, loss=0.317, lr=1]\nSteps:  23%|██▎       | 271/1200 [02:13<07:39,  2.02it/s, loss=0.317, lr=1]\nSteps:  23%|██▎       | 271/1200 [02:13<07:39,  2.02it/s, loss=0.588, lr=1]\nSteps:  23%|██▎       | 272/1200 [02:13<07:37,  2.03it/s, loss=0.588, lr=1]\nSteps:  23%|██▎       | 272/1200 [02:13<07:37,  2.03it/s, loss=0.404, lr=1]\nSteps:  23%|██▎       | 273/1200 [02:14<07:37,  2.03it/s, loss=0.404, lr=1]\nSteps:  23%|██▎       | 273/1200 [02:14<07:37,  2.03it/s, loss=0.773, lr=1]\nSteps:  23%|██▎       | 274/1200 [02:14<07:36,  2.03it/s, loss=0.773, lr=1]\nSteps:  23%|██▎       | 274/1200 [02:14<07:36,  2.03it/s, loss=0.607, lr=1]\nSteps:  23%|██▎       | 275/1200 [02:15<07:35,  2.03it/s, loss=0.607, lr=1]\nSteps:  23%|██▎       | 275/1200 [02:15<07:35,  2.03it/s, loss=0.592, lr=1]\nSteps:  23%|██▎       | 276/1200 [02:15<07:34,  2.03it/s, loss=0.592, lr=1]\nSteps:  23%|██▎       | 276/1200 [02:15<07:34,  2.03it/s, loss=0.353, lr=1]\nSteps:  23%|██▎       | 277/1200 [02:16<07:36,  2.02it/s, loss=0.353, lr=1]\nSteps:  23%|██▎       | 277/1200 [02:16<07:36,  2.02it/s, loss=0.955, lr=1]\nSteps:  23%|██▎       | 278/1200 [02:16<07:34,  2.03it/s, loss=0.955, lr=1]\nSteps:  23%|██▎       | 278/1200 [02:16<07:34,  2.03it/s, loss=0.788, lr=1]\nSteps:  23%|██▎       | 279/1200 [02:17<07:33,  2.03it/s, loss=0.788, lr=1]\nSteps:  23%|██▎       | 279/1200 [02:17<07:33,  2.03it/s, loss=0.691, lr=1]\nSteps:  23%|██▎       | 280/1200 [02:17<07:32,  2.03it/s, loss=0.691, lr=1]\nSteps:  23%|██▎       | 280/1200 [02:17<07:32,  2.03it/s, loss=0.323, lr=1]\nSteps:  23%|██▎       | 281/1200 [02:18<07:31,  2.03it/s, loss=0.323, lr=1]\nSteps:  23%|██▎       | 281/1200 [02:18<07:31,  2.03it/s, loss=0.471, lr=1]\nSteps:  24%|██▎       | 282/1200 [02:18<07:31,  2.03it/s, loss=0.471, lr=1]\nSteps:  24%|██▎       | 282/1200 [02:18<07:31,  2.03it/s, loss=0.868, lr=1]\nSteps:  24%|██▎       | 283/1200 [02:19<07:30,  2.04it/s, loss=0.868, lr=1]\nSteps:  24%|██▎       | 283/1200 [02:19<07:30,  2.04it/s, loss=0.917, lr=1]\nSteps:  24%|██▎       | 284/1200 [02:19<07:29,  2.04it/s, loss=0.917, lr=1]\nSteps:  24%|██▎       | 284/1200 [02:19<07:29,  2.04it/s, loss=0.64, lr=1] \nSteps:  24%|██▍       | 285/1200 [02:20<07:29,  2.04it/s, loss=0.64, lr=1]\nSteps:  24%|██▍       | 285/1200 [02:20<07:29,  2.04it/s, loss=0.307, lr=1]\nSteps:  24%|██▍       | 286/1200 [02:20<07:28,  2.04it/s, loss=0.307, lr=1]\nSteps:  24%|██▍       | 286/1200 [02:20<07:28,  2.04it/s, loss=0.273, lr=1]\nSteps:  24%|██▍       | 287/1200 [02:21<07:27,  2.04it/s, loss=0.273, lr=1]\nSteps:  24%|██▍       | 287/1200 [02:21<07:27,  2.04it/s, loss=0.805, lr=1]\nSteps:  24%|██▍       | 288/1200 [02:21<07:27,  2.04it/s, loss=0.805, lr=1]\nSteps:  24%|██▍       | 288/1200 [02:21<07:27,  2.04it/s, loss=0.618, lr=1]\nSteps:  24%|██▍       | 289/1200 [02:22<07:28,  2.03it/s, loss=0.618, lr=1]\nSteps:  24%|██▍       | 289/1200 [02:22<07:28,  2.03it/s, loss=0.297, lr=1]\nSteps:  24%|██▍       | 290/1200 [02:22<07:27,  2.03it/s, loss=0.297, lr=1]\nSteps:  24%|██▍       | 290/1200 [02:22<07:27,  2.03it/s, loss=0.645, lr=1]\nSteps:  24%|██▍       | 291/1200 [02:23<07:26,  2.03it/s, loss=0.645, lr=1]\nSteps:  24%|██▍       | 291/1200 [02:23<07:26,  2.03it/s, loss=0.318, lr=1]\nSteps:  24%|██▍       | 292/1200 [02:23<07:26,  2.04it/s, loss=0.318, lr=1]\nSteps:  24%|██▍       | 292/1200 [02:23<07:26,  2.04it/s, loss=0.294, lr=1]\nSteps:  24%|██▍       | 293/1200 [02:24<07:25,  2.04it/s, loss=0.294, lr=1]\nSteps:  24%|██▍       | 293/1200 [02:24<07:25,  2.04it/s, loss=0.33, lr=1] \nSteps:  24%|██▍       | 294/1200 [02:24<07:24,  2.04it/s, loss=0.33, lr=1]\nSteps:  24%|██▍       | 294/1200 [02:24<07:24,  2.04it/s, loss=0.786, lr=1]\nSteps:  25%|██▍       | 295/1200 [02:25<07:24,  2.04it/s, loss=0.786, lr=1]\nSteps:  25%|██▍       | 295/1200 [02:25<07:24,  2.04it/s, loss=0.945, lr=1]\nSteps:  25%|██▍       | 296/1200 [02:25<07:23,  2.04it/s, loss=0.945, lr=1]\nSteps:  25%|██▍       | 296/1200 [02:25<07:23,  2.04it/s, loss=0.372, lr=1]\nSteps:  25%|██▍       | 297/1200 [02:26<07:23,  2.04it/s, loss=0.372, lr=1]\nSteps:  25%|██▍       | 297/1200 [02:26<07:23,  2.04it/s, loss=0.384, lr=1]\nSteps:  25%|██▍       | 298/1200 [02:26<07:22,  2.04it/s, loss=0.384, lr=1]\nSteps:  25%|██▍       | 298/1200 [02:26<07:22,  2.04it/s, loss=0.313, lr=1]\nSteps:  25%|██▍       | 299/1200 [02:27<07:21,  2.04it/s, loss=0.313, lr=1]\nSteps:  25%|██▍       | 299/1200 [02:27<07:21,  2.04it/s, loss=0.351, lr=1]\nSteps:  25%|██▌       | 300/1200 [02:27<07:21,  2.04it/s, loss=0.351, lr=1]\nSteps:  25%|██▌       | 300/1200 [02:27<07:21,  2.04it/s, loss=0.782, lr=1]\nSteps:  25%|██▌       | 301/1200 [02:28<07:22,  2.03it/s, loss=0.782, lr=1]\nSteps:  25%|██▌       | 301/1200 [02:28<07:22,  2.03it/s, loss=0.558, lr=1]\nSteps:  25%|██▌       | 302/1200 [02:28<07:21,  2.03it/s, loss=0.558, lr=1]\nSteps:  25%|██▌       | 302/1200 [02:28<07:21,  2.03it/s, loss=0.4, lr=1]  \nSteps:  25%|██▌       | 303/1200 [02:29<07:20,  2.03it/s, loss=0.4, lr=1]\nSteps:  25%|██▌       | 303/1200 [02:29<07:20,  2.03it/s, loss=0.31, lr=1]\nSteps:  25%|██▌       | 304/1200 [02:29<07:20,  2.04it/s, loss=0.31, lr=1]\nSteps:  25%|██▌       | 304/1200 [02:29<07:20,  2.04it/s, loss=0.499, lr=1]\nSteps:  25%|██▌       | 305/1200 [02:30<07:19,  2.04it/s, loss=0.499, lr=1]\nSteps:  25%|██▌       | 305/1200 [02:30<07:19,  2.04it/s, loss=0.503, lr=1]\nSteps:  26%|██▌       | 306/1200 [02:30<07:18,  2.04it/s, loss=0.503, lr=1]\nSteps:  26%|██▌       | 306/1200 [02:30<07:18,  2.04it/s, loss=0.353, lr=1]\nSteps:  26%|██▌       | 307/1200 [02:31<07:18,  2.04it/s, loss=0.353, lr=1]\nSteps:  26%|██▌       | 307/1200 [02:31<07:18,  2.04it/s, loss=0.49, lr=1] \nSteps:  26%|██▌       | 308/1200 [02:31<07:17,  2.04it/s, loss=0.49, lr=1]\nSteps:  26%|██▌       | 308/1200 [02:31<07:17,  2.04it/s, loss=0.623, lr=1]\nSteps:  26%|██▌       | 309/1200 [02:32<07:16,  2.04it/s, loss=0.623, lr=1]\nSteps:  26%|██▌       | 309/1200 [02:32<07:16,  2.04it/s, loss=0.265, lr=1]\nSteps:  26%|██▌       | 310/1200 [02:32<07:16,  2.04it/s, loss=0.265, lr=1]\nSteps:  26%|██▌       | 310/1200 [02:32<07:16,  2.04it/s, loss=0.639, lr=1]\nSteps:  26%|██▌       | 311/1200 [02:32<07:15,  2.04it/s, loss=0.639, lr=1]\nSteps:  26%|██▌       | 311/1200 [02:32<07:15,  2.04it/s, loss=0.367, lr=1]\nSteps:  26%|██▌       | 312/1200 [02:33<07:15,  2.04it/s, loss=0.367, lr=1]\nSteps:  26%|██▌       | 312/1200 [02:33<07:15,  2.04it/s, loss=0.362, lr=1]\nSteps:  26%|██▌       | 313/1200 [02:33<07:16,  2.03it/s, loss=0.362, lr=1]\nSteps:  26%|██▌       | 313/1200 [02:33<07:16,  2.03it/s, loss=0.757, lr=1]\nSteps:  26%|██▌       | 314/1200 [02:34<07:15,  2.03it/s, loss=0.757, lr=1]\nSteps:  26%|██▌       | 314/1200 [02:34<07:15,  2.03it/s, loss=0.379, lr=1]\nSteps:  26%|██▋       | 315/1200 [02:34<07:14,  2.04it/s, loss=0.379, lr=1]\nSteps:  26%|██▋       | 315/1200 [02:34<07:14,  2.04it/s, loss=0.377, lr=1]\nSteps:  26%|██▋       | 316/1200 [02:35<07:14,  2.04it/s, loss=0.377, lr=1]\nSteps:  26%|██▋       | 316/1200 [02:35<07:14,  2.04it/s, loss=0.604, lr=1]\nSteps:  26%|██▋       | 317/1200 [02:35<07:13,  2.04it/s, loss=0.604, lr=1]\nSteps:  26%|██▋       | 317/1200 [02:35<07:13,  2.04it/s, loss=0.32, lr=1] \nSteps:  26%|██▋       | 318/1200 [02:36<07:12,  2.04it/s, loss=0.32, lr=1]\nSteps:  26%|██▋       | 318/1200 [02:36<07:12,  2.04it/s, loss=0.515, lr=1]\nSteps:  27%|██▋       | 319/1200 [02:36<07:12,  2.04it/s, loss=0.515, lr=1]\nSteps:  27%|██▋       | 319/1200 [02:36<07:12,  2.04it/s, loss=0.522, lr=1]\nSteps:  27%|██▋       | 320/1200 [02:37<07:11,  2.04it/s, loss=0.522, lr=1]\nSteps:  27%|██▋       | 320/1200 [02:37<07:11,  2.04it/s, loss=0.916, lr=1]\nSteps:  27%|██▋       | 321/1200 [02:37<07:11,  2.04it/s, loss=0.916, lr=1]\nSteps:  27%|██▋       | 321/1200 [02:37<07:11,  2.04it/s, loss=0.334, lr=1]\nSteps:  27%|██▋       | 322/1200 [02:38<07:11,  2.04it/s, loss=0.334, lr=1]\nSteps:  27%|██▋       | 322/1200 [02:38<07:11,  2.04it/s, loss=0.638, lr=1]\nSteps:  27%|██▋       | 323/1200 [02:38<07:10,  2.04it/s, loss=0.638, lr=1]\nSteps:  27%|██▋       | 323/1200 [02:38<07:10,  2.04it/s, loss=0.361, lr=1]\nSteps:  27%|██▋       | 324/1200 [02:39<07:10,  2.04it/s, loss=0.361, lr=1]\nSteps:  27%|██▋       | 324/1200 [02:39<07:10,  2.04it/s, loss=0.408, lr=1]\nSteps:  27%|██▋       | 325/1200 [02:39<07:11,  2.03it/s, loss=0.408, lr=1]\nSteps:  27%|██▋       | 325/1200 [02:39<07:11,  2.03it/s, loss=0.41, lr=1] \nSteps:  27%|██▋       | 326/1200 [02:40<07:10,  2.03it/s, loss=0.41, lr=1]\nSteps:  27%|██▋       | 326/1200 [02:40<07:10,  2.03it/s, loss=0.402, lr=1]\nSteps:  27%|██▋       | 327/1200 [02:40<07:09,  2.03it/s, loss=0.402, lr=1]\nSteps:  27%|██▋       | 327/1200 [02:40<07:09,  2.03it/s, loss=0.636, lr=1]\nSteps:  27%|██▋       | 328/1200 [02:41<07:08,  2.03it/s, loss=0.636, lr=1]\nSteps:  27%|██▋       | 328/1200 [02:41<07:08,  2.03it/s, loss=0.687, lr=1]\nSteps:  27%|██▋       | 329/1200 [02:41<07:07,  2.04it/s, loss=0.687, lr=1]\nSteps:  27%|██▋       | 329/1200 [02:41<07:07,  2.04it/s, loss=0.46, lr=1] \nSteps:  28%|██▊       | 330/1200 [02:42<07:07,  2.04it/s, loss=0.46, lr=1]\nSteps:  28%|██▊       | 330/1200 [02:42<07:07,  2.04it/s, loss=0.369, lr=1]\nSteps:  28%|██▊       | 331/1200 [02:42<07:06,  2.04it/s, loss=0.369, lr=1]\nSteps:  28%|██▊       | 331/1200 [02:42<07:06,  2.04it/s, loss=0.599, lr=1]\nSteps:  28%|██▊       | 332/1200 [02:43<07:05,  2.04it/s, loss=0.599, lr=1]\nSteps:  28%|██▊       | 332/1200 [02:43<07:05,  2.04it/s, loss=0.332, lr=1]\nSteps:  28%|██▊       | 333/1200 [02:43<07:05,  2.04it/s, loss=0.332, lr=1]\nSteps:  28%|██▊       | 333/1200 [02:43<07:05,  2.04it/s, loss=0.634, lr=1]\nSteps:  28%|██▊       | 334/1200 [02:44<07:04,  2.04it/s, loss=0.634, lr=1]\nSteps:  28%|██▊       | 334/1200 [02:44<07:04,  2.04it/s, loss=0.381, lr=1]\nSteps:  28%|██▊       | 335/1200 [02:44<07:04,  2.04it/s, loss=0.381, lr=1]\nSteps:  28%|██▊       | 335/1200 [02:44<07:04,  2.04it/s, loss=0.544, lr=1]\nSteps:  28%|██▊       | 336/1200 [02:45<07:03,  2.04it/s, loss=0.544, lr=1]\nSteps:  28%|██▊       | 336/1200 [02:45<07:03,  2.04it/s, loss=0.356, lr=1]\nSteps:  28%|██▊       | 337/1200 [02:45<07:05,  2.03it/s, loss=0.356, lr=1]\nSteps:  28%|██▊       | 337/1200 [02:45<07:05,  2.03it/s, loss=0.477, lr=1]\nSteps:  28%|██▊       | 338/1200 [02:46<07:04,  2.03it/s, loss=0.477, lr=1]\nSteps:  28%|██▊       | 338/1200 [02:46<07:04,  2.03it/s, loss=0.572, lr=1]\nSteps:  28%|██▊       | 339/1200 [02:46<07:03,  2.03it/s, loss=0.572, lr=1]\nSteps:  28%|██▊       | 339/1200 [02:46<07:03,  2.03it/s, loss=0.347, lr=1]\nSteps:  28%|██▊       | 340/1200 [02:47<07:02,  2.03it/s, loss=0.347, lr=1]\nSteps:  28%|██▊       | 340/1200 [02:47<07:02,  2.03it/s, loss=0.309, lr=1]\nSteps:  28%|██▊       | 341/1200 [02:47<07:01,  2.04it/s, loss=0.309, lr=1]\nSteps:  28%|██▊       | 341/1200 [02:47<07:01,  2.04it/s, loss=0.286, lr=1]\nSteps:  28%|██▊       | 342/1200 [02:48<07:01,  2.04it/s, loss=0.286, lr=1]\nSteps:  28%|██▊       | 342/1200 [02:48<07:01,  2.04it/s, loss=0.608, lr=1]\nSteps:  29%|██▊       | 343/1200 [02:48<07:00,  2.04it/s, loss=0.608, lr=1]\nSteps:  29%|██▊       | 343/1200 [02:48<07:00,  2.04it/s, loss=0.523, lr=1]\nSteps:  29%|██▊       | 344/1200 [02:49<06:59,  2.04it/s, loss=0.523, lr=1]\nSteps:  29%|██▊       | 344/1200 [02:49<06:59,  2.04it/s, loss=0.592, lr=1]\nSteps:  29%|██▉       | 345/1200 [02:49<06:59,  2.04it/s, loss=0.592, lr=1]\nSteps:  29%|██▉       | 345/1200 [02:49<06:59,  2.04it/s, loss=0.302, lr=1]\nSteps:  29%|██▉       | 346/1200 [02:50<06:58,  2.04it/s, loss=0.302, lr=1]\nSteps:  29%|██▉       | 346/1200 [02:50<06:58,  2.04it/s, loss=0.607, lr=1]\nSteps:  29%|██▉       | 347/1200 [02:50<06:58,  2.04it/s, loss=0.607, lr=1]\nSteps:  29%|██▉       | 347/1200 [02:50<06:58,  2.04it/s, loss=0.671, lr=1]\nSteps:  29%|██▉       | 348/1200 [02:51<06:57,  2.04it/s, loss=0.671, lr=1]\nSteps:  29%|██▉       | 348/1200 [02:51<06:57,  2.04it/s, loss=0.308, lr=1]\nSteps:  29%|██▉       | 349/1200 [02:51<06:59,  2.03it/s, loss=0.308, lr=1]\nSteps:  29%|██▉       | 349/1200 [02:51<06:59,  2.03it/s, loss=0.616, lr=1]\nSteps:  29%|██▉       | 350/1200 [02:52<06:58,  2.03it/s, loss=0.616, lr=1]\nSteps:  29%|██▉       | 350/1200 [02:52<06:58,  2.03it/s, loss=0.327, lr=1]\nSteps:  29%|██▉       | 351/1200 [02:52<06:57,  2.03it/s, loss=0.327, lr=1]\nSteps:  29%|██▉       | 351/1200 [02:52<06:57,  2.03it/s, loss=0.323, lr=1]\nSteps:  29%|██▉       | 352/1200 [02:53<06:56,  2.04it/s, loss=0.323, lr=1]\nSteps:  29%|██▉       | 352/1200 [02:53<06:56,  2.04it/s, loss=0.425, lr=1]\nSteps:  29%|██▉       | 353/1200 [02:53<06:56,  2.04it/s, loss=0.425, lr=1]\nSteps:  29%|██▉       | 353/1200 [02:53<06:56,  2.04it/s, loss=0.438, lr=1]\nSteps:  30%|██▉       | 354/1200 [02:54<06:55,  2.04it/s, loss=0.438, lr=1]\nSteps:  30%|██▉       | 354/1200 [02:54<06:55,  2.04it/s, loss=0.383, lr=1]\nSteps:  30%|██▉       | 355/1200 [02:54<06:55,  2.03it/s, loss=0.383, lr=1]\nSteps:  30%|██▉       | 355/1200 [02:54<06:55,  2.03it/s, loss=0.591, lr=1]\nSteps:  30%|██▉       | 356/1200 [02:55<06:54,  2.04it/s, loss=0.591, lr=1]\nSteps:  30%|██▉       | 356/1200 [02:55<06:54,  2.04it/s, loss=1.06, lr=1] \nSteps:  30%|██▉       | 357/1200 [02:55<06:54,  2.04it/s, loss=1.06, lr=1]\nSteps:  30%|██▉       | 357/1200 [02:55<06:54,  2.04it/s, loss=0.631, lr=1]\nSteps:  30%|██▉       | 358/1200 [02:56<06:53,  2.04it/s, loss=0.631, lr=1]\nSteps:  30%|██▉       | 358/1200 [02:56<06:53,  2.04it/s, loss=0.646, lr=1]\nSteps:  30%|██▉       | 359/1200 [02:56<06:52,  2.04it/s, loss=0.646, lr=1]\nSteps:  30%|██▉       | 359/1200 [02:56<06:52,  2.04it/s, loss=0.473, lr=1]\nSteps:  30%|███       | 360/1200 [02:57<06:52,  2.04it/s, loss=0.473, lr=1]\nSteps:  30%|███       | 360/1200 [02:57<06:52,  2.04it/s, loss=0.318, lr=1]\nSteps:  30%|███       | 361/1200 [02:57<06:53,  2.03it/s, loss=0.318, lr=1]\nSteps:  30%|███       | 361/1200 [02:57<06:53,  2.03it/s, loss=0.302, lr=1]\nSteps:  30%|███       | 362/1200 [02:58<06:52,  2.03it/s, loss=0.302, lr=1]\nSteps:  30%|███       | 362/1200 [02:58<06:52,  2.03it/s, loss=0.322, lr=1]\nSteps:  30%|███       | 363/1200 [02:58<06:51,  2.03it/s, loss=0.322, lr=1]\nSteps:  30%|███       | 363/1200 [02:58<06:51,  2.03it/s, loss=0.542, lr=1]\nSteps:  30%|███       | 364/1200 [02:59<06:50,  2.04it/s, loss=0.542, lr=1]\nSteps:  30%|███       | 364/1200 [02:59<06:50,  2.04it/s, loss=0.281, lr=1]\nSteps:  30%|███       | 365/1200 [02:59<06:49,  2.04it/s, loss=0.281, lr=1]\nSteps:  30%|███       | 365/1200 [02:59<06:49,  2.04it/s, loss=1.07, lr=1] \nSteps:  30%|███       | 366/1200 [03:00<06:49,  2.04it/s, loss=1.07, lr=1]\nSteps:  30%|███       | 366/1200 [03:00<06:49,  2.04it/s, loss=0.342, lr=1]\nSteps:  31%|███       | 367/1200 [03:00<06:48,  2.04it/s, loss=0.342, lr=1]\nSteps:  31%|███       | 367/1200 [03:00<06:48,  2.04it/s, loss=0.602, lr=1]\nSteps:  31%|███       | 368/1200 [03:00<06:48,  2.04it/s, loss=0.602, lr=1]\nSteps:  31%|███       | 368/1200 [03:00<06:48,  2.04it/s, loss=0.436, lr=1]\nSteps:  31%|███       | 369/1200 [03:01<06:47,  2.04it/s, loss=0.436, lr=1]\nSteps:  31%|███       | 369/1200 [03:01<06:47,  2.04it/s, loss=0.688, lr=1]\nSteps:  31%|███       | 370/1200 [03:01<06:47,  2.03it/s, loss=0.688, lr=1]\nSteps:  31%|███       | 370/1200 [03:01<06:47,  2.03it/s, loss=0.353, lr=1]\nSteps:  31%|███       | 371/1200 [03:02<06:47,  2.04it/s, loss=0.353, lr=1]\nSteps:  31%|███       | 371/1200 [03:02<06:47,  2.04it/s, loss=0.537, lr=1]\nSteps:  31%|███       | 372/1200 [03:02<06:46,  2.04it/s, loss=0.537, lr=1]\nSteps:  31%|███       | 372/1200 [03:02<06:46,  2.04it/s, loss=0.547, lr=1]\nSteps:  31%|███       | 373/1200 [03:03<06:47,  2.03it/s, loss=0.547, lr=1]\nSteps:  31%|███       | 373/1200 [03:03<06:47,  2.03it/s, loss=0.443, lr=1]\nSteps:  31%|███       | 374/1200 [03:03<06:46,  2.03it/s, loss=0.443, lr=1]\nSteps:  31%|███       | 374/1200 [03:03<06:46,  2.03it/s, loss=0.983, lr=1]\nSteps:  31%|███▏      | 375/1200 [03:04<06:47,  2.03it/s, loss=0.983, lr=1]\nSteps:  31%|███▏      | 375/1200 [03:04<06:47,  2.03it/s, loss=0.298, lr=1]\nSteps:  31%|███▏      | 376/1200 [03:04<06:46,  2.03it/s, loss=0.298, lr=1]\nSteps:  31%|███▏      | 376/1200 [03:04<06:46,  2.03it/s, loss=0.601, lr=1]\nSteps:  31%|███▏      | 377/1200 [03:05<06:45,  2.03it/s, loss=0.601, lr=1]\nSteps:  31%|███▏      | 377/1200 [03:05<06:45,  2.03it/s, loss=0.714, lr=1]\nSteps:  32%|███▏      | 378/1200 [03:05<06:44,  2.03it/s, loss=0.714, lr=1]\nSteps:  32%|███▏      | 378/1200 [03:05<06:44,  2.03it/s, loss=0.646, lr=1]\nSteps:  32%|███▏      | 379/1200 [03:06<06:43,  2.03it/s, loss=0.646, lr=1]\nSteps:  32%|███▏      | 379/1200 [03:06<06:43,  2.03it/s, loss=0.778, lr=1]\nSteps:  32%|███▏      | 380/1200 [03:06<06:43,  2.03it/s, loss=0.778, lr=1]\nSteps:  32%|███▏      | 380/1200 [03:06<06:43,  2.03it/s, loss=0.351, lr=1]\nSteps:  32%|███▏      | 381/1200 [03:07<06:42,  2.04it/s, loss=0.351, lr=1]\nSteps:  32%|███▏      | 381/1200 [03:07<06:42,  2.04it/s, loss=0.271, lr=1]\nSteps:  32%|███▏      | 382/1200 [03:07<06:41,  2.03it/s, loss=0.271, lr=1]\nSteps:  32%|███▏      | 382/1200 [03:07<06:41,  2.03it/s, loss=0.581, lr=1]\nSteps:  32%|███▏      | 383/1200 [03:08<06:41,  2.04it/s, loss=0.581, lr=1]\nSteps:  32%|███▏      | 383/1200 [03:08<06:41,  2.04it/s, loss=0.376, lr=1]\nSteps:  32%|███▏      | 384/1200 [03:08<06:40,  2.04it/s, loss=0.376, lr=1]\nSteps:  32%|███▏      | 384/1200 [03:08<06:40,  2.04it/s, loss=0.918, lr=1]\nSteps:  32%|███▏      | 385/1200 [03:09<06:42,  2.03it/s, loss=0.918, lr=1]\nSteps:  32%|███▏      | 385/1200 [03:09<06:42,  2.03it/s, loss=0.33, lr=1] \nSteps:  32%|███▏      | 386/1200 [03:09<06:41,  2.03it/s, loss=0.33, lr=1]\nSteps:  32%|███▏      | 386/1200 [03:09<06:41,  2.03it/s, loss=0.298, lr=1]\nSteps:  32%|███▏      | 387/1200 [03:10<06:40,  2.03it/s, loss=0.298, lr=1]\nSteps:  32%|███▏      | 387/1200 [03:10<06:40,  2.03it/s, loss=0.596, lr=1]\nSteps:  32%|███▏      | 388/1200 [03:10<06:39,  2.03it/s, loss=0.596, lr=1]\nSteps:  32%|███▏      | 388/1200 [03:10<06:39,  2.03it/s, loss=0.358, lr=1]\nSteps:  32%|███▏      | 389/1200 [03:11<06:39,  2.03it/s, loss=0.358, lr=1]\nSteps:  32%|███▏      | 389/1200 [03:11<06:39,  2.03it/s, loss=0.489, lr=1]\nSteps:  32%|███▎      | 390/1200 [03:11<06:38,  2.03it/s, loss=0.489, lr=1]\nSteps:  32%|███▎      | 390/1200 [03:11<06:38,  2.03it/s, loss=0.618, lr=1]\nSteps:  33%|███▎      | 391/1200 [03:12<06:37,  2.03it/s, loss=0.618, lr=1]\nSteps:  33%|███▎      | 391/1200 [03:12<06:37,  2.03it/s, loss=0.433, lr=1]\nSteps:  33%|███▎      | 392/1200 [03:12<06:37,  2.04it/s, loss=0.433, lr=1]\nSteps:  33%|███▎      | 392/1200 [03:12<06:37,  2.04it/s, loss=0.621, lr=1]\nSteps:  33%|███▎      | 393/1200 [03:13<06:36,  2.04it/s, loss=0.621, lr=1]\nSteps:  33%|███▎      | 393/1200 [03:13<06:36,  2.04it/s, loss=0.439, lr=1]\nSteps:  33%|███▎      | 394/1200 [03:13<06:35,  2.04it/s, loss=0.439, lr=1]\nSteps:  33%|███▎      | 394/1200 [03:13<06:35,  2.04it/s, loss=0.622, lr=1]\nSteps:  33%|███▎      | 395/1200 [03:14<06:35,  2.04it/s, loss=0.622, lr=1]\nSteps:  33%|███▎      | 395/1200 [03:14<06:35,  2.04it/s, loss=0.44, lr=1] \nSteps:  33%|███▎      | 396/1200 [03:14<06:35,  2.03it/s, loss=0.44, lr=1]\nSteps:  33%|███▎      | 396/1200 [03:14<06:35,  2.03it/s, loss=0.618, lr=1]\nSteps:  33%|███▎      | 397/1200 [03:15<06:36,  2.03it/s, loss=0.618, lr=1]\nSteps:  33%|███▎      | 397/1200 [03:15<06:36,  2.03it/s, loss=0.329, lr=1]\nSteps:  33%|███▎      | 398/1200 [03:15<06:35,  2.03it/s, loss=0.329, lr=1]\nSteps:  33%|███▎      | 398/1200 [03:15<06:35,  2.03it/s, loss=0.431, lr=1]\nSteps:  33%|███▎      | 399/1200 [03:16<06:34,  2.03it/s, loss=0.431, lr=1]\nSteps:  33%|███▎      | 399/1200 [03:16<06:34,  2.03it/s, loss=0.345, lr=1]\nSteps:  33%|███▎      | 400/1200 [03:16<06:33,  2.03it/s, loss=0.345, lr=1]\nSteps:  33%|███▎      | 400/1200 [03:16<06:33,  2.03it/s, loss=0.515, lr=1]\nSteps:  33%|███▎      | 401/1200 [03:17<06:32,  2.03it/s, loss=0.515, lr=1]\nSteps:  33%|███▎      | 401/1200 [03:17<06:32,  2.03it/s, loss=0.636, lr=1]\nSteps:  34%|███▎      | 402/1200 [03:17<06:32,  2.03it/s, loss=0.636, lr=1]\nSteps:  34%|███▎      | 402/1200 [03:17<06:32,  2.03it/s, loss=0.327, lr=1]\nSteps:  34%|███▎      | 403/1200 [03:18<06:31,  2.04it/s, loss=0.327, lr=1]\nSteps:  34%|███▎      | 403/1200 [03:18<06:31,  2.04it/s, loss=0.33, lr=1] \nSteps:  34%|███▎      | 404/1200 [03:18<06:30,  2.04it/s, loss=0.33, lr=1]\nSteps:  34%|███▎      | 404/1200 [03:18<06:30,  2.04it/s, loss=0.394, lr=1]\nSteps:  34%|███▍      | 405/1200 [03:19<06:30,  2.04it/s, loss=0.394, lr=1]\nSteps:  34%|███▍      | 405/1200 [03:19<06:30,  2.04it/s, loss=0.629, lr=1]\nSteps:  34%|███▍      | 406/1200 [03:19<06:29,  2.04it/s, loss=0.629, lr=1]\nSteps:  34%|███▍      | 406/1200 [03:19<06:29,  2.04it/s, loss=0.374, lr=1]\nSteps:  34%|███▍      | 407/1200 [03:20<06:29,  2.04it/s, loss=0.374, lr=1]\nSteps:  34%|███▍      | 407/1200 [03:20<06:29,  2.04it/s, loss=0.721, lr=1]\nSteps:  34%|███▍      | 408/1200 [03:20<06:28,  2.04it/s, loss=0.721, lr=1]\nSteps:  34%|███▍      | 408/1200 [03:20<06:28,  2.04it/s, loss=0.656, lr=1]\nSteps:  34%|███▍      | 409/1200 [03:21<06:30,  2.03it/s, loss=0.656, lr=1]\nSteps:  34%|███▍      | 409/1200 [03:21<06:30,  2.03it/s, loss=0.412, lr=1]\nSteps:  34%|███▍      | 410/1200 [03:21<06:29,  2.03it/s, loss=0.412, lr=1]\nSteps:  34%|███▍      | 410/1200 [03:21<06:29,  2.03it/s, loss=0.342, lr=1]\nSteps:  34%|███▍      | 411/1200 [03:22<06:28,  2.03it/s, loss=0.342, lr=1]\nSteps:  34%|███▍      | 411/1200 [03:22<06:28,  2.03it/s, loss=0.42, lr=1] \nSteps:  34%|███▍      | 412/1200 [03:22<06:27,  2.03it/s, loss=0.42, lr=1]\nSteps:  34%|███▍      | 412/1200 [03:22<06:27,  2.03it/s, loss=0.326, lr=1]\nSteps:  34%|███▍      | 413/1200 [03:23<06:27,  2.03it/s, loss=0.326, lr=1]\nSteps:  34%|███▍      | 413/1200 [03:23<06:27,  2.03it/s, loss=0.419, lr=1]\nSteps:  34%|███▍      | 414/1200 [03:23<06:26,  2.03it/s, loss=0.419, lr=1]\nSteps:  34%|███▍      | 414/1200 [03:23<06:26,  2.03it/s, loss=0.59, lr=1] \nSteps:  35%|███▍      | 415/1200 [03:24<06:25,  2.04it/s, loss=0.59, lr=1]\nSteps:  35%|███▍      | 415/1200 [03:24<06:25,  2.04it/s, loss=0.414, lr=1]\nSteps:  35%|███▍      | 416/1200 [03:24<06:26,  2.03it/s, loss=0.414, lr=1]\nSteps:  35%|███▍      | 416/1200 [03:24<06:26,  2.03it/s, loss=0.36, lr=1] \nSteps:  35%|███▍      | 417/1200 [03:25<06:25,  2.03it/s, loss=0.36, lr=1]\nSteps:  35%|███▍      | 417/1200 [03:25<06:25,  2.03it/s, loss=0.54, lr=1]\nSteps:  35%|███▍      | 418/1200 [03:25<06:25,  2.03it/s, loss=0.54, lr=1]\nSteps:  35%|███▍      | 418/1200 [03:25<06:25,  2.03it/s, loss=0.317, lr=1]\nSteps:  35%|███▍      | 419/1200 [03:26<06:24,  2.03it/s, loss=0.317, lr=1]\nSteps:  35%|███▍      | 419/1200 [03:26<06:24,  2.03it/s, loss=0.45, lr=1] \nSteps:  35%|███▌      | 420/1200 [03:26<06:23,  2.03it/s, loss=0.45, lr=1]\nSteps:  35%|███▌      | 420/1200 [03:26<06:23,  2.03it/s, loss=0.356, lr=1]\nSteps:  35%|███▌      | 421/1200 [03:27<06:24,  2.03it/s, loss=0.356, lr=1]\nSteps:  35%|███▌      | 421/1200 [03:27<06:24,  2.03it/s, loss=0.439, lr=1]\nSteps:  35%|███▌      | 422/1200 [03:27<06:23,  2.03it/s, loss=0.439, lr=1]\nSteps:  35%|███▌      | 422/1200 [03:27<06:23,  2.03it/s, loss=0.294, lr=1]\nSteps:  35%|███▌      | 423/1200 [03:28<06:22,  2.03it/s, loss=0.294, lr=1]\nSteps:  35%|███▌      | 423/1200 [03:28<06:22,  2.03it/s, loss=0.282, lr=1]\nSteps:  35%|███▌      | 424/1200 [03:28<06:21,  2.03it/s, loss=0.282, lr=1]\nSteps:  35%|███▌      | 424/1200 [03:28<06:21,  2.03it/s, loss=0.328, lr=1]\nSteps:  35%|███▌      | 425/1200 [03:29<06:20,  2.04it/s, loss=0.328, lr=1]\nSteps:  35%|███▌      | 425/1200 [03:29<06:20,  2.04it/s, loss=0.348, lr=1]\nSteps:  36%|███▌      | 426/1200 [03:29<06:19,  2.04it/s, loss=0.348, lr=1]\nSteps:  36%|███▌      | 426/1200 [03:29<06:19,  2.04it/s, loss=0.393, lr=1]\nSteps:  36%|███▌      | 427/1200 [03:30<06:19,  2.04it/s, loss=0.393, lr=1]\nSteps:  36%|███▌      | 427/1200 [03:30<06:19,  2.04it/s, loss=0.326, lr=1]\nSteps:  36%|███▌      | 428/1200 [03:30<06:18,  2.04it/s, loss=0.326, lr=1]\nSteps:  36%|███▌      | 428/1200 [03:30<06:18,  2.04it/s, loss=0.602, lr=1]\nSteps:  36%|███▌      | 429/1200 [03:30<06:18,  2.04it/s, loss=0.602, lr=1]\nSteps:  36%|███▌      | 429/1200 [03:30<06:18,  2.04it/s, loss=0.498, lr=1]\nSteps:  36%|███▌      | 430/1200 [03:31<06:17,  2.04it/s, loss=0.498, lr=1]\nSteps:  36%|███▌      | 430/1200 [03:31<06:17,  2.04it/s, loss=0.347, lr=1]\nSteps:  36%|███▌      | 431/1200 [03:31<06:17,  2.04it/s, loss=0.347, lr=1]\nSteps:  36%|███▌      | 431/1200 [03:31<06:17,  2.04it/s, loss=0.379, lr=1]\nSteps:  36%|███▌      | 432/1200 [03:32<06:16,  2.04it/s, loss=0.379, lr=1]\nSteps:  36%|███▌      | 432/1200 [03:32<06:16,  2.04it/s, loss=0.335, lr=1]\nSteps:  36%|███▌      | 433/1200 [03:32<06:18,  2.03it/s, loss=0.335, lr=1]\nSteps:  36%|███▌      | 433/1200 [03:32<06:18,  2.03it/s, loss=0.328, lr=1]\nSteps:  36%|███▌      | 434/1200 [03:33<06:17,  2.03it/s, loss=0.328, lr=1]\nSteps:  36%|███▌      | 434/1200 [03:33<06:17,  2.03it/s, loss=0.447, lr=1]\nSteps:  36%|███▋      | 435/1200 [03:33<06:16,  2.03it/s, loss=0.447, lr=1]\nSteps:  36%|███▋      | 435/1200 [03:33<06:16,  2.03it/s, loss=1.04, lr=1] \nSteps:  36%|███▋      | 436/1200 [03:34<06:16,  2.03it/s, loss=1.04, lr=1]\nSteps:  36%|███▋      | 436/1200 [03:34<06:16,  2.03it/s, loss=0.426, lr=1]\nSteps:  36%|███▋      | 437/1200 [03:34<06:15,  2.03it/s, loss=0.426, lr=1]\nSteps:  36%|███▋      | 437/1200 [03:34<06:15,  2.03it/s, loss=0.288, lr=1]\nSteps:  36%|███▋      | 438/1200 [03:35<06:15,  2.03it/s, loss=0.288, lr=1]\nSteps:  36%|███▋      | 438/1200 [03:35<06:15,  2.03it/s, loss=0.451, lr=1]\nSteps:  37%|███▋      | 439/1200 [03:35<06:14,  2.03it/s, loss=0.451, lr=1]\nSteps:  37%|███▋      | 439/1200 [03:35<06:14,  2.03it/s, loss=0.386, lr=1]\nSteps:  37%|███▋      | 440/1200 [03:36<06:13,  2.03it/s, loss=0.386, lr=1]\nSteps:  37%|███▋      | 440/1200 [03:36<06:13,  2.03it/s, loss=0.415, lr=1]\nSteps:  37%|███▋      | 441/1200 [03:36<06:13,  2.03it/s, loss=0.415, lr=1]\nSteps:  37%|███▋      | 441/1200 [03:36<06:13,  2.03it/s, loss=0.438, lr=1]\nSteps:  37%|███▋      | 442/1200 [03:37<06:12,  2.03it/s, loss=0.438, lr=1]\nSteps:  37%|███▋      | 442/1200 [03:37<06:12,  2.03it/s, loss=0.574, lr=1]\nSteps:  37%|███▋      | 443/1200 [03:37<06:12,  2.03it/s, loss=0.574, lr=1]\nSteps:  37%|███▋      | 443/1200 [03:37<06:12,  2.03it/s, loss=0.983, lr=1]\nSteps:  37%|███▋      | 444/1200 [03:38<06:11,  2.03it/s, loss=0.983, lr=1]\nSteps:  37%|███▋      | 444/1200 [03:38<06:11,  2.03it/s, loss=0.774, lr=1]\nSteps:  37%|███▋      | 445/1200 [03:38<06:12,  2.03it/s, loss=0.774, lr=1]\nSteps:  37%|███▋      | 445/1200 [03:38<06:12,  2.03it/s, loss=0.324, lr=1]\nSteps:  37%|███▋      | 446/1200 [03:39<06:11,  2.03it/s, loss=0.324, lr=1]\nSteps:  37%|███▋      | 446/1200 [03:39<06:11,  2.03it/s, loss=0.576, lr=1]\nSteps:  37%|███▋      | 447/1200 [03:39<06:10,  2.03it/s, loss=0.576, lr=1]\nSteps:  37%|███▋      | 447/1200 [03:39<06:10,  2.03it/s, loss=0.464, lr=1]\nSteps:  37%|███▋      | 448/1200 [03:40<06:10,  2.03it/s, loss=0.464, lr=1]\nSteps:  37%|███▋      | 448/1200 [03:40<06:10,  2.03it/s, loss=0.975, lr=1]\nSteps:  37%|███▋      | 449/1200 [03:40<06:09,  2.03it/s, loss=0.975, lr=1]\nSteps:  37%|███▋      | 449/1200 [03:40<06:09,  2.03it/s, loss=0.63, lr=1] \nSteps:  38%|███▊      | 450/1200 [03:41<06:08,  2.03it/s, loss=0.63, lr=1]\nSteps:  38%|███▊      | 450/1200 [03:41<06:08,  2.03it/s, loss=0.635, lr=1]\nSteps:  38%|███▊      | 451/1200 [03:41<06:08,  2.03it/s, loss=0.635, lr=1]\nSteps:  38%|███▊      | 451/1200 [03:41<06:08,  2.03it/s, loss=0.603, lr=1]\nSteps:  38%|███▊      | 452/1200 [03:42<06:07,  2.03it/s, loss=0.603, lr=1]\nSteps:  38%|███▊      | 452/1200 [03:42<06:07,  2.03it/s, loss=0.291, lr=1]\nSteps:  38%|███▊      | 453/1200 [03:42<06:07,  2.03it/s, loss=0.291, lr=1]\nSteps:  38%|███▊      | 453/1200 [03:42<06:07,  2.03it/s, loss=0.632, lr=1]\nSteps:  38%|███▊      | 454/1200 [03:43<06:06,  2.03it/s, loss=0.632, lr=1]\nSteps:  38%|███▊      | 454/1200 [03:43<06:06,  2.03it/s, loss=0.609, lr=1]\nSteps:  38%|███▊      | 455/1200 [03:43<06:05,  2.04it/s, loss=0.609, lr=1]\nSteps:  38%|███▊      | 455/1200 [03:43<06:05,  2.04it/s, loss=0.353, lr=1]\nSteps:  38%|███▊      | 456/1200 [03:44<06:05,  2.03it/s, loss=0.353, lr=1]\nSteps:  38%|███▊      | 456/1200 [03:44<06:05,  2.03it/s, loss=0.537, lr=1]\nSteps:  38%|███▊      | 457/1200 [03:44<06:06,  2.02it/s, loss=0.537, lr=1]\nSteps:  38%|███▊      | 457/1200 [03:44<06:06,  2.02it/s, loss=0.399, lr=1]\nSteps:  38%|███▊      | 458/1200 [03:45<06:05,  2.03it/s, loss=0.399, lr=1]\nSteps:  38%|███▊      | 458/1200 [03:45<06:05,  2.03it/s, loss=0.511, lr=1]\nSteps:  38%|███▊      | 459/1200 [03:45<06:04,  2.03it/s, loss=0.511, lr=1]\nSteps:  38%|███▊      | 459/1200 [03:45<06:04,  2.03it/s, loss=0.605, lr=1]\nSteps:  38%|███▊      | 460/1200 [03:46<06:03,  2.03it/s, loss=0.605, lr=1]\nSteps:  38%|███▊      | 460/1200 [03:46<06:03,  2.03it/s, loss=0.289, lr=1]\nSteps:  38%|███▊      | 461/1200 [03:46<06:02,  2.04it/s, loss=0.289, lr=1]\nSteps:  38%|███▊      | 461/1200 [03:46<06:02,  2.04it/s, loss=0.515, lr=1]\nSteps:  38%|███▊      | 462/1200 [03:47<06:02,  2.04it/s, loss=0.515, lr=1]\nSteps:  38%|███▊      | 462/1200 [03:47<06:02,  2.04it/s, loss=0.331, lr=1]\nSteps:  39%|███▊      | 463/1200 [03:47<06:01,  2.04it/s, loss=0.331, lr=1]\nSteps:  39%|███▊      | 463/1200 [03:47<06:01,  2.04it/s, loss=0.371, lr=1]\nSteps:  39%|███▊      | 464/1200 [03:48<06:01,  2.04it/s, loss=0.371, lr=1]\nSteps:  39%|███▊      | 464/1200 [03:48<06:01,  2.04it/s, loss=0.628, lr=1]\nSteps:  39%|███▉      | 465/1200 [03:48<06:00,  2.04it/s, loss=0.628, lr=1]\nSteps:  39%|███▉      | 465/1200 [03:48<06:00,  2.04it/s, loss=0.5, lr=1]  \nSteps:  39%|███▉      | 466/1200 [03:49<05:59,  2.04it/s, loss=0.5, lr=1]\nSteps:  39%|███▉      | 466/1200 [03:49<05:59,  2.04it/s, loss=0.577, lr=1]\nSteps:  39%|███▉      | 467/1200 [03:49<05:59,  2.04it/s, loss=0.577, lr=1]\nSteps:  39%|███▉      | 467/1200 [03:49<05:59,  2.04it/s, loss=0.306, lr=1]\nSteps:  39%|███▉      | 468/1200 [03:50<05:59,  2.04it/s, loss=0.306, lr=1]\nSteps:  39%|███▉      | 468/1200 [03:50<05:59,  2.04it/s, loss=0.265, lr=1]\nSteps:  39%|███▉      | 469/1200 [03:50<06:00,  2.03it/s, loss=0.265, lr=1]\nSteps:  39%|███▉      | 469/1200 [03:50<06:00,  2.03it/s, loss=0.375, lr=1]\nSteps:  39%|███▉      | 470/1200 [03:51<05:59,  2.03it/s, loss=0.375, lr=1]\nSteps:  39%|███▉      | 470/1200 [03:51<05:59,  2.03it/s, loss=0.333, lr=1]\nSteps:  39%|███▉      | 471/1200 [03:51<05:59,  2.03it/s, loss=0.333, lr=1]\nSteps:  39%|███▉      | 471/1200 [03:51<05:59,  2.03it/s, loss=0.57, lr=1] \nSteps:  39%|███▉      | 472/1200 [03:52<05:58,  2.03it/s, loss=0.57, lr=1]\nSteps:  39%|███▉      | 472/1200 [03:52<05:58,  2.03it/s, loss=0.295, lr=1]\nSteps:  39%|███▉      | 473/1200 [03:52<05:57,  2.03it/s, loss=0.295, lr=1]\nSteps:  39%|███▉      | 473/1200 [03:52<05:57,  2.03it/s, loss=0.779, lr=1]\nSteps:  40%|███▉      | 474/1200 [03:53<05:56,  2.03it/s, loss=0.779, lr=1]\nSteps:  40%|███▉      | 474/1200 [03:53<05:56,  2.03it/s, loss=0.937, lr=1]\nSteps:  40%|███▉      | 475/1200 [03:53<05:56,  2.04it/s, loss=0.937, lr=1]\nSteps:  40%|███▉      | 475/1200 [03:53<05:56,  2.04it/s, loss=0.377, lr=1]\nSteps:  40%|███▉      | 476/1200 [03:54<05:55,  2.04it/s, loss=0.377, lr=1]\nSteps:  40%|███▉      | 476/1200 [03:54<05:55,  2.04it/s, loss=0.274, lr=1]\nSteps:  40%|███▉      | 477/1200 [03:54<05:55,  2.04it/s, loss=0.274, lr=1]\nSteps:  40%|███▉      | 477/1200 [03:54<05:55,  2.04it/s, loss=0.601, lr=1]\nSteps:  40%|███▉      | 478/1200 [03:55<05:54,  2.04it/s, loss=0.601, lr=1]\nSteps:  40%|███▉      | 478/1200 [03:55<05:54,  2.04it/s, loss=0.426, lr=1]\nSteps:  40%|███▉      | 479/1200 [03:55<05:54,  2.04it/s, loss=0.426, lr=1]\nSteps:  40%|███▉      | 479/1200 [03:55<05:54,  2.04it/s, loss=0.353, lr=1]\nSteps:  40%|████      | 480/1200 [03:56<05:53,  2.04it/s, loss=0.353, lr=1]\nSteps:  40%|████      | 480/1200 [03:56<05:53,  2.04it/s, loss=0.628, lr=1]\nSteps:  40%|████      | 481/1200 [03:56<05:54,  2.03it/s, loss=0.628, lr=1]\nSteps:  40%|████      | 481/1200 [03:56<05:54,  2.03it/s, loss=0.449, lr=1]\nSteps:  40%|████      | 482/1200 [03:57<05:53,  2.03it/s, loss=0.449, lr=1]\nSteps:  40%|████      | 482/1200 [03:57<05:53,  2.03it/s, loss=0.335, lr=1]\nSteps:  40%|████      | 483/1200 [03:57<05:52,  2.03it/s, loss=0.335, lr=1]\nSteps:  40%|████      | 483/1200 [03:57<05:52,  2.03it/s, loss=0.425, lr=1]\nSteps:  40%|████      | 484/1200 [03:58<05:52,  2.03it/s, loss=0.425, lr=1]\nSteps:  40%|████      | 484/1200 [03:58<05:52,  2.03it/s, loss=0.626, lr=1]\nSteps:  40%|████      | 485/1200 [03:58<05:51,  2.04it/s, loss=0.626, lr=1]\nSteps:  40%|████      | 485/1200 [03:58<05:51,  2.04it/s, loss=0.327, lr=1]\nSteps:  40%|████      | 486/1200 [03:59<05:50,  2.04it/s, loss=0.327, lr=1]\nSteps:  40%|████      | 486/1200 [03:59<05:50,  2.04it/s, loss=1.09, lr=1] \nSteps:  41%|████      | 487/1200 [03:59<05:50,  2.04it/s, loss=1.09, lr=1]\nSteps:  41%|████      | 487/1200 [03:59<05:50,  2.04it/s, loss=0.993, lr=1]\nSteps:  41%|████      | 488/1200 [04:00<05:49,  2.04it/s, loss=0.993, lr=1]\nSteps:  41%|████      | 488/1200 [04:00<05:49,  2.04it/s, loss=0.293, lr=1]\nSteps:  41%|████      | 489/1200 [04:00<05:48,  2.04it/s, loss=0.293, lr=1]\nSteps:  41%|████      | 489/1200 [04:00<05:48,  2.04it/s, loss=0.504, lr=1]\nSteps:  41%|████      | 490/1200 [04:00<05:48,  2.04it/s, loss=0.504, lr=1]\nSteps:  41%|████      | 490/1200 [04:00<05:48,  2.04it/s, loss=0.648, lr=1]\nSteps:  41%|████      | 491/1200 [04:01<05:48,  2.04it/s, loss=0.648, lr=1]\nSteps:  41%|████      | 491/1200 [04:01<05:48,  2.04it/s, loss=0.777, lr=1]\nSteps:  41%|████      | 492/1200 [04:01<05:47,  2.04it/s, loss=0.777, lr=1]\nSteps:  41%|████      | 492/1200 [04:01<05:47,  2.04it/s, loss=0.39, lr=1] \nSteps:  41%|████      | 493/1200 [04:02<05:48,  2.03it/s, loss=0.39, lr=1]\nSteps:  41%|████      | 493/1200 [04:02<05:48,  2.03it/s, loss=0.293, lr=1]\nSteps:  41%|████      | 494/1200 [04:02<05:47,  2.03it/s, loss=0.293, lr=1]\nSteps:  41%|████      | 494/1200 [04:02<05:47,  2.03it/s, loss=0.367, lr=1]\nSteps:  41%|████▏     | 495/1200 [04:03<05:46,  2.03it/s, loss=0.367, lr=1]\nSteps:  41%|████▏     | 495/1200 [04:03<05:46,  2.03it/s, loss=0.464, lr=1]\nSteps:  41%|████▏     | 496/1200 [04:03<05:46,  2.03it/s, loss=0.464, lr=1]\nSteps:  41%|████▏     | 496/1200 [04:03<05:46,  2.03it/s, loss=0.747, lr=1]\nSteps:  41%|████▏     | 497/1200 [04:04<05:45,  2.03it/s, loss=0.747, lr=1]\nSteps:  41%|████▏     | 497/1200 [04:04<05:45,  2.03it/s, loss=0.34, lr=1] \nSteps:  42%|████▏     | 498/1200 [04:04<05:45,  2.03it/s, loss=0.34, lr=1]\nSteps:  42%|████▏     | 498/1200 [04:04<05:45,  2.03it/s, loss=0.616, lr=1]\nSteps:  42%|████▏     | 499/1200 [04:05<05:44,  2.03it/s, loss=0.616, lr=1]\nSteps:  42%|████▏     | 499/1200 [04:05<05:44,  2.03it/s, loss=0.399, lr=1]\nSteps:  42%|████▏     | 500/1200 [04:05<05:44,  2.03it/s, loss=0.399, lr=1]\nSteps:  42%|████▏     | 500/1200 [04:05<05:44,  2.03it/s, loss=0.324, lr=1]\nSteps:  42%|████▏     | 501/1200 [04:06<05:43,  2.03it/s, loss=0.324, lr=1]\nSteps:  42%|████▏     | 501/1200 [04:06<05:43,  2.03it/s, loss=0.315, lr=1]\nSteps:  42%|████▏     | 502/1200 [04:06<05:43,  2.03it/s, loss=0.315, lr=1]\nSteps:  42%|████▏     | 502/1200 [04:06<05:43,  2.03it/s, loss=0.585, lr=1]\nSteps:  42%|████▏     | 503/1200 [04:07<05:43,  2.03it/s, loss=0.585, lr=1]\nSteps:  42%|████▏     | 503/1200 [04:07<05:43,  2.03it/s, loss=0.336, lr=1]\nSteps:  42%|████▏     | 504/1200 [04:07<05:42,  2.03it/s, loss=0.336, lr=1]\nSteps:  42%|████▏     | 504/1200 [04:07<05:42,  2.03it/s, loss=0.291, lr=1]\nSteps:  42%|████▏     | 505/1200 [04:08<05:43,  2.02it/s, loss=0.291, lr=1]\nSteps:  42%|████▏     | 505/1200 [04:08<05:43,  2.02it/s, loss=0.625, lr=1]\nSteps:  42%|████▏     | 506/1200 [04:08<05:42,  2.03it/s, loss=0.625, lr=1]\nSteps:  42%|████▏     | 506/1200 [04:08<05:42,  2.03it/s, loss=0.536, lr=1]\nSteps:  42%|████▏     | 507/1200 [04:09<05:41,  2.03it/s, loss=0.536, lr=1]\nSteps:  42%|████▏     | 507/1200 [04:09<05:41,  2.03it/s, loss=0.655, lr=1]\nSteps:  42%|████▏     | 508/1200 [04:09<05:40,  2.03it/s, loss=0.655, lr=1]\nSteps:  42%|████▏     | 508/1200 [04:09<05:40,  2.03it/s, loss=0.617, lr=1]\nSteps:  42%|████▏     | 509/1200 [04:10<05:40,  2.03it/s, loss=0.617, lr=1]\nSteps:  42%|████▏     | 509/1200 [04:10<05:40,  2.03it/s, loss=0.314, lr=1]\nSteps:  42%|████▎     | 510/1200 [04:10<05:39,  2.03it/s, loss=0.314, lr=1]\nSteps:  42%|████▎     | 510/1200 [04:10<05:39,  2.03it/s, loss=0.512, lr=1]\nSteps:  43%|████▎     | 511/1200 [04:11<05:38,  2.03it/s, loss=0.512, lr=1]\nSteps:  43%|████▎     | 511/1200 [04:11<05:38,  2.03it/s, loss=0.294, lr=1]\nSteps:  43%|████▎     | 512/1200 [04:11<05:38,  2.03it/s, loss=0.294, lr=1]\nSteps:  43%|████▎     | 512/1200 [04:11<05:38,  2.03it/s, loss=0.854, lr=1]\nSteps:  43%|████▎     | 513/1200 [04:12<05:37,  2.04it/s, loss=0.854, lr=1]\nSteps:  43%|████▎     | 513/1200 [04:12<05:37,  2.04it/s, loss=0.641, lr=1]\nSteps:  43%|████▎     | 514/1200 [04:12<05:36,  2.04it/s, loss=0.641, lr=1]\nSteps:  43%|████▎     | 514/1200 [04:12<05:36,  2.04it/s, loss=0.489, lr=1]\nSteps:  43%|████▎     | 515/1200 [04:13<05:36,  2.04it/s, loss=0.489, lr=1]\nSteps:  43%|████▎     | 515/1200 [04:13<05:36,  2.04it/s, loss=0.407, lr=1]\nSteps:  43%|████▎     | 516/1200 [04:13<05:35,  2.04it/s, loss=0.407, lr=1]\nSteps:  43%|████▎     | 516/1200 [04:13<05:35,  2.04it/s, loss=0.444, lr=1]\nSteps:  43%|████▎     | 517/1200 [04:14<05:36,  2.03it/s, loss=0.444, lr=1]\nSteps:  43%|████▎     | 517/1200 [04:14<05:36,  2.03it/s, loss=0.444, lr=1]\nSteps:  43%|████▎     | 518/1200 [04:14<05:35,  2.03it/s, loss=0.444, lr=1]\nSteps:  43%|████▎     | 518/1200 [04:14<05:35,  2.03it/s, loss=0.313, lr=1]\nSteps:  43%|████▎     | 519/1200 [04:15<05:35,  2.03it/s, loss=0.313, lr=1]\nSteps:  43%|████▎     | 519/1200 [04:15<05:35,  2.03it/s, loss=0.356, lr=1]\nSteps:  43%|████▎     | 520/1200 [04:15<05:34,  2.03it/s, loss=0.356, lr=1]\nSteps:  43%|████▎     | 520/1200 [04:15<05:34,  2.03it/s, loss=0.538, lr=1]\nSteps:  43%|████▎     | 521/1200 [04:16<05:33,  2.03it/s, loss=0.538, lr=1]\nSteps:  43%|████▎     | 521/1200 [04:16<05:33,  2.03it/s, loss=0.585, lr=1]\nSteps:  44%|████▎     | 522/1200 [04:16<05:33,  2.04it/s, loss=0.585, lr=1]\nSteps:  44%|████▎     | 522/1200 [04:16<05:33,  2.04it/s, loss=0.496, lr=1]\nSteps:  44%|████▎     | 523/1200 [04:17<05:32,  2.04it/s, loss=0.496, lr=1]\nSteps:  44%|████▎     | 523/1200 [04:17<05:32,  2.04it/s, loss=0.41, lr=1] \nSteps:  44%|████▎     | 524/1200 [04:17<05:31,  2.04it/s, loss=0.41, lr=1]\nSteps:  44%|████▎     | 524/1200 [04:17<05:31,  2.04it/s, loss=0.651, lr=1]\nSteps:  44%|████▍     | 525/1200 [04:18<05:31,  2.04it/s, loss=0.651, lr=1]\nSteps:  44%|████▍     | 525/1200 [04:18<05:31,  2.04it/s, loss=0.779, lr=1]\nSteps:  44%|████▍     | 526/1200 [04:18<05:30,  2.04it/s, loss=0.779, lr=1]\nSteps:  44%|████▍     | 526/1200 [04:18<05:30,  2.04it/s, loss=0.396, lr=1]\nSteps:  44%|████▍     | 527/1200 [04:19<05:30,  2.04it/s, loss=0.396, lr=1]\nSteps:  44%|████▍     | 527/1200 [04:19<05:30,  2.04it/s, loss=0.337, lr=1]\nSteps:  44%|████▍     | 528/1200 [04:19<05:29,  2.04it/s, loss=0.337, lr=1]\nSteps:  44%|████▍     | 528/1200 [04:19<05:29,  2.04it/s, loss=0.33, lr=1] \nSteps:  44%|████▍     | 529/1200 [04:20<05:30,  2.03it/s, loss=0.33, lr=1]\nSteps:  44%|████▍     | 529/1200 [04:20<05:30,  2.03it/s, loss=0.577, lr=1]\nSteps:  44%|████▍     | 530/1200 [04:20<05:29,  2.03it/s, loss=0.577, lr=1]\nSteps:  44%|████▍     | 530/1200 [04:20<05:29,  2.03it/s, loss=0.612, lr=1]\nSteps:  44%|████▍     | 531/1200 [04:21<05:29,  2.03it/s, loss=0.612, lr=1]\nSteps:  44%|████▍     | 531/1200 [04:21<05:29,  2.03it/s, loss=0.339, lr=1]\nSteps:  44%|████▍     | 532/1200 [04:21<05:28,  2.03it/s, loss=0.339, lr=1]\nSteps:  44%|████▍     | 532/1200 [04:21<05:28,  2.03it/s, loss=0.464, lr=1]\nSteps:  44%|████▍     | 533/1200 [04:22<05:27,  2.04it/s, loss=0.464, lr=1]\nSteps:  44%|████▍     | 533/1200 [04:22<05:27,  2.04it/s, loss=0.637, lr=1]\nSteps:  44%|████▍     | 534/1200 [04:22<05:27,  2.04it/s, loss=0.637, lr=1]\nSteps:  44%|████▍     | 534/1200 [04:22<05:27,  2.04it/s, loss=1.04, lr=1] \nSteps:  45%|████▍     | 535/1200 [04:23<05:26,  2.04it/s, loss=1.04, lr=1]\nSteps:  45%|████▍     | 535/1200 [04:23<05:26,  2.04it/s, loss=0.336, lr=1]\nSteps:  45%|████▍     | 536/1200 [04:23<05:25,  2.04it/s, loss=0.336, lr=1]\nSteps:  45%|████▍     | 536/1200 [04:23<05:25,  2.04it/s, loss=0.33, lr=1] \nSteps:  45%|████▍     | 537/1200 [04:24<05:25,  2.04it/s, loss=0.33, lr=1]\nSteps:  45%|████▍     | 537/1200 [04:24<05:25,  2.04it/s, loss=0.935, lr=1]\nSteps:  45%|████▍     | 538/1200 [04:24<05:25,  2.04it/s, loss=0.935, lr=1]\nSteps:  45%|████▍     | 538/1200 [04:24<05:25,  2.04it/s, loss=0.472, lr=1]\nSteps:  45%|████▍     | 539/1200 [04:25<05:24,  2.04it/s, loss=0.472, lr=1]\nSteps:  45%|████▍     | 539/1200 [04:25<05:24,  2.04it/s, loss=0.551, lr=1]\nSteps:  45%|████▌     | 540/1200 [04:25<05:23,  2.04it/s, loss=0.551, lr=1]\nSteps:  45%|████▌     | 540/1200 [04:25<05:23,  2.04it/s, loss=0.642, lr=1]\nSteps:  45%|████▌     | 541/1200 [04:26<05:24,  2.03it/s, loss=0.642, lr=1]\nSteps:  45%|████▌     | 541/1200 [04:26<05:24,  2.03it/s, loss=0.306, lr=1]\nSteps:  45%|████▌     | 542/1200 [04:26<05:23,  2.03it/s, loss=0.306, lr=1]\nSteps:  45%|████▌     | 542/1200 [04:26<05:23,  2.03it/s, loss=0.307, lr=1]\nSteps:  45%|████▌     | 543/1200 [04:27<05:22,  2.03it/s, loss=0.307, lr=1]\nSteps:  45%|████▌     | 543/1200 [04:27<05:22,  2.03it/s, loss=0.436, lr=1]\nSteps:  45%|████▌     | 544/1200 [04:27<05:22,  2.04it/s, loss=0.436, lr=1]\nSteps:  45%|████▌     | 544/1200 [04:27<05:22,  2.04it/s, loss=0.64, lr=1] \nSteps:  45%|████▌     | 545/1200 [04:28<05:21,  2.04it/s, loss=0.64, lr=1]\nSteps:  45%|████▌     | 545/1200 [04:28<05:21,  2.04it/s, loss=0.306, lr=1]\nSteps:  46%|████▌     | 546/1200 [04:28<05:20,  2.04it/s, loss=0.306, lr=1]\nSteps:  46%|████▌     | 546/1200 [04:28<05:20,  2.04it/s, loss=0.648, lr=1]\nSteps:  46%|████▌     | 547/1200 [04:29<05:21,  2.03it/s, loss=0.648, lr=1]\nSteps:  46%|████▌     | 547/1200 [04:29<05:21,  2.03it/s, loss=0.321, lr=1]\nSteps:  46%|████▌     | 548/1200 [04:29<05:20,  2.03it/s, loss=0.321, lr=1]\nSteps:  46%|████▌     | 548/1200 [04:29<05:20,  2.03it/s, loss=0.515, lr=1]\nSteps:  46%|████▌     | 549/1200 [04:29<05:19,  2.04it/s, loss=0.515, lr=1]\nSteps:  46%|████▌     | 549/1200 [04:29<05:19,  2.04it/s, loss=0.809, lr=1]\nSteps:  46%|████▌     | 550/1200 [04:30<05:19,  2.04it/s, loss=0.809, lr=1]\nSteps:  46%|████▌     | 550/1200 [04:30<05:19,  2.04it/s, loss=1.04, lr=1] \nSteps:  46%|████▌     | 551/1200 [04:30<05:18,  2.04it/s, loss=1.04, lr=1]\nSteps:  46%|████▌     | 551/1200 [04:30<05:18,  2.04it/s, loss=0.361, lr=1]\nSteps:  46%|████▌     | 552/1200 [04:31<05:17,  2.04it/s, loss=0.361, lr=1]\nSteps:  46%|████▌     | 552/1200 [04:31<05:17,  2.04it/s, loss=0.6, lr=1]  \nSteps:  46%|████▌     | 553/1200 [04:31<05:18,  2.03it/s, loss=0.6, lr=1]\nSteps:  46%|████▌     | 553/1200 [04:31<05:18,  2.03it/s, loss=0.421, lr=1]\nSteps:  46%|████▌     | 554/1200 [04:32<05:17,  2.03it/s, loss=0.421, lr=1]\nSteps:  46%|████▌     | 554/1200 [04:32<05:17,  2.03it/s, loss=0.6, lr=1]  \nSteps:  46%|████▋     | 555/1200 [04:32<05:16,  2.03it/s, loss=0.6, lr=1]\nSteps:  46%|████▋     | 555/1200 [04:32<05:16,  2.03it/s, loss=0.386, lr=1]\nSteps:  46%|████▋     | 556/1200 [04:33<05:16,  2.03it/s, loss=0.386, lr=1]\nSteps:  46%|████▋     | 556/1200 [04:33<05:16,  2.03it/s, loss=0.417, lr=1]\nSteps:  46%|████▋     | 557/1200 [04:33<05:15,  2.04it/s, loss=0.417, lr=1]\nSteps:  46%|████▋     | 557/1200 [04:33<05:15,  2.04it/s, loss=0.634, lr=1]\nSteps:  46%|████▋     | 558/1200 [04:34<05:15,  2.04it/s, loss=0.634, lr=1]\nSteps:  46%|████▋     | 558/1200 [04:34<05:15,  2.04it/s, loss=0.994, lr=1]\nSteps:  47%|████▋     | 559/1200 [04:34<05:15,  2.03it/s, loss=0.994, lr=1]\nSteps:  47%|████▋     | 559/1200 [04:34<05:15,  2.03it/s, loss=0.383, lr=1]\nSteps:  47%|████▋     | 560/1200 [04:35<05:14,  2.03it/s, loss=0.383, lr=1]\nSteps:  47%|████▋     | 560/1200 [04:35<05:14,  2.03it/s, loss=0.637, lr=1]\nSteps:  47%|████▋     | 561/1200 [04:35<05:13,  2.04it/s, loss=0.637, lr=1]\nSteps:  47%|████▋     | 561/1200 [04:35<05:13,  2.04it/s, loss=0.68, lr=1] \nSteps:  47%|████▋     | 562/1200 [04:36<05:13,  2.03it/s, loss=0.68, lr=1]\nSteps:  47%|████▋     | 562/1200 [04:36<05:13,  2.03it/s, loss=0.42, lr=1]\nSteps:  47%|████▋     | 563/1200 [04:36<05:13,  2.03it/s, loss=0.42, lr=1]\nSteps:  47%|████▋     | 563/1200 [04:36<05:13,  2.03it/s, loss=0.354, lr=1]\nSteps:  47%|████▋     | 564/1200 [04:37<05:12,  2.04it/s, loss=0.354, lr=1]\nSteps:  47%|████▋     | 564/1200 [04:37<05:12,  2.04it/s, loss=0.412, lr=1]\nSteps:  47%|████▋     | 565/1200 [04:37<05:13,  2.03it/s, loss=0.412, lr=1]\nSteps:  47%|████▋     | 565/1200 [04:37<05:13,  2.03it/s, loss=0.605, lr=1]\nSteps:  47%|████▋     | 566/1200 [04:38<05:12,  2.03it/s, loss=0.605, lr=1]\nSteps:  47%|████▋     | 566/1200 [04:38<05:12,  2.03it/s, loss=0.521, lr=1]\nSteps:  47%|████▋     | 567/1200 [04:38<05:11,  2.03it/s, loss=0.521, lr=1]\nSteps:  47%|████▋     | 567/1200 [04:38<05:11,  2.03it/s, loss=0.954, lr=1]\nSteps:  47%|████▋     | 568/1200 [04:39<05:10,  2.03it/s, loss=0.954, lr=1]\nSteps:  47%|████▋     | 568/1200 [04:39<05:10,  2.03it/s, loss=0.38, lr=1] \nSteps:  47%|████▋     | 569/1200 [04:39<05:09,  2.04it/s, loss=0.38, lr=1]\nSteps:  47%|████▋     | 569/1200 [04:39<05:09,  2.04it/s, loss=0.379, lr=1]\nSteps:  48%|████▊     | 570/1200 [04:40<05:09,  2.03it/s, loss=0.379, lr=1]\nSteps:  48%|████▊     | 570/1200 [04:40<05:09,  2.03it/s, loss=0.371, lr=1]\nSteps:  48%|████▊     | 571/1200 [04:40<05:09,  2.04it/s, loss=0.371, lr=1]\nSteps:  48%|████▊     | 571/1200 [04:40<05:09,  2.04it/s, loss=0.362, lr=1]\nSteps:  48%|████▊     | 572/1200 [04:41<05:08,  2.04it/s, loss=0.362, lr=1]\nSteps:  48%|████▊     | 572/1200 [04:41<05:08,  2.04it/s, loss=0.329, lr=1]\nSteps:  48%|████▊     | 573/1200 [04:41<05:07,  2.04it/s, loss=0.329, lr=1]\nSteps:  48%|████▊     | 573/1200 [04:41<05:07,  2.04it/s, loss=0.77, lr=1] \nSteps:  48%|████▊     | 574/1200 [04:42<05:07,  2.04it/s, loss=0.77, lr=1]\nSteps:  48%|████▊     | 574/1200 [04:42<05:07,  2.04it/s, loss=0.574, lr=1]\nSteps:  48%|████▊     | 575/1200 [04:42<05:06,  2.04it/s, loss=0.574, lr=1]\nSteps:  48%|████▊     | 575/1200 [04:42<05:06,  2.04it/s, loss=0.278, lr=1]\nSteps:  48%|████▊     | 576/1200 [04:43<05:05,  2.04it/s, loss=0.278, lr=1]\nSteps:  48%|████▊     | 576/1200 [04:43<05:05,  2.04it/s, loss=0.537, lr=1]\nSteps:  48%|████▊     | 577/1200 [04:43<05:06,  2.03it/s, loss=0.537, lr=1]\nSteps:  48%|████▊     | 577/1200 [04:43<05:06,  2.03it/s, loss=0.774, lr=1]\nSteps:  48%|████▊     | 578/1200 [04:44<05:05,  2.03it/s, loss=0.774, lr=1]\nSteps:  48%|████▊     | 578/1200 [04:44<05:05,  2.03it/s, loss=1.04, lr=1] \nSteps:  48%|████▊     | 579/1200 [04:44<05:05,  2.03it/s, loss=1.04, lr=1]\nSteps:  48%|████▊     | 579/1200 [04:44<05:05,  2.03it/s, loss=0.418, lr=1]\nSteps:  48%|████▊     | 580/1200 [04:45<05:04,  2.04it/s, loss=0.418, lr=1]\nSteps:  48%|████▊     | 580/1200 [04:45<05:04,  2.04it/s, loss=0.701, lr=1]\nSteps:  48%|████▊     | 581/1200 [04:45<05:03,  2.04it/s, loss=0.701, lr=1]\nSteps:  48%|████▊     | 581/1200 [04:45<05:03,  2.04it/s, loss=0.634, lr=1]\nSteps:  48%|████▊     | 582/1200 [04:46<05:03,  2.04it/s, loss=0.634, lr=1]\nSteps:  48%|████▊     | 582/1200 [04:46<05:03,  2.04it/s, loss=0.621, lr=1]\nSteps:  49%|████▊     | 583/1200 [04:46<05:02,  2.04it/s, loss=0.621, lr=1]\nSteps:  49%|████▊     | 583/1200 [04:46<05:02,  2.04it/s, loss=0.282, lr=1]\nSteps:  49%|████▊     | 584/1200 [04:47<05:02,  2.04it/s, loss=0.282, lr=1]\nSteps:  49%|████▊     | 584/1200 [04:47<05:02,  2.04it/s, loss=0.713, lr=1]\nSteps:  49%|████▉     | 585/1200 [04:47<05:01,  2.04it/s, loss=0.713, lr=1]\nSteps:  49%|████▉     | 585/1200 [04:47<05:01,  2.04it/s, loss=0.314, lr=1]\nSteps:  49%|████▉     | 586/1200 [04:48<05:01,  2.04it/s, loss=0.314, lr=1]\nSteps:  49%|████▉     | 586/1200 [04:48<05:01,  2.04it/s, loss=0.417, lr=1]\nSteps:  49%|████▉     | 587/1200 [04:48<05:00,  2.04it/s, loss=0.417, lr=1]\nSteps:  49%|████▉     | 587/1200 [04:48<05:00,  2.04it/s, loss=1.02, lr=1] \nSteps:  49%|████▉     | 588/1200 [04:49<05:00,  2.04it/s, loss=1.02, lr=1]\nSteps:  49%|████▉     | 588/1200 [04:49<05:00,  2.04it/s, loss=0.584, lr=1]\nSteps:  49%|████▉     | 589/1200 [04:49<05:01,  2.03it/s, loss=0.584, lr=1]\nSteps:  49%|████▉     | 589/1200 [04:49<05:01,  2.03it/s, loss=0.368, lr=1]\nSteps:  49%|████▉     | 590/1200 [04:50<05:00,  2.03it/s, loss=0.368, lr=1]\nSteps:  49%|████▉     | 590/1200 [04:50<05:00,  2.03it/s, loss=0.834, lr=1]\nSteps:  49%|████▉     | 591/1200 [04:50<04:59,  2.03it/s, loss=0.834, lr=1]\nSteps:  49%|████▉     | 591/1200 [04:50<04:59,  2.03it/s, loss=0.274, lr=1]\nSteps:  49%|████▉     | 592/1200 [04:51<04:59,  2.03it/s, loss=0.274, lr=1]\nSteps:  49%|████▉     | 592/1200 [04:51<04:59,  2.03it/s, loss=0.87, lr=1] \nSteps:  49%|████▉     | 593/1200 [04:51<04:58,  2.03it/s, loss=0.87, lr=1]\nSteps:  49%|████▉     | 593/1200 [04:51<04:58,  2.03it/s, loss=0.66, lr=1]\nSteps:  50%|████▉     | 594/1200 [04:52<04:57,  2.03it/s, loss=0.66, lr=1]\nSteps:  50%|████▉     | 594/1200 [04:52<04:57,  2.03it/s, loss=0.538, lr=1]\nSteps:  50%|████▉     | 595/1200 [04:52<04:57,  2.04it/s, loss=0.538, lr=1]\nSteps:  50%|████▉     | 595/1200 [04:52<04:57,  2.04it/s, loss=0.628, lr=1]\nSteps:  50%|████▉     | 596/1200 [04:53<04:56,  2.04it/s, loss=0.628, lr=1]\nSteps:  50%|████▉     | 596/1200 [04:53<04:56,  2.04it/s, loss=0.952, lr=1]\nSteps:  50%|████▉     | 597/1200 [04:53<04:56,  2.04it/s, loss=0.952, lr=1]\nSteps:  50%|████▉     | 597/1200 [04:53<04:56,  2.04it/s, loss=0.37, lr=1] \nSteps:  50%|████▉     | 598/1200 [04:54<04:55,  2.04it/s, loss=0.37, lr=1]\nSteps:  50%|████▉     | 598/1200 [04:54<04:55,  2.04it/s, loss=0.603, lr=1]\nSteps:  50%|████▉     | 599/1200 [04:54<04:55,  2.03it/s, loss=0.603, lr=1]\nSteps:  50%|████▉     | 599/1200 [04:54<04:55,  2.03it/s, loss=0.325, lr=1]\nSteps:  50%|█████     | 600/1200 [04:55<04:54,  2.04it/s, loss=0.325, lr=1]\nSteps:  50%|█████     | 600/1200 [04:55<04:54,  2.04it/s, loss=0.48, lr=1] \nSteps:  50%|█████     | 601/1200 [04:55<04:55,  2.03it/s, loss=0.48, lr=1]\nSteps:  50%|█████     | 601/1200 [04:55<04:55,  2.03it/s, loss=0.452, lr=1]\nSteps:  50%|█████     | 602/1200 [04:56<04:54,  2.03it/s, loss=0.452, lr=1]\nSteps:  50%|█████     | 602/1200 [04:56<04:54,  2.03it/s, loss=0.28, lr=1] \nSteps:  50%|█████     | 603/1200 [04:56<04:53,  2.03it/s, loss=0.28, lr=1]\nSteps:  50%|█████     | 603/1200 [04:56<04:53,  2.03it/s, loss=0.474, lr=1]\nSteps:  50%|█████     | 604/1200 [04:57<04:53,  2.03it/s, loss=0.474, lr=1]\nSteps:  50%|█████     | 604/1200 [04:57<04:53,  2.03it/s, loss=0.313, lr=1]\nSteps:  50%|█████     | 605/1200 [04:57<04:52,  2.04it/s, loss=0.313, lr=1]\nSteps:  50%|█████     | 605/1200 [04:57<04:52,  2.04it/s, loss=0.512, lr=1]\nSteps:  50%|█████     | 606/1200 [04:58<04:51,  2.04it/s, loss=0.512, lr=1]\nSteps:  50%|█████     | 606/1200 [04:58<04:51,  2.04it/s, loss=0.588, lr=1]\nSteps:  51%|█████     | 607/1200 [04:58<04:50,  2.04it/s, loss=0.588, lr=1]\nSteps:  51%|█████     | 607/1200 [04:58<04:50,  2.04it/s, loss=0.326, lr=1]\nSteps:  51%|█████     | 608/1200 [04:58<04:50,  2.04it/s, loss=0.326, lr=1]\nSteps:  51%|█████     | 608/1200 [04:58<04:50,  2.04it/s, loss=0.971, lr=1]\nSteps:  51%|█████     | 609/1200 [04:59<04:49,  2.04it/s, loss=0.971, lr=1]\nSteps:  51%|█████     | 609/1200 [04:59<04:49,  2.04it/s, loss=0.619, lr=1]\nSteps:  51%|█████     | 610/1200 [04:59<04:49,  2.04it/s, loss=0.619, lr=1]\nSteps:  51%|█████     | 610/1200 [04:59<04:49,  2.04it/s, loss=0.531, lr=1]\nSteps:  51%|█████     | 611/1200 [05:00<04:48,  2.04it/s, loss=0.531, lr=1]\nSteps:  51%|█████     | 611/1200 [05:00<04:48,  2.04it/s, loss=0.778, lr=1]\nSteps:  51%|█████     | 612/1200 [05:00<04:48,  2.04it/s, loss=0.778, lr=1]\nSteps:  51%|█████     | 612/1200 [05:00<04:48,  2.04it/s, loss=0.523, lr=1]\nSteps:  51%|█████     | 613/1200 [05:01<04:49,  2.03it/s, loss=0.523, lr=1]\nSteps:  51%|█████     | 613/1200 [05:01<04:49,  2.03it/s, loss=0.639, lr=1]\nSteps:  51%|█████     | 614/1200 [05:01<04:48,  2.03it/s, loss=0.639, lr=1]\nSteps:  51%|█████     | 614/1200 [05:01<04:48,  2.03it/s, loss=0.683, lr=1]\nSteps:  51%|█████▏    | 615/1200 [05:02<04:47,  2.03it/s, loss=0.683, lr=1]\nSteps:  51%|█████▏    | 615/1200 [05:02<04:47,  2.03it/s, loss=0.599, lr=1]\nSteps:  51%|█████▏    | 616/1200 [05:02<04:46,  2.04it/s, loss=0.599, lr=1]\nSteps:  51%|█████▏    | 616/1200 [05:02<04:46,  2.04it/s, loss=0.499, lr=1]\nSteps:  51%|█████▏    | 617/1200 [05:03<04:46,  2.04it/s, loss=0.499, lr=1]\nSteps:  51%|█████▏    | 617/1200 [05:03<04:46,  2.04it/s, loss=0.604, lr=1]\nSteps:  52%|█████▏    | 618/1200 [05:03<04:45,  2.04it/s, loss=0.604, lr=1]\nSteps:  52%|█████▏    | 618/1200 [05:03<04:45,  2.04it/s, loss=0.628, lr=1]\nSteps:  52%|█████▏    | 619/1200 [05:04<04:45,  2.04it/s, loss=0.628, lr=1]\nSteps:  52%|█████▏    | 619/1200 [05:04<04:45,  2.04it/s, loss=0.345, lr=1]\nSteps:  52%|█████▏    | 620/1200 [05:04<04:44,  2.04it/s, loss=0.345, lr=1]\nSteps:  52%|█████▏    | 620/1200 [05:04<04:44,  2.04it/s, loss=0.417, lr=1]\nSteps:  52%|█████▏    | 621/1200 [05:05<04:44,  2.04it/s, loss=0.417, lr=1]\nSteps:  52%|█████▏    | 621/1200 [05:05<04:44,  2.04it/s, loss=0.764, lr=1]\nSteps:  52%|█████▏    | 622/1200 [05:05<04:43,  2.04it/s, loss=0.764, lr=1]\nSteps:  52%|█████▏    | 622/1200 [05:05<04:43,  2.04it/s, loss=0.316, lr=1]\nSteps:  52%|█████▏    | 623/1200 [05:06<04:43,  2.04it/s, loss=0.316, lr=1]\nSteps:  52%|█████▏    | 623/1200 [05:06<04:43,  2.04it/s, loss=0.423, lr=1]\nSteps:  52%|█████▏    | 624/1200 [05:06<04:42,  2.04it/s, loss=0.423, lr=1]\nSteps:  52%|█████▏    | 624/1200 [05:06<04:42,  2.04it/s, loss=0.356, lr=1]\nSteps:  52%|█████▏    | 625/1200 [05:07<04:43,  2.03it/s, loss=0.356, lr=1]\nSteps:  52%|█████▏    | 625/1200 [05:07<04:43,  2.03it/s, loss=0.618, lr=1]\nSteps:  52%|█████▏    | 626/1200 [05:07<04:42,  2.03it/s, loss=0.618, lr=1]\nSteps:  52%|█████▏    | 626/1200 [05:07<04:42,  2.03it/s, loss=0.618, lr=1]\nSteps:  52%|█████▏    | 627/1200 [05:08<04:41,  2.03it/s, loss=0.618, lr=1]\nSteps:  52%|█████▏    | 627/1200 [05:08<04:41,  2.03it/s, loss=0.265, lr=1]\nSteps:  52%|█████▏    | 628/1200 [05:08<04:41,  2.03it/s, loss=0.265, lr=1]\nSteps:  52%|█████▏    | 628/1200 [05:08<04:41,  2.03it/s, loss=0.561, lr=1]\nSteps:  52%|█████▏    | 629/1200 [05:09<04:40,  2.04it/s, loss=0.561, lr=1]\nSteps:  52%|█████▏    | 629/1200 [05:09<04:40,  2.04it/s, loss=0.818, lr=1]\nSteps:  52%|█████▎    | 630/1200 [05:09<04:39,  2.04it/s, loss=0.818, lr=1]\nSteps:  52%|█████▎    | 630/1200 [05:09<04:39,  2.04it/s, loss=0.508, lr=1]\nSteps:  53%|█████▎    | 631/1200 [05:10<04:39,  2.04it/s, loss=0.508, lr=1]\nSteps:  53%|█████▎    | 631/1200 [05:10<04:39,  2.04it/s, loss=0.362, lr=1]\nSteps:  53%|█████▎    | 632/1200 [05:10<04:38,  2.04it/s, loss=0.362, lr=1]\nSteps:  53%|█████▎    | 632/1200 [05:10<04:38,  2.04it/s, loss=0.646, lr=1]\nSteps:  53%|█████▎    | 633/1200 [05:11<04:38,  2.04it/s, loss=0.646, lr=1]\nSteps:  53%|█████▎    | 633/1200 [05:11<04:38,  2.04it/s, loss=0.596, lr=1]\nSteps:  53%|█████▎    | 634/1200 [05:11<04:38,  2.03it/s, loss=0.596, lr=1]\nSteps:  53%|█████▎    | 634/1200 [05:11<04:38,  2.03it/s, loss=0.676, lr=1]\nSteps:  53%|█████▎    | 635/1200 [05:12<04:37,  2.03it/s, loss=0.676, lr=1]\nSteps:  53%|█████▎    | 635/1200 [05:12<04:37,  2.03it/s, loss=0.308, lr=1]\nSteps:  53%|█████▎    | 636/1200 [05:12<04:37,  2.04it/s, loss=0.308, lr=1]\nSteps:  53%|█████▎    | 636/1200 [05:12<04:37,  2.04it/s, loss=0.74, lr=1] \nSteps:  53%|█████▎    | 637/1200 [05:13<04:37,  2.03it/s, loss=0.74, lr=1]\nSteps:  53%|█████▎    | 637/1200 [05:13<04:37,  2.03it/s, loss=0.645, lr=1]\nSteps:  53%|█████▎    | 638/1200 [05:13<04:37,  2.03it/s, loss=0.645, lr=1]\nSteps:  53%|█████▎    | 638/1200 [05:13<04:37,  2.03it/s, loss=0.98, lr=1] \nSteps:  53%|█████▎    | 639/1200 [05:14<04:36,  2.03it/s, loss=0.98, lr=1]\nSteps:  53%|█████▎    | 639/1200 [05:14<04:36,  2.03it/s, loss=0.531, lr=1]\nSteps:  53%|█████▎    | 640/1200 [05:14<04:35,  2.03it/s, loss=0.531, lr=1]\nSteps:  53%|█████▎    | 640/1200 [05:14<04:35,  2.03it/s, loss=0.516, lr=1]\nSteps:  53%|█████▎    | 641/1200 [05:15<04:34,  2.03it/s, loss=0.516, lr=1]\nSteps:  53%|█████▎    | 641/1200 [05:15<04:34,  2.03it/s, loss=0.598, lr=1]\nSteps:  54%|█████▎    | 642/1200 [05:15<04:34,  2.03it/s, loss=0.598, lr=1]\nSteps:  54%|█████▎    | 642/1200 [05:15<04:34,  2.03it/s, loss=0.303, lr=1]\nSteps:  54%|█████▎    | 643/1200 [05:16<04:33,  2.03it/s, loss=0.303, lr=1]\nSteps:  54%|█████▎    | 643/1200 [05:16<04:33,  2.03it/s, loss=0.462, lr=1]\nSteps:  54%|█████▎    | 644/1200 [05:16<04:33,  2.04it/s, loss=0.462, lr=1]\nSteps:  54%|█████▎    | 644/1200 [05:16<04:33,  2.04it/s, loss=0.348, lr=1]\nSteps:  54%|█████▍    | 645/1200 [05:17<04:32,  2.04it/s, loss=0.348, lr=1]\nSteps:  54%|█████▍    | 645/1200 [05:17<04:32,  2.04it/s, loss=0.643, lr=1]\nSteps:  54%|█████▍    | 646/1200 [05:17<04:31,  2.04it/s, loss=0.643, lr=1]\nSteps:  54%|█████▍    | 646/1200 [05:17<04:31,  2.04it/s, loss=0.762, lr=1]\nSteps:  54%|█████▍    | 647/1200 [05:18<04:31,  2.04it/s, loss=0.762, lr=1]\nSteps:  54%|█████▍    | 647/1200 [05:18<04:31,  2.04it/s, loss=0.486, lr=1]\nSteps:  54%|█████▍    | 648/1200 [05:18<04:30,  2.04it/s, loss=0.486, lr=1]\nSteps:  54%|█████▍    | 648/1200 [05:18<04:30,  2.04it/s, loss=0.538, lr=1]\nSteps:  54%|█████▍    | 649/1200 [05:19<04:31,  2.03it/s, loss=0.538, lr=1]\nSteps:  54%|█████▍    | 649/1200 [05:19<04:31,  2.03it/s, loss=0.561, lr=1]\nSteps:  54%|█████▍    | 650/1200 [05:19<04:30,  2.03it/s, loss=0.561, lr=1]\nSteps:  54%|█████▍    | 650/1200 [05:19<04:30,  2.03it/s, loss=0.602, lr=1]\nSteps:  54%|█████▍    | 651/1200 [05:20<04:29,  2.03it/s, loss=0.602, lr=1]\nSteps:  54%|█████▍    | 651/1200 [05:20<04:29,  2.03it/s, loss=0.704, lr=1]\nSteps:  54%|█████▍    | 652/1200 [05:20<04:29,  2.04it/s, loss=0.704, lr=1]\nSteps:  54%|█████▍    | 652/1200 [05:20<04:29,  2.04it/s, loss=0.622, lr=1]\nSteps:  54%|█████▍    | 653/1200 [05:21<04:28,  2.04it/s, loss=0.622, lr=1]\nSteps:  54%|█████▍    | 653/1200 [05:21<04:28,  2.04it/s, loss=0.416, lr=1]\nSteps:  55%|█████▍    | 654/1200 [05:21<04:28,  2.04it/s, loss=0.416, lr=1]\nSteps:  55%|█████▍    | 654/1200 [05:21<04:28,  2.04it/s, loss=0.457, lr=1]\nSteps:  55%|█████▍    | 655/1200 [05:22<04:27,  2.04it/s, loss=0.457, lr=1]\nSteps:  55%|█████▍    | 655/1200 [05:22<04:27,  2.04it/s, loss=0.285, lr=1]\nSteps:  55%|█████▍    | 656/1200 [05:22<04:27,  2.04it/s, loss=0.285, lr=1]\nSteps:  55%|█████▍    | 656/1200 [05:22<04:27,  2.04it/s, loss=0.748, lr=1]\nSteps:  55%|█████▍    | 657/1200 [05:23<04:26,  2.04it/s, loss=0.748, lr=1]\nSteps:  55%|█████▍    | 657/1200 [05:23<04:26,  2.04it/s, loss=0.603, lr=1]\nSteps:  55%|█████▍    | 658/1200 [05:23<04:25,  2.04it/s, loss=0.603, lr=1]\nSteps:  55%|█████▍    | 658/1200 [05:23<04:25,  2.04it/s, loss=0.602, lr=1]\nSteps:  55%|█████▍    | 659/1200 [05:24<04:25,  2.04it/s, loss=0.602, lr=1]\nSteps:  55%|█████▍    | 659/1200 [05:24<04:25,  2.04it/s, loss=0.596, lr=1]\nSteps:  55%|█████▌    | 660/1200 [05:24<04:24,  2.04it/s, loss=0.596, lr=1]\nSteps:  55%|█████▌    | 660/1200 [05:24<04:24,  2.04it/s, loss=0.592, lr=1]\nSteps:  55%|█████▌    | 661/1200 [05:25<04:25,  2.03it/s, loss=0.592, lr=1]\nSteps:  55%|█████▌    | 661/1200 [05:25<04:25,  2.03it/s, loss=0.552, lr=1]\nSteps:  55%|█████▌    | 662/1200 [05:25<04:24,  2.03it/s, loss=0.552, lr=1]\nSteps:  55%|█████▌    | 662/1200 [05:25<04:24,  2.03it/s, loss=0.646, lr=1]\nSteps:  55%|█████▌    | 663/1200 [05:26<04:23,  2.04it/s, loss=0.646, lr=1]\nSteps:  55%|█████▌    | 663/1200 [05:26<04:23,  2.04it/s, loss=0.323, lr=1]\nSteps:  55%|█████▌    | 664/1200 [05:26<04:22,  2.04it/s, loss=0.323, lr=1]\nSteps:  55%|█████▌    | 664/1200 [05:26<04:22,  2.04it/s, loss=0.351, lr=1]\nSteps:  55%|█████▌    | 665/1200 [05:26<04:22,  2.04it/s, loss=0.351, lr=1]\nSteps:  55%|█████▌    | 665/1200 [05:26<04:22,  2.04it/s, loss=0.624, lr=1]\nSteps:  56%|█████▌    | 666/1200 [05:27<04:21,  2.04it/s, loss=0.624, lr=1]\nSteps:  56%|█████▌    | 666/1200 [05:27<04:21,  2.04it/s, loss=0.407, lr=1]\nSteps:  56%|█████▌    | 667/1200 [05:27<04:21,  2.04it/s, loss=0.407, lr=1]\nSteps:  56%|█████▌    | 667/1200 [05:27<04:21,  2.04it/s, loss=0.33, lr=1] \nSteps:  56%|█████▌    | 668/1200 [05:28<04:20,  2.04it/s, loss=0.33, lr=1]\nSteps:  56%|█████▌    | 668/1200 [05:28<04:20,  2.04it/s, loss=0.553, lr=1]\nSteps:  56%|█████▌    | 669/1200 [05:28<04:20,  2.04it/s, loss=0.553, lr=1]\nSteps:  56%|█████▌    | 669/1200 [05:28<04:20,  2.04it/s, loss=0.296, lr=1]\nSteps:  56%|█████▌    | 670/1200 [05:29<04:20,  2.04it/s, loss=0.296, lr=1]\nSteps:  56%|█████▌    | 670/1200 [05:29<04:20,  2.04it/s, loss=0.788, lr=1]\nSteps:  56%|█████▌    | 671/1200 [05:29<04:19,  2.04it/s, loss=0.788, lr=1]\nSteps:  56%|█████▌    | 671/1200 [05:29<04:19,  2.04it/s, loss=0.424, lr=1]\nSteps:  56%|█████▌    | 672/1200 [05:30<04:19,  2.04it/s, loss=0.424, lr=1]\nSteps:  56%|█████▌    | 672/1200 [05:30<04:19,  2.04it/s, loss=0.33, lr=1] \nSteps:  56%|█████▌    | 673/1200 [05:30<04:19,  2.03it/s, loss=0.33, lr=1]\nSteps:  56%|█████▌    | 673/1200 [05:30<04:19,  2.03it/s, loss=0.482, lr=1]\nSteps:  56%|█████▌    | 674/1200 [05:31<04:18,  2.03it/s, loss=0.482, lr=1]\nSteps:  56%|█████▌    | 674/1200 [05:31<04:18,  2.03it/s, loss=0.776, lr=1]\nSteps:  56%|█████▋    | 675/1200 [05:31<04:17,  2.04it/s, loss=0.776, lr=1]\nSteps:  56%|█████▋    | 675/1200 [05:31<04:17,  2.04it/s, loss=0.464, lr=1]\nSteps:  56%|█████▋    | 676/1200 [05:32<04:17,  2.04it/s, loss=0.464, lr=1]\nSteps:  56%|█████▋    | 676/1200 [05:32<04:17,  2.04it/s, loss=0.276, lr=1]\nSteps:  56%|█████▋    | 677/1200 [05:32<04:16,  2.04it/s, loss=0.276, lr=1]\nSteps:  56%|█████▋    | 677/1200 [05:32<04:16,  2.04it/s, loss=0.325, lr=1]\nSteps:  56%|█████▋    | 678/1200 [05:33<04:16,  2.04it/s, loss=0.325, lr=1]\nSteps:  56%|█████▋    | 678/1200 [05:33<04:16,  2.04it/s, loss=0.511, lr=1]\nSteps:  57%|█████▋    | 679/1200 [05:33<04:15,  2.04it/s, loss=0.511, lr=1]\nSteps:  57%|█████▋    | 679/1200 [05:33<04:15,  2.04it/s, loss=0.477, lr=1]\nSteps:  57%|█████▋    | 680/1200 [05:34<04:15,  2.04it/s, loss=0.477, lr=1]\nSteps:  57%|█████▋    | 680/1200 [05:34<04:15,  2.04it/s, loss=0.314, lr=1]\nSteps:  57%|█████▋    | 681/1200 [05:34<04:14,  2.04it/s, loss=0.314, lr=1]\nSteps:  57%|█████▋    | 681/1200 [05:34<04:14,  2.04it/s, loss=0.491, lr=1]\nSteps:  57%|█████▋    | 682/1200 [05:35<04:14,  2.04it/s, loss=0.491, lr=1]\nSteps:  57%|█████▋    | 682/1200 [05:35<04:14,  2.04it/s, loss=0.733, lr=1]\nSteps:  57%|█████▋    | 683/1200 [05:35<04:13,  2.04it/s, loss=0.733, lr=1]\nSteps:  57%|█████▋    | 683/1200 [05:35<04:13,  2.04it/s, loss=0.482, lr=1]\nSteps:  57%|█████▋    | 684/1200 [05:36<04:13,  2.04it/s, loss=0.482, lr=1]\nSteps:  57%|█████▋    | 684/1200 [05:36<04:13,  2.04it/s, loss=0.597, lr=1]\nSteps:  57%|█████▋    | 685/1200 [05:36<04:13,  2.03it/s, loss=0.597, lr=1]\nSteps:  57%|█████▋    | 685/1200 [05:36<04:13,  2.03it/s, loss=0.307, lr=1]\nSteps:  57%|█████▋    | 686/1200 [05:37<04:12,  2.03it/s, loss=0.307, lr=1]\nSteps:  57%|█████▋    | 686/1200 [05:37<04:12,  2.03it/s, loss=0.31, lr=1] \nSteps:  57%|█████▋    | 687/1200 [05:37<04:12,  2.03it/s, loss=0.31, lr=1]\nSteps:  57%|█████▋    | 687/1200 [05:37<04:12,  2.03it/s, loss=0.301, lr=1]\nSteps:  57%|█████▋    | 688/1200 [05:38<04:11,  2.04it/s, loss=0.301, lr=1]\nSteps:  57%|█████▋    | 688/1200 [05:38<04:11,  2.04it/s, loss=0.673, lr=1]\nSteps:  57%|█████▋    | 689/1200 [05:38<04:10,  2.04it/s, loss=0.673, lr=1]\nSteps:  57%|█████▋    | 689/1200 [05:38<04:10,  2.04it/s, loss=0.304, lr=1]\nSteps:  57%|█████▊    | 690/1200 [05:39<04:10,  2.04it/s, loss=0.304, lr=1]\nSteps:  57%|█████▊    | 690/1200 [05:39<04:10,  2.04it/s, loss=0.28, lr=1] \nSteps:  58%|█████▊    | 691/1200 [05:39<04:09,  2.04it/s, loss=0.28, lr=1]\nSteps:  58%|█████▊    | 691/1200 [05:39<04:09,  2.04it/s, loss=0.32, lr=1]\nSteps:  58%|█████▊    | 692/1200 [05:40<04:09,  2.04it/s, loss=0.32, lr=1]\nSteps:  58%|█████▊    | 692/1200 [05:40<04:09,  2.04it/s, loss=0.53, lr=1]\nSteps:  58%|█████▊    | 693/1200 [05:40<04:08,  2.04it/s, loss=0.53, lr=1]\nSteps:  58%|█████▊    | 693/1200 [05:40<04:08,  2.04it/s, loss=0.64, lr=1]\nSteps:  58%|█████▊    | 694/1200 [05:41<04:08,  2.04it/s, loss=0.64, lr=1]\nSteps:  58%|█████▊    | 694/1200 [05:41<04:08,  2.04it/s, loss=0.553, lr=1]\nSteps:  58%|█████▊    | 695/1200 [05:41<04:07,  2.04it/s, loss=0.553, lr=1]\nSteps:  58%|█████▊    | 695/1200 [05:41<04:07,  2.04it/s, loss=0.484, lr=1]\nSteps:  58%|█████▊    | 696/1200 [05:42<04:06,  2.04it/s, loss=0.484, lr=1]\nSteps:  58%|█████▊    | 696/1200 [05:42<04:06,  2.04it/s, loss=0.42, lr=1] \nSteps:  58%|█████▊    | 697/1200 [05:42<04:07,  2.03it/s, loss=0.42, lr=1]\nSteps:  58%|█████▊    | 697/1200 [05:42<04:07,  2.03it/s, loss=0.778, lr=1]\nSteps:  58%|█████▊    | 698/1200 [05:43<04:06,  2.03it/s, loss=0.778, lr=1]\nSteps:  58%|█████▊    | 698/1200 [05:43<04:06,  2.03it/s, loss=0.462, lr=1]\nSteps:  58%|█████▊    | 699/1200 [05:43<04:06,  2.03it/s, loss=0.462, lr=1]\nSteps:  58%|█████▊    | 699/1200 [05:43<04:06,  2.03it/s, loss=0.512, lr=1]\nSteps:  58%|█████▊    | 700/1200 [05:44<04:05,  2.04it/s, loss=0.512, lr=1]\nSteps:  58%|█████▊    | 700/1200 [05:44<04:05,  2.04it/s, loss=0.454, lr=1]\nSteps:  58%|█████▊    | 701/1200 [05:44<04:04,  2.04it/s, loss=0.454, lr=1]\nSteps:  58%|█████▊    | 701/1200 [05:44<04:04,  2.04it/s, loss=0.366, lr=1]\nSteps:  58%|█████▊    | 702/1200 [05:45<04:04,  2.04it/s, loss=0.366, lr=1]\nSteps:  58%|█████▊    | 702/1200 [05:45<04:04,  2.04it/s, loss=0.327, lr=1]\nSteps:  59%|█████▊    | 703/1200 [05:45<04:03,  2.04it/s, loss=0.327, lr=1]\nSteps:  59%|█████▊    | 703/1200 [05:45<04:03,  2.04it/s, loss=0.326, lr=1]\nSteps:  59%|█████▊    | 704/1200 [05:46<04:03,  2.04it/s, loss=0.326, lr=1]\nSteps:  59%|█████▊    | 704/1200 [05:46<04:03,  2.04it/s, loss=0.325, lr=1]\nSteps:  59%|█████▉    | 705/1200 [05:46<04:02,  2.04it/s, loss=0.325, lr=1]\nSteps:  59%|█████▉    | 705/1200 [05:46<04:02,  2.04it/s, loss=0.353, lr=1]\nSteps:  59%|█████▉    | 706/1200 [05:47<04:02,  2.04it/s, loss=0.353, lr=1]\nSteps:  59%|█████▉    | 706/1200 [05:47<04:02,  2.04it/s, loss=0.608, lr=1]\nSteps:  59%|█████▉    | 707/1200 [05:47<04:01,  2.04it/s, loss=0.608, lr=1]\nSteps:  59%|█████▉    | 707/1200 [05:47<04:01,  2.04it/s, loss=0.314, lr=1]\nSteps:  59%|█████▉    | 708/1200 [05:48<04:01,  2.04it/s, loss=0.314, lr=1]\nSteps:  59%|█████▉    | 708/1200 [05:48<04:01,  2.04it/s, loss=0.448, lr=1]\nSteps:  59%|█████▉    | 709/1200 [05:48<04:01,  2.03it/s, loss=0.448, lr=1]\nSteps:  59%|█████▉    | 709/1200 [05:48<04:01,  2.03it/s, loss=0.449, lr=1]\nSteps:  59%|█████▉    | 710/1200 [05:49<04:00,  2.04it/s, loss=0.449, lr=1]\nSteps:  59%|█████▉    | 710/1200 [05:49<04:00,  2.04it/s, loss=0.501, lr=1]\nSteps:  59%|█████▉    | 711/1200 [05:49<03:59,  2.04it/s, loss=0.501, lr=1]\nSteps:  59%|█████▉    | 711/1200 [05:49<03:59,  2.04it/s, loss=0.426, lr=1]\nSteps:  59%|█████▉    | 712/1200 [05:50<03:59,  2.04it/s, loss=0.426, lr=1]\nSteps:  59%|█████▉    | 712/1200 [05:50<03:59,  2.04it/s, loss=0.288, lr=1]\nSteps:  59%|█████▉    | 713/1200 [05:50<03:58,  2.04it/s, loss=0.288, lr=1]\nSteps:  59%|█████▉    | 713/1200 [05:50<03:58,  2.04it/s, loss=0.775, lr=1]\nSteps:  60%|█████▉    | 714/1200 [05:51<03:58,  2.04it/s, loss=0.775, lr=1]\nSteps:  60%|█████▉    | 714/1200 [05:51<03:58,  2.04it/s, loss=0.489, lr=1]\nSteps:  60%|█████▉    | 715/1200 [05:51<03:57,  2.04it/s, loss=0.489, lr=1]\nSteps:  60%|█████▉    | 715/1200 [05:51<03:57,  2.04it/s, loss=0.538, lr=1]\nSteps:  60%|█████▉    | 716/1200 [05:52<03:57,  2.04it/s, loss=0.538, lr=1]\nSteps:  60%|█████▉    | 716/1200 [05:52<03:57,  2.04it/s, loss=0.269, lr=1]\nSteps:  60%|█████▉    | 717/1200 [05:52<03:56,  2.04it/s, loss=0.269, lr=1]\nSteps:  60%|█████▉    | 717/1200 [05:52<03:56,  2.04it/s, loss=0.574, lr=1]\nSteps:  60%|█████▉    | 718/1200 [05:53<03:56,  2.04it/s, loss=0.574, lr=1]\nSteps:  60%|█████▉    | 718/1200 [05:53<03:56,  2.04it/s, loss=0.357, lr=1]\nSteps:  60%|█████▉    | 719/1200 [05:53<03:55,  2.04it/s, loss=0.357, lr=1]\nSteps:  60%|█████▉    | 719/1200 [05:53<03:55,  2.04it/s, loss=0.591, lr=1]\nSteps:  60%|██████    | 720/1200 [05:53<03:54,  2.04it/s, loss=0.591, lr=1]\nSteps:  60%|██████    | 720/1200 [05:53<03:54,  2.04it/s, loss=0.381, lr=1]\nSteps:  60%|██████    | 721/1200 [05:54<03:55,  2.03it/s, loss=0.381, lr=1]\nSteps:  60%|██████    | 721/1200 [05:54<03:55,  2.03it/s, loss=0.292, lr=1]\nSteps:  60%|██████    | 722/1200 [05:54<03:54,  2.04it/s, loss=0.292, lr=1]\nSteps:  60%|██████    | 722/1200 [05:54<03:54,  2.04it/s, loss=0.702, lr=1]\nSteps:  60%|██████    | 723/1200 [05:55<03:54,  2.04it/s, loss=0.702, lr=1]\nSteps:  60%|██████    | 723/1200 [05:55<03:54,  2.04it/s, loss=0.523, lr=1]\nSteps:  60%|██████    | 724/1200 [05:55<03:53,  2.04it/s, loss=0.523, lr=1]\nSteps:  60%|██████    | 724/1200 [05:55<03:53,  2.04it/s, loss=0.423, lr=1]\nSteps:  60%|██████    | 725/1200 [05:56<03:52,  2.04it/s, loss=0.423, lr=1]\nSteps:  60%|██████    | 725/1200 [05:56<03:52,  2.04it/s, loss=0.484, lr=1]\nSteps:  60%|██████    | 726/1200 [05:56<03:52,  2.04it/s, loss=0.484, lr=1]\nSteps:  60%|██████    | 726/1200 [05:56<03:52,  2.04it/s, loss=0.591, lr=1]\nSteps:  61%|██████    | 727/1200 [05:57<03:52,  2.04it/s, loss=0.591, lr=1]\nSteps:  61%|██████    | 727/1200 [05:57<03:52,  2.04it/s, loss=0.807, lr=1]\nSteps:  61%|██████    | 728/1200 [05:57<03:51,  2.04it/s, loss=0.807, lr=1]\nSteps:  61%|██████    | 728/1200 [05:57<03:51,  2.04it/s, loss=0.469, lr=1]\nSteps:  61%|██████    | 729/1200 [05:58<03:50,  2.04it/s, loss=0.469, lr=1]\nSteps:  61%|██████    | 729/1200 [05:58<03:50,  2.04it/s, loss=0.361, lr=1]\nSteps:  61%|██████    | 730/1200 [05:58<03:50,  2.04it/s, loss=0.361, lr=1]\nSteps:  61%|██████    | 730/1200 [05:58<03:50,  2.04it/s, loss=0.294, lr=1]\nSteps:  61%|██████    | 731/1200 [05:59<03:49,  2.04it/s, loss=0.294, lr=1]\nSteps:  61%|██████    | 731/1200 [05:59<03:49,  2.04it/s, loss=0.555, lr=1]\nSteps:  61%|██████    | 732/1200 [05:59<03:49,  2.04it/s, loss=0.555, lr=1]\nSteps:  61%|██████    | 732/1200 [05:59<03:49,  2.04it/s, loss=0.392, lr=1]\nSteps:  61%|██████    | 733/1200 [06:00<03:49,  2.03it/s, loss=0.392, lr=1]\nSteps:  61%|██████    | 733/1200 [06:00<03:49,  2.03it/s, loss=0.348, lr=1]\nSteps:  61%|██████    | 734/1200 [06:00<03:48,  2.04it/s, loss=0.348, lr=1]\nSteps:  61%|██████    | 734/1200 [06:00<03:48,  2.04it/s, loss=0.625, lr=1]\nSteps:  61%|██████▏   | 735/1200 [06:01<03:48,  2.04it/s, loss=0.625, lr=1]\nSteps:  61%|██████▏   | 735/1200 [06:01<03:48,  2.04it/s, loss=0.346, lr=1]\nSteps:  61%|██████▏   | 736/1200 [06:01<03:47,  2.04it/s, loss=0.346, lr=1]\nSteps:  61%|██████▏   | 736/1200 [06:01<03:47,  2.04it/s, loss=0.331, lr=1]\nSteps:  61%|██████▏   | 737/1200 [06:02<03:46,  2.04it/s, loss=0.331, lr=1]\nSteps:  61%|██████▏   | 737/1200 [06:02<03:46,  2.04it/s, loss=0.322, lr=1]\nSteps:  62%|██████▏   | 738/1200 [06:02<03:46,  2.04it/s, loss=0.322, lr=1]\nSteps:  62%|██████▏   | 738/1200 [06:02<03:46,  2.04it/s, loss=0.391, lr=1]\nSteps:  62%|██████▏   | 739/1200 [06:03<03:45,  2.04it/s, loss=0.391, lr=1]\nSteps:  62%|██████▏   | 739/1200 [06:03<03:45,  2.04it/s, loss=0.617, lr=1]\nSteps:  62%|██████▏   | 740/1200 [06:03<03:45,  2.04it/s, loss=0.617, lr=1]\nSteps:  62%|██████▏   | 740/1200 [06:03<03:45,  2.04it/s, loss=0.648, lr=1]\nSteps:  62%|██████▏   | 741/1200 [06:04<03:44,  2.04it/s, loss=0.648, lr=1]\nSteps:  62%|██████▏   | 741/1200 [06:04<03:44,  2.04it/s, loss=0.275, lr=1]\nSteps:  62%|██████▏   | 742/1200 [06:04<03:44,  2.04it/s, loss=0.275, lr=1]\nSteps:  62%|██████▏   | 742/1200 [06:04<03:44,  2.04it/s, loss=0.658, lr=1]\nSteps:  62%|██████▏   | 743/1200 [06:05<03:43,  2.04it/s, loss=0.658, lr=1]\nSteps:  62%|██████▏   | 743/1200 [06:05<03:43,  2.04it/s, loss=0.324, lr=1]\nSteps:  62%|██████▏   | 744/1200 [06:05<03:43,  2.04it/s, loss=0.324, lr=1]\nSteps:  62%|██████▏   | 744/1200 [06:05<03:43,  2.04it/s, loss=0.76, lr=1] \nSteps:  62%|██████▏   | 745/1200 [06:06<03:43,  2.03it/s, loss=0.76, lr=1]\nSteps:  62%|██████▏   | 745/1200 [06:06<03:43,  2.03it/s, loss=0.298, lr=1]\nSteps:  62%|██████▏   | 746/1200 [06:06<03:42,  2.04it/s, loss=0.298, lr=1]\nSteps:  62%|██████▏   | 746/1200 [06:06<03:42,  2.04it/s, loss=0.564, lr=1]\nSteps:  62%|██████▏   | 747/1200 [06:07<03:42,  2.04it/s, loss=0.564, lr=1]\nSteps:  62%|██████▏   | 747/1200 [06:07<03:42,  2.04it/s, loss=0.281, lr=1]\nSteps:  62%|██████▏   | 748/1200 [06:07<03:41,  2.04it/s, loss=0.281, lr=1]\nSteps:  62%|██████▏   | 748/1200 [06:07<03:41,  2.04it/s, loss=0.634, lr=1]\nSteps:  62%|██████▏   | 749/1200 [06:08<03:40,  2.04it/s, loss=0.634, lr=1]\nSteps:  62%|██████▏   | 749/1200 [06:08<03:40,  2.04it/s, loss=0.879, lr=1]\nSteps:  62%|██████▎   | 750/1200 [06:08<03:40,  2.04it/s, loss=0.879, lr=1]\nSteps:  62%|██████▎   | 750/1200 [06:08<03:40,  2.04it/s, loss=0.598, lr=1]\nSteps:  63%|██████▎   | 751/1200 [06:09<03:39,  2.04it/s, loss=0.598, lr=1]\nSteps:  63%|██████▎   | 751/1200 [06:09<03:39,  2.04it/s, loss=0.379, lr=1]\nSteps:  63%|██████▎   | 752/1200 [06:09<03:39,  2.04it/s, loss=0.379, lr=1]\nSteps:  63%|██████▎   | 752/1200 [06:09<03:39,  2.04it/s, loss=0.493, lr=1]\nSteps:  63%|██████▎   | 753/1200 [06:10<03:38,  2.04it/s, loss=0.493, lr=1]\nSteps:  63%|██████▎   | 753/1200 [06:10<03:38,  2.04it/s, loss=0.646, lr=1]\nSteps:  63%|██████▎   | 754/1200 [06:10<03:38,  2.04it/s, loss=0.646, lr=1]\nSteps:  63%|██████▎   | 754/1200 [06:10<03:38,  2.04it/s, loss=0.625, lr=1]\nSteps:  63%|██████▎   | 755/1200 [06:11<03:38,  2.04it/s, loss=0.625, lr=1]\nSteps:  63%|██████▎   | 755/1200 [06:11<03:38,  2.04it/s, loss=0.376, lr=1]\nSteps:  63%|██████▎   | 756/1200 [06:11<03:37,  2.04it/s, loss=0.376, lr=1]\nSteps:  63%|██████▎   | 756/1200 [06:11<03:37,  2.04it/s, loss=0.839, lr=1]\nSteps:  63%|██████▎   | 757/1200 [06:12<03:37,  2.03it/s, loss=0.839, lr=1]\nSteps:  63%|██████▎   | 757/1200 [06:12<03:37,  2.03it/s, loss=0.635, lr=1]\nSteps:  63%|██████▎   | 758/1200 [06:12<03:37,  2.03it/s, loss=0.635, lr=1]\nSteps:  63%|██████▎   | 758/1200 [06:12<03:37,  2.03it/s, loss=0.39, lr=1] \nSteps:  63%|██████▎   | 759/1200 [06:13<03:36,  2.04it/s, loss=0.39, lr=1]\nSteps:  63%|██████▎   | 759/1200 [06:13<03:36,  2.04it/s, loss=0.717, lr=1]\nSteps:  63%|██████▎   | 760/1200 [06:13<03:36,  2.04it/s, loss=0.717, lr=1]\nSteps:  63%|██████▎   | 760/1200 [06:13<03:36,  2.04it/s, loss=0.61, lr=1] \nSteps:  63%|██████▎   | 761/1200 [06:14<03:35,  2.04it/s, loss=0.61, lr=1]\nSteps:  63%|██████▎   | 761/1200 [06:14<03:35,  2.04it/s, loss=0.314, lr=1]\nSteps:  64%|██████▎   | 762/1200 [06:14<03:36,  2.03it/s, loss=0.314, lr=1]\nSteps:  64%|██████▎   | 762/1200 [06:14<03:36,  2.03it/s, loss=0.571, lr=1]\nSteps:  64%|██████▎   | 763/1200 [06:15<03:35,  2.03it/s, loss=0.571, lr=1]\nSteps:  64%|██████▎   | 763/1200 [06:15<03:35,  2.03it/s, loss=0.596, lr=1]\nSteps:  64%|██████▎   | 764/1200 [06:15<03:34,  2.03it/s, loss=0.596, lr=1]\nSteps:  64%|██████▎   | 764/1200 [06:15<03:34,  2.03it/s, loss=0.281, lr=1]\nSteps:  64%|██████▍   | 765/1200 [06:16<03:34,  2.03it/s, loss=0.281, lr=1]\nSteps:  64%|██████▍   | 765/1200 [06:16<03:34,  2.03it/s, loss=0.276, lr=1]\nSteps:  64%|██████▍   | 766/1200 [06:16<03:36,  2.01it/s, loss=0.276, lr=1]\nSteps:  64%|██████▍   | 766/1200 [06:16<03:36,  2.01it/s, loss=0.312, lr=1]\nSteps:  64%|██████▍   | 767/1200 [06:17<03:34,  2.02it/s, loss=0.312, lr=1]\nSteps:  64%|██████▍   | 767/1200 [06:17<03:34,  2.02it/s, loss=0.463, lr=1]\nSteps:  64%|██████▍   | 768/1200 [06:17<03:33,  2.03it/s, loss=0.463, lr=1]\nSteps:  64%|██████▍   | 768/1200 [06:17<03:33,  2.03it/s, loss=0.312, lr=1]\nSteps:  64%|██████▍   | 769/1200 [06:18<03:33,  2.02it/s, loss=0.312, lr=1]\nSteps:  64%|██████▍   | 769/1200 [06:18<03:33,  2.02it/s, loss=0.27, lr=1] \nSteps:  64%|██████▍   | 770/1200 [06:18<03:32,  2.03it/s, loss=0.27, lr=1]\nSteps:  64%|██████▍   | 770/1200 [06:18<03:32,  2.03it/s, loss=0.448, lr=1]\nSteps:  64%|██████▍   | 771/1200 [06:19<03:31,  2.03it/s, loss=0.448, lr=1]\nSteps:  64%|██████▍   | 771/1200 [06:19<03:31,  2.03it/s, loss=0.3, lr=1]  \nSteps:  64%|██████▍   | 772/1200 [06:19<03:30,  2.03it/s, loss=0.3, lr=1]\nSteps:  64%|██████▍   | 772/1200 [06:19<03:30,  2.03it/s, loss=0.641, lr=1]\nSteps:  64%|██████▍   | 773/1200 [06:20<03:29,  2.04it/s, loss=0.641, lr=1]\nSteps:  64%|██████▍   | 773/1200 [06:20<03:29,  2.04it/s, loss=0.616, lr=1]\nSteps:  64%|██████▍   | 774/1200 [06:20<03:29,  2.04it/s, loss=0.616, lr=1]\nSteps:  64%|██████▍   | 774/1200 [06:20<03:29,  2.04it/s, loss=0.506, lr=1]\nSteps:  65%|██████▍   | 775/1200 [06:21<03:28,  2.04it/s, loss=0.506, lr=1]\nSteps:  65%|██████▍   | 775/1200 [06:21<03:28,  2.04it/s, loss=0.406, lr=1]\nSteps:  65%|██████▍   | 776/1200 [06:21<03:27,  2.04it/s, loss=0.406, lr=1]\nSteps:  65%|██████▍   | 776/1200 [06:21<03:27,  2.04it/s, loss=0.591, lr=1]\nSteps:  65%|██████▍   | 777/1200 [06:21<03:27,  2.04it/s, loss=0.591, lr=1]\nSteps:  65%|██████▍   | 777/1200 [06:21<03:27,  2.04it/s, loss=0.372, lr=1]\nSteps:  65%|██████▍   | 778/1200 [06:22<03:26,  2.04it/s, loss=0.372, lr=1]\nSteps:  65%|██████▍   | 778/1200 [06:22<03:26,  2.04it/s, loss=0.36, lr=1] \nSteps:  65%|██████▍   | 779/1200 [06:22<03:26,  2.04it/s, loss=0.36, lr=1]\nSteps:  65%|██████▍   | 779/1200 [06:22<03:26,  2.04it/s, loss=0.364, lr=1]\nSteps:  65%|██████▌   | 780/1200 [06:23<03:25,  2.04it/s, loss=0.364, lr=1]\nSteps:  65%|██████▌   | 780/1200 [06:23<03:25,  2.04it/s, loss=0.297, lr=1]\nSteps:  65%|██████▌   | 781/1200 [06:23<03:26,  2.03it/s, loss=0.297, lr=1]\nSteps:  65%|██████▌   | 781/1200 [06:23<03:26,  2.03it/s, loss=0.664, lr=1]\nSteps:  65%|██████▌   | 782/1200 [06:24<03:25,  2.03it/s, loss=0.664, lr=1]\nSteps:  65%|██████▌   | 782/1200 [06:24<03:25,  2.03it/s, loss=0.636, lr=1]\nSteps:  65%|██████▌   | 783/1200 [06:24<03:24,  2.04it/s, loss=0.636, lr=1]\nSteps:  65%|██████▌   | 783/1200 [06:24<03:24,  2.04it/s, loss=0.592, lr=1]\nSteps:  65%|██████▌   | 784/1200 [06:25<03:24,  2.04it/s, loss=0.592, lr=1]\nSteps:  65%|██████▌   | 784/1200 [06:25<03:24,  2.04it/s, loss=0.547, lr=1]\nSteps:  65%|██████▌   | 785/1200 [06:25<03:23,  2.04it/s, loss=0.547, lr=1]\nSteps:  65%|██████▌   | 785/1200 [06:25<03:23,  2.04it/s, loss=0.426, lr=1]\nSteps:  66%|██████▌   | 786/1200 [06:26<03:23,  2.04it/s, loss=0.426, lr=1]\nSteps:  66%|██████▌   | 786/1200 [06:26<03:23,  2.04it/s, loss=0.286, lr=1]\nSteps:  66%|██████▌   | 787/1200 [06:26<03:22,  2.04it/s, loss=0.286, lr=1]\nSteps:  66%|██████▌   | 787/1200 [06:26<03:22,  2.04it/s, loss=0.56, lr=1] \nSteps:  66%|██████▌   | 788/1200 [06:27<03:22,  2.04it/s, loss=0.56, lr=1]\nSteps:  66%|██████▌   | 788/1200 [06:27<03:22,  2.04it/s, loss=0.621, lr=1]\nSteps:  66%|██████▌   | 789/1200 [06:27<03:21,  2.04it/s, loss=0.621, lr=1]\nSteps:  66%|██████▌   | 789/1200 [06:27<03:21,  2.04it/s, loss=0.322, lr=1]\nSteps:  66%|██████▌   | 790/1200 [06:28<03:21,  2.04it/s, loss=0.322, lr=1]\nSteps:  66%|██████▌   | 790/1200 [06:28<03:21,  2.04it/s, loss=0.609, lr=1]\nSteps:  66%|██████▌   | 791/1200 [06:28<03:20,  2.04it/s, loss=0.609, lr=1]\nSteps:  66%|██████▌   | 791/1200 [06:28<03:20,  2.04it/s, loss=0.698, lr=1]\nSteps:  66%|██████▌   | 792/1200 [06:29<03:20,  2.04it/s, loss=0.698, lr=1]\nSteps:  66%|██████▌   | 792/1200 [06:29<03:20,  2.04it/s, loss=0.286, lr=1]\nSteps:  66%|██████▌   | 793/1200 [06:29<03:20,  2.03it/s, loss=0.286, lr=1]\nSteps:  66%|██████▌   | 793/1200 [06:29<03:20,  2.03it/s, loss=0.579, lr=1]\nSteps:  66%|██████▌   | 794/1200 [06:30<03:19,  2.03it/s, loss=0.579, lr=1]\nSteps:  66%|██████▌   | 794/1200 [06:30<03:19,  2.03it/s, loss=0.429, lr=1]\nSteps:  66%|██████▋   | 795/1200 [06:30<03:19,  2.03it/s, loss=0.429, lr=1]\nSteps:  66%|██████▋   | 795/1200 [06:30<03:19,  2.03it/s, loss=0.48, lr=1] \nSteps:  66%|██████▋   | 796/1200 [06:31<03:18,  2.04it/s, loss=0.48, lr=1]\nSteps:  66%|██████▋   | 796/1200 [06:31<03:18,  2.04it/s, loss=0.295, lr=1]\nSteps:  66%|██████▋   | 797/1200 [06:31<03:17,  2.04it/s, loss=0.295, lr=1]\nSteps:  66%|██████▋   | 797/1200 [06:31<03:17,  2.04it/s, loss=0.32, lr=1] \nSteps:  66%|██████▋   | 798/1200 [06:32<03:17,  2.04it/s, loss=0.32, lr=1]\nSteps:  66%|██████▋   | 798/1200 [06:32<03:17,  2.04it/s, loss=0.348, lr=1]\nSteps:  67%|██████▋   | 799/1200 [06:32<03:16,  2.04it/s, loss=0.348, lr=1]\nSteps:  67%|██████▋   | 799/1200 [06:32<03:16,  2.04it/s, loss=0.343, lr=1]\nSteps:  67%|██████▋   | 800/1200 [06:33<03:16,  2.04it/s, loss=0.343, lr=1]\nSteps:  67%|██████▋   | 800/1200 [06:33<03:16,  2.04it/s, loss=0.4, lr=1]  \nSteps:  67%|██████▋   | 801/1200 [06:33<03:15,  2.04it/s, loss=0.4, lr=1]\nSteps:  67%|██████▋   | 801/1200 [06:33<03:15,  2.04it/s, loss=0.309, lr=1]\nSteps:  67%|██████▋   | 802/1200 [06:34<03:15,  2.04it/s, loss=0.309, lr=1]\nSteps:  67%|██████▋   | 802/1200 [06:34<03:15,  2.04it/s, loss=0.586, lr=1]\nSteps:  67%|██████▋   | 803/1200 [06:34<03:14,  2.04it/s, loss=0.586, lr=1]\nSteps:  67%|██████▋   | 803/1200 [06:34<03:14,  2.04it/s, loss=0.322, lr=1]\nSteps:  67%|██████▋   | 804/1200 [06:35<03:14,  2.04it/s, loss=0.322, lr=1]\nSteps:  67%|██████▋   | 804/1200 [06:35<03:14,  2.04it/s, loss=0.6, lr=1]  \nSteps:  67%|██████▋   | 805/1200 [06:35<03:14,  2.03it/s, loss=0.6, lr=1]\nSteps:  67%|██████▋   | 805/1200 [06:35<03:14,  2.03it/s, loss=0.572, lr=1]\nSteps:  67%|██████▋   | 806/1200 [06:36<03:13,  2.03it/s, loss=0.572, lr=1]\nSteps:  67%|██████▋   | 806/1200 [06:36<03:13,  2.03it/s, loss=0.408, lr=1]\nSteps:  67%|██████▋   | 807/1200 [06:36<03:13,  2.03it/s, loss=0.408, lr=1]\nSteps:  67%|██████▋   | 807/1200 [06:36<03:13,  2.03it/s, loss=0.289, lr=1]\nSteps:  67%|██████▋   | 808/1200 [06:37<03:12,  2.04it/s, loss=0.289, lr=1]\nSteps:  67%|██████▋   | 808/1200 [06:37<03:12,  2.04it/s, loss=0.703, lr=1]\nSteps:  67%|██████▋   | 809/1200 [06:37<03:11,  2.04it/s, loss=0.703, lr=1]\nSteps:  67%|██████▋   | 809/1200 [06:37<03:11,  2.04it/s, loss=0.297, lr=1]\nSteps:  68%|██████▊   | 810/1200 [06:38<03:11,  2.04it/s, loss=0.297, lr=1]\nSteps:  68%|██████▊   | 810/1200 [06:38<03:11,  2.04it/s, loss=0.356, lr=1]\nSteps:  68%|██████▊   | 811/1200 [06:38<03:10,  2.04it/s, loss=0.356, lr=1]\nSteps:  68%|██████▊   | 811/1200 [06:38<03:10,  2.04it/s, loss=0.61, lr=1] \nSteps:  68%|██████▊   | 812/1200 [06:39<03:10,  2.04it/s, loss=0.61, lr=1]\nSteps:  68%|██████▊   | 812/1200 [06:39<03:10,  2.04it/s, loss=0.633, lr=1]\nSteps:  68%|██████▊   | 813/1200 [06:39<03:09,  2.04it/s, loss=0.633, lr=1]\nSteps:  68%|██████▊   | 813/1200 [06:39<03:09,  2.04it/s, loss=0.32, lr=1] \nSteps:  68%|██████▊   | 814/1200 [06:40<03:09,  2.04it/s, loss=0.32, lr=1]\nSteps:  68%|██████▊   | 814/1200 [06:40<03:09,  2.04it/s, loss=0.372, lr=1]\nSteps:  68%|██████▊   | 815/1200 [06:40<03:08,  2.04it/s, loss=0.372, lr=1]\nSteps:  68%|██████▊   | 815/1200 [06:40<03:08,  2.04it/s, loss=0.621, lr=1]\nSteps:  68%|██████▊   | 816/1200 [06:41<03:08,  2.04it/s, loss=0.621, lr=1]\nSteps:  68%|██████▊   | 816/1200 [06:41<03:08,  2.04it/s, loss=0.62, lr=1] \nSteps:  68%|██████▊   | 817/1200 [06:41<03:08,  2.03it/s, loss=0.62, lr=1]\nSteps:  68%|██████▊   | 817/1200 [06:41<03:08,  2.03it/s, loss=0.573, lr=1]\nSteps:  68%|██████▊   | 818/1200 [06:42<03:07,  2.03it/s, loss=0.573, lr=1]\nSteps:  68%|██████▊   | 818/1200 [06:42<03:07,  2.03it/s, loss=0.66, lr=1] \nSteps:  68%|██████▊   | 819/1200 [06:42<03:07,  2.04it/s, loss=0.66, lr=1]\nSteps:  68%|██████▊   | 819/1200 [06:42<03:07,  2.04it/s, loss=0.615, lr=1]\nSteps:  68%|██████▊   | 820/1200 [06:43<03:22,  1.88it/s, loss=0.615, lr=1]\nSteps:  68%|██████▊   | 820/1200 [06:43<03:22,  1.88it/s, loss=0.362, lr=1]\nSteps:  68%|██████▊   | 821/1200 [06:43<03:17,  1.92it/s, loss=0.362, lr=1]\nSteps:  68%|██████▊   | 821/1200 [06:43<03:17,  1.92it/s, loss=0.665, lr=1]\nSteps:  68%|██████▊   | 822/1200 [06:44<03:13,  1.96it/s, loss=0.665, lr=1]\nSteps:  68%|██████▊   | 822/1200 [06:44<03:13,  1.96it/s, loss=0.583, lr=1]\nSteps:  69%|██████▊   | 823/1200 [06:44<03:10,  1.98it/s, loss=0.583, lr=1]\nSteps:  69%|██████▊   | 823/1200 [06:44<03:10,  1.98it/s, loss=0.554, lr=1]\nSteps:  69%|██████▊   | 824/1200 [06:45<03:08,  2.00it/s, loss=0.554, lr=1]\nSteps:  69%|██████▊   | 824/1200 [06:45<03:08,  2.00it/s, loss=0.764, lr=1]\nSteps:  69%|██████▉   | 825/1200 [06:45<03:06,  2.01it/s, loss=0.764, lr=1]\nSteps:  69%|██████▉   | 825/1200 [06:45<03:06,  2.01it/s, loss=0.612, lr=1]\nSteps:  69%|██████▉   | 826/1200 [06:46<03:05,  2.02it/s, loss=0.612, lr=1]\nSteps:  69%|██████▉   | 826/1200 [06:46<03:05,  2.02it/s, loss=0.37, lr=1] \nSteps:  69%|██████▉   | 827/1200 [06:46<03:04,  2.02it/s, loss=0.37, lr=1]\nSteps:  69%|██████▉   | 827/1200 [06:46<03:04,  2.02it/s, loss=0.499, lr=1]\nSteps:  69%|██████▉   | 828/1200 [06:47<03:03,  2.03it/s, loss=0.499, lr=1]\nSteps:  69%|██████▉   | 828/1200 [06:47<03:03,  2.03it/s, loss=0.44, lr=1] \nSteps:  69%|██████▉   | 829/1200 [06:47<03:03,  2.02it/s, loss=0.44, lr=1]\nSteps:  69%|██████▉   | 829/1200 [06:47<03:03,  2.02it/s, loss=0.665, lr=1]\nSteps:  69%|██████▉   | 830/1200 [06:48<03:02,  2.03it/s, loss=0.665, lr=1]\nSteps:  69%|██████▉   | 830/1200 [06:48<03:02,  2.03it/s, loss=0.372, lr=1]\nSteps:  69%|██████▉   | 831/1200 [06:48<03:01,  2.03it/s, loss=0.372, lr=1]\nSteps:  69%|██████▉   | 831/1200 [06:48<03:01,  2.03it/s, loss=0.528, lr=1]\nSteps:  69%|██████▉   | 832/1200 [06:49<03:01,  2.03it/s, loss=0.528, lr=1]\nSteps:  69%|██████▉   | 832/1200 [06:49<03:01,  2.03it/s, loss=0.319, lr=1]\nSteps:  69%|██████▉   | 833/1200 [06:49<03:00,  2.03it/s, loss=0.319, lr=1]\nSteps:  69%|██████▉   | 833/1200 [06:49<03:00,  2.03it/s, loss=0.348, lr=1]\nSteps:  70%|██████▉   | 834/1200 [06:50<02:59,  2.04it/s, loss=0.348, lr=1]\nSteps:  70%|██████▉   | 834/1200 [06:50<02:59,  2.04it/s, loss=0.301, lr=1]\nSteps:  70%|██████▉   | 835/1200 [06:50<02:59,  2.04it/s, loss=0.301, lr=1]\nSteps:  70%|██████▉   | 835/1200 [06:50<02:59,  2.04it/s, loss=0.322, lr=1]\nSteps:  70%|██████▉   | 836/1200 [06:51<02:58,  2.04it/s, loss=0.322, lr=1]\nSteps:  70%|██████▉   | 836/1200 [06:51<02:58,  2.04it/s, loss=0.608, lr=1]\nSteps:  70%|██████▉   | 837/1200 [06:51<02:58,  2.04it/s, loss=0.608, lr=1]\nSteps:  70%|██████▉   | 837/1200 [06:51<02:58,  2.04it/s, loss=0.26, lr=1] \nSteps:  70%|██████▉   | 838/1200 [06:52<02:57,  2.04it/s, loss=0.26, lr=1]\nSteps:  70%|██████▉   | 838/1200 [06:52<02:57,  2.04it/s, loss=0.405, lr=1]\nSteps:  70%|██████▉   | 839/1200 [06:52<02:56,  2.04it/s, loss=0.405, lr=1]\nSteps:  70%|██████▉   | 839/1200 [06:52<02:56,  2.04it/s, loss=0.37, lr=1] \nSteps:  70%|███████   | 840/1200 [06:53<02:56,  2.04it/s, loss=0.37, lr=1]\nSteps:  70%|███████   | 840/1200 [06:53<02:56,  2.04it/s, loss=0.641, lr=1]\nSteps:  70%|███████   | 841/1200 [06:53<02:57,  2.03it/s, loss=0.641, lr=1]\nSteps:  70%|███████   | 841/1200 [06:53<02:57,  2.03it/s, loss=0.595, lr=1]\nSteps:  70%|███████   | 842/1200 [06:54<02:56,  2.03it/s, loss=0.595, lr=1]\nSteps:  70%|███████   | 842/1200 [06:54<02:56,  2.03it/s, loss=0.899, lr=1]\nSteps:  70%|███████   | 843/1200 [06:54<02:55,  2.03it/s, loss=0.899, lr=1]\nSteps:  70%|███████   | 843/1200 [06:54<02:55,  2.03it/s, loss=0.317, lr=1]\nSteps:  70%|███████   | 844/1200 [06:55<02:55,  2.03it/s, loss=0.317, lr=1]\nSteps:  70%|███████   | 844/1200 [06:55<02:55,  2.03it/s, loss=0.333, lr=1]\nSteps:  70%|███████   | 845/1200 [06:55<02:54,  2.04it/s, loss=0.333, lr=1]\nSteps:  70%|███████   | 845/1200 [06:55<02:54,  2.04it/s, loss=0.304, lr=1]\nSteps:  70%|███████   | 846/1200 [06:56<02:53,  2.04it/s, loss=0.304, lr=1]\nSteps:  70%|███████   | 846/1200 [06:56<02:53,  2.04it/s, loss=0.671, lr=1]\nSteps:  71%|███████   | 847/1200 [06:56<02:53,  2.04it/s, loss=0.671, lr=1]\nSteps:  71%|███████   | 847/1200 [06:56<02:53,  2.04it/s, loss=0.581, lr=1]\nSteps:  71%|███████   | 848/1200 [06:56<02:52,  2.04it/s, loss=0.581, lr=1]\nSteps:  71%|███████   | 848/1200 [06:56<02:52,  2.04it/s, loss=0.583, lr=1]\nSteps:  71%|███████   | 849/1200 [06:57<02:52,  2.03it/s, loss=0.583, lr=1]\nSteps:  71%|███████   | 849/1200 [06:57<02:52,  2.03it/s, loss=0.933, lr=1]\nSteps:  71%|███████   | 850/1200 [06:57<02:52,  2.03it/s, loss=0.933, lr=1]\nSteps:  71%|███████   | 850/1200 [06:57<02:52,  2.03it/s, loss=0.656, lr=1]\nSteps:  71%|███████   | 851/1200 [06:58<02:51,  2.04it/s, loss=0.656, lr=1]\nSteps:  71%|███████   | 851/1200 [06:58<02:51,  2.04it/s, loss=0.561, lr=1]\nSteps:  71%|███████   | 852/1200 [06:58<02:50,  2.04it/s, loss=0.561, lr=1]\nSteps:  71%|███████   | 852/1200 [06:58<02:50,  2.04it/s, loss=0.325, lr=1]\nSteps:  71%|███████   | 853/1200 [06:59<02:51,  2.03it/s, loss=0.325, lr=1]\nSteps:  71%|███████   | 853/1200 [06:59<02:51,  2.03it/s, loss=0.539, lr=1]\nSteps:  71%|███████   | 854/1200 [06:59<02:50,  2.03it/s, loss=0.539, lr=1]\nSteps:  71%|███████   | 854/1200 [06:59<02:50,  2.03it/s, loss=0.846, lr=1]\nSteps:  71%|███████▏  | 855/1200 [07:00<02:49,  2.03it/s, loss=0.846, lr=1]\nSteps:  71%|███████▏  | 855/1200 [07:00<02:49,  2.03it/s, loss=0.869, lr=1]\nSteps:  71%|███████▏  | 856/1200 [07:00<02:49,  2.03it/s, loss=0.869, lr=1]\nSteps:  71%|███████▏  | 856/1200 [07:00<02:49,  2.03it/s, loss=0.378, lr=1]\nSteps:  71%|███████▏  | 857/1200 [07:01<02:48,  2.03it/s, loss=0.378, lr=1]\nSteps:  71%|███████▏  | 857/1200 [07:01<02:48,  2.03it/s, loss=0.29, lr=1] \nSteps:  72%|███████▏  | 858/1200 [07:01<02:47,  2.04it/s, loss=0.29, lr=1]\nSteps:  72%|███████▏  | 858/1200 [07:01<02:47,  2.04it/s, loss=0.702, lr=1]\nSteps:  72%|███████▏  | 859/1200 [07:02<02:47,  2.04it/s, loss=0.702, lr=1]\nSteps:  72%|███████▏  | 859/1200 [07:02<02:47,  2.04it/s, loss=0.43, lr=1] \nSteps:  72%|███████▏  | 860/1200 [07:02<02:46,  2.04it/s, loss=0.43, lr=1]\nSteps:  72%|███████▏  | 860/1200 [07:02<02:46,  2.04it/s, loss=0.859, lr=1]\nSteps:  72%|███████▏  | 861/1200 [07:03<02:46,  2.04it/s, loss=0.859, lr=1]\nSteps:  72%|███████▏  | 861/1200 [07:03<02:46,  2.04it/s, loss=0.325, lr=1]\nSteps:  72%|███████▏  | 862/1200 [07:03<02:45,  2.04it/s, loss=0.325, lr=1]\nSteps:  72%|███████▏  | 862/1200 [07:03<02:45,  2.04it/s, loss=0.363, lr=1]\nSteps:  72%|███████▏  | 863/1200 [07:04<02:45,  2.04it/s, loss=0.363, lr=1]\nSteps:  72%|███████▏  | 863/1200 [07:04<02:45,  2.04it/s, loss=0.627, lr=1]\nSteps:  72%|███████▏  | 864/1200 [07:04<02:44,  2.04it/s, loss=0.627, lr=1]\nSteps:  72%|███████▏  | 864/1200 [07:04<02:44,  2.04it/s, loss=0.564, lr=1]\nSteps:  72%|███████▏  | 865/1200 [07:05<02:45,  2.03it/s, loss=0.564, lr=1]\nSteps:  72%|███████▏  | 865/1200 [07:05<02:45,  2.03it/s, loss=0.266, lr=1]\nSteps:  72%|███████▏  | 866/1200 [07:05<02:44,  2.03it/s, loss=0.266, lr=1]\nSteps:  72%|███████▏  | 866/1200 [07:05<02:44,  2.03it/s, loss=0.385, lr=1]\nSteps:  72%|███████▏  | 867/1200 [07:06<02:43,  2.03it/s, loss=0.385, lr=1]\nSteps:  72%|███████▏  | 867/1200 [07:06<02:43,  2.03it/s, loss=0.61, lr=1] \nSteps:  72%|███████▏  | 868/1200 [07:06<02:43,  2.04it/s, loss=0.61, lr=1]\nSteps:  72%|███████▏  | 868/1200 [07:06<02:43,  2.04it/s, loss=0.772, lr=1]\nSteps:  72%|███████▏  | 869/1200 [07:07<02:42,  2.04it/s, loss=0.772, lr=1]\nSteps:  72%|███████▏  | 869/1200 [07:07<02:42,  2.04it/s, loss=0.627, lr=1]\nSteps:  72%|███████▎  | 870/1200 [07:07<02:42,  2.03it/s, loss=0.627, lr=1]\nSteps:  72%|███████▎  | 870/1200 [07:07<02:42,  2.03it/s, loss=0.322, lr=1]\nSteps:  73%|███████▎  | 871/1200 [07:08<02:41,  2.04it/s, loss=0.322, lr=1]\nSteps:  73%|███████▎  | 871/1200 [07:08<02:41,  2.04it/s, loss=0.338, lr=1]\nSteps:  73%|███████▎  | 872/1200 [07:08<02:41,  2.04it/s, loss=0.338, lr=1]\nSteps:  73%|███████▎  | 872/1200 [07:08<02:41,  2.04it/s, loss=0.861, lr=1]\nSteps:  73%|███████▎  | 873/1200 [07:09<02:40,  2.04it/s, loss=0.861, lr=1]\nSteps:  73%|███████▎  | 873/1200 [07:09<02:40,  2.04it/s, loss=0.788, lr=1]\nSteps:  73%|███████▎  | 874/1200 [07:09<02:40,  2.04it/s, loss=0.788, lr=1]\nSteps:  73%|███████▎  | 874/1200 [07:09<02:40,  2.04it/s, loss=0.764, lr=1]\nSteps:  73%|███████▎  | 875/1200 [07:10<02:39,  2.04it/s, loss=0.764, lr=1]\nSteps:  73%|███████▎  | 875/1200 [07:10<02:39,  2.04it/s, loss=0.273, lr=1]\nSteps:  73%|███████▎  | 876/1200 [07:10<02:39,  2.04it/s, loss=0.273, lr=1]\nSteps:  73%|███████▎  | 876/1200 [07:10<02:39,  2.04it/s, loss=0.451, lr=1]\nSteps:  73%|███████▎  | 877/1200 [07:11<02:39,  2.03it/s, loss=0.451, lr=1]\nSteps:  73%|███████▎  | 877/1200 [07:11<02:39,  2.03it/s, loss=0.377, lr=1]\nSteps:  73%|███████▎  | 878/1200 [07:11<02:38,  2.03it/s, loss=0.377, lr=1]\nSteps:  73%|███████▎  | 878/1200 [07:11<02:38,  2.03it/s, loss=0.292, lr=1]\nSteps:  73%|███████▎  | 879/1200 [07:12<02:37,  2.03it/s, loss=0.292, lr=1]\nSteps:  73%|███████▎  | 879/1200 [07:12<02:37,  2.03it/s, loss=0.481, lr=1]\nSteps:  73%|███████▎  | 880/1200 [07:12<02:37,  2.04it/s, loss=0.481, lr=1]\nSteps:  73%|███████▎  | 880/1200 [07:12<02:37,  2.04it/s, loss=0.305, lr=1]\nSteps:  73%|███████▎  | 881/1200 [07:13<02:36,  2.04it/s, loss=0.305, lr=1]\nSteps:  73%|███████▎  | 881/1200 [07:13<02:36,  2.04it/s, loss=0.459, lr=1]\nSteps:  74%|███████▎  | 882/1200 [07:13<02:36,  2.03it/s, loss=0.459, lr=1]\nSteps:  74%|███████▎  | 882/1200 [07:13<02:36,  2.03it/s, loss=0.583, lr=1]\nSteps:  74%|███████▎  | 883/1200 [07:14<02:35,  2.03it/s, loss=0.583, lr=1]\nSteps:  74%|███████▎  | 883/1200 [07:14<02:35,  2.03it/s, loss=0.566, lr=1]\nSteps:  74%|███████▎  | 884/1200 [07:14<02:35,  2.04it/s, loss=0.566, lr=1]\nSteps:  74%|███████▎  | 884/1200 [07:14<02:35,  2.04it/s, loss=0.373, lr=1]\nSteps:  74%|███████▍  | 885/1200 [07:15<02:34,  2.04it/s, loss=0.373, lr=1]\nSteps:  74%|███████▍  | 885/1200 [07:15<02:34,  2.04it/s, loss=0.977, lr=1]\nSteps:  74%|███████▍  | 886/1200 [07:15<02:34,  2.04it/s, loss=0.977, lr=1]\nSteps:  74%|███████▍  | 886/1200 [07:15<02:34,  2.04it/s, loss=0.374, lr=1]\nSteps:  74%|███████▍  | 887/1200 [07:16<02:33,  2.04it/s, loss=0.374, lr=1]\nSteps:  74%|███████▍  | 887/1200 [07:16<02:33,  2.04it/s, loss=0.591, lr=1]\nSteps:  74%|███████▍  | 888/1200 [07:16<02:33,  2.04it/s, loss=0.591, lr=1]\nSteps:  74%|███████▍  | 888/1200 [07:16<02:33,  2.04it/s, loss=0.526, lr=1]\nSteps:  74%|███████▍  | 889/1200 [07:17<02:33,  2.03it/s, loss=0.526, lr=1]\nSteps:  74%|███████▍  | 889/1200 [07:17<02:33,  2.03it/s, loss=0.37, lr=1] \nSteps:  74%|███████▍  | 890/1200 [07:17<02:32,  2.03it/s, loss=0.37, lr=1]\nSteps:  74%|███████▍  | 890/1200 [07:17<02:32,  2.03it/s, loss=0.31, lr=1]\nSteps:  74%|███████▍  | 891/1200 [07:18<02:31,  2.04it/s, loss=0.31, lr=1]\nSteps:  74%|███████▍  | 891/1200 [07:18<02:31,  2.04it/s, loss=0.391, lr=1]\nSteps:  74%|███████▍  | 892/1200 [07:18<02:31,  2.04it/s, loss=0.391, lr=1]\nSteps:  74%|███████▍  | 892/1200 [07:18<02:31,  2.04it/s, loss=0.601, lr=1]\nSteps:  74%|███████▍  | 893/1200 [07:19<02:30,  2.04it/s, loss=0.601, lr=1]\nSteps:  74%|███████▍  | 893/1200 [07:19<02:30,  2.04it/s, loss=0.342, lr=1]\nSteps:  74%|███████▍  | 894/1200 [07:19<02:30,  2.04it/s, loss=0.342, lr=1]\nSteps:  74%|███████▍  | 894/1200 [07:19<02:30,  2.04it/s, loss=0.377, lr=1]\nSteps:  75%|███████▍  | 895/1200 [07:20<02:29,  2.04it/s, loss=0.377, lr=1]\nSteps:  75%|███████▍  | 895/1200 [07:20<02:29,  2.04it/s, loss=0.463, lr=1]\nSteps:  75%|███████▍  | 896/1200 [07:20<02:29,  2.04it/s, loss=0.463, lr=1]\nSteps:  75%|███████▍  | 896/1200 [07:20<02:29,  2.04it/s, loss=0.452, lr=1]\nSteps:  75%|███████▍  | 897/1200 [07:21<02:28,  2.04it/s, loss=0.452, lr=1]\nSteps:  75%|███████▍  | 897/1200 [07:21<02:28,  2.04it/s, loss=0.625, lr=1]\nSteps:  75%|███████▍  | 898/1200 [07:21<02:28,  2.04it/s, loss=0.625, lr=1]\nSteps:  75%|███████▍  | 898/1200 [07:21<02:28,  2.04it/s, loss=0.308, lr=1]\nSteps:  75%|███████▍  | 899/1200 [07:22<02:27,  2.04it/s, loss=0.308, lr=1]\nSteps:  75%|███████▍  | 899/1200 [07:22<02:27,  2.04it/s, loss=0.465, lr=1]\nSteps:  75%|███████▌  | 900/1200 [07:22<02:26,  2.04it/s, loss=0.465, lr=1]\nSteps:  75%|███████▌  | 900/1200 [07:22<02:26,  2.04it/s, loss=0.576, lr=1]\nSteps:  75%|███████▌  | 901/1200 [07:23<02:27,  2.03it/s, loss=0.576, lr=1]\nSteps:  75%|███████▌  | 901/1200 [07:23<02:27,  2.03it/s, loss=0.267, lr=1]\nSteps:  75%|███████▌  | 902/1200 [07:23<02:26,  2.03it/s, loss=0.267, lr=1]\nSteps:  75%|███████▌  | 902/1200 [07:23<02:26,  2.03it/s, loss=0.466, lr=1]\nSteps:  75%|███████▌  | 903/1200 [07:24<02:25,  2.04it/s, loss=0.466, lr=1]\nSteps:  75%|███████▌  | 903/1200 [07:24<02:25,  2.04it/s, loss=0.737, lr=1]\nSteps:  75%|███████▌  | 904/1200 [07:24<02:26,  2.02it/s, loss=0.737, lr=1]\nSteps:  75%|███████▌  | 904/1200 [07:24<02:26,  2.02it/s, loss=0.756, lr=1]\nSteps:  75%|███████▌  | 905/1200 [07:24<02:25,  2.03it/s, loss=0.756, lr=1]\nSteps:  75%|███████▌  | 905/1200 [07:24<02:25,  2.03it/s, loss=0.566, lr=1]\nSteps:  76%|███████▌  | 906/1200 [07:25<02:24,  2.03it/s, loss=0.566, lr=1]\nSteps:  76%|███████▌  | 906/1200 [07:25<02:24,  2.03it/s, loss=0.404, lr=1]\nSteps:  76%|███████▌  | 907/1200 [07:25<02:23,  2.04it/s, loss=0.404, lr=1]\nSteps:  76%|███████▌  | 907/1200 [07:25<02:23,  2.04it/s, loss=0.794, lr=1]\nSteps:  76%|███████▌  | 908/1200 [07:26<02:23,  2.04it/s, loss=0.794, lr=1]\nSteps:  76%|███████▌  | 908/1200 [07:26<02:23,  2.04it/s, loss=0.629, lr=1]\nSteps:  76%|███████▌  | 909/1200 [07:26<02:22,  2.04it/s, loss=0.629, lr=1]\nSteps:  76%|███████▌  | 909/1200 [07:26<02:22,  2.04it/s, loss=0.581, lr=1]\nSteps:  76%|███████▌  | 910/1200 [07:27<02:22,  2.04it/s, loss=0.581, lr=1]\nSteps:  76%|███████▌  | 910/1200 [07:27<02:22,  2.04it/s, loss=0.64, lr=1] \nSteps:  76%|███████▌  | 911/1200 [07:27<02:21,  2.04it/s, loss=0.64, lr=1]\nSteps:  76%|███████▌  | 911/1200 [07:27<02:21,  2.04it/s, loss=0.517, lr=1]\nSteps:  76%|███████▌  | 912/1200 [07:28<02:21,  2.04it/s, loss=0.517, lr=1]\nSteps:  76%|███████▌  | 912/1200 [07:28<02:21,  2.04it/s, loss=0.383, lr=1]\nSteps:  76%|███████▌  | 913/1200 [07:28<02:21,  2.03it/s, loss=0.383, lr=1]\nSteps:  76%|███████▌  | 913/1200 [07:28<02:21,  2.03it/s, loss=0.263, lr=1]\nSteps:  76%|███████▌  | 914/1200 [07:29<02:20,  2.03it/s, loss=0.263, lr=1]\nSteps:  76%|███████▌  | 914/1200 [07:29<02:20,  2.03it/s, loss=0.614, lr=1]\nSteps:  76%|███████▋  | 915/1200 [07:29<02:19,  2.04it/s, loss=0.614, lr=1]\nSteps:  76%|███████▋  | 915/1200 [07:29<02:19,  2.04it/s, loss=0.806, lr=1]\nSteps:  76%|███████▋  | 916/1200 [07:30<02:19,  2.04it/s, loss=0.806, lr=1]\nSteps:  76%|███████▋  | 916/1200 [07:30<02:19,  2.04it/s, loss=1.03, lr=1] \nSteps:  76%|███████▋  | 917/1200 [07:30<02:18,  2.04it/s, loss=1.03, lr=1]\nSteps:  76%|███████▋  | 917/1200 [07:30<02:18,  2.04it/s, loss=0.313, lr=1]\nSteps:  76%|███████▋  | 918/1200 [07:31<02:18,  2.04it/s, loss=0.313, lr=1]\nSteps:  76%|███████▋  | 918/1200 [07:31<02:18,  2.04it/s, loss=0.56, lr=1] \nSteps:  77%|███████▋  | 919/1200 [07:31<02:17,  2.04it/s, loss=0.56, lr=1]\nSteps:  77%|███████▋  | 919/1200 [07:31<02:17,  2.04it/s, loss=0.348, lr=1]\nSteps:  77%|███████▋  | 920/1200 [07:32<02:17,  2.04it/s, loss=0.348, lr=1]\nSteps:  77%|███████▋  | 920/1200 [07:32<02:17,  2.04it/s, loss=0.564, lr=1]\nSteps:  77%|███████▋  | 921/1200 [07:32<02:16,  2.04it/s, loss=0.564, lr=1]\nSteps:  77%|███████▋  | 921/1200 [07:32<02:16,  2.04it/s, loss=0.835, lr=1]\nSteps:  77%|███████▋  | 922/1200 [07:33<02:16,  2.04it/s, loss=0.835, lr=1]\nSteps:  77%|███████▋  | 922/1200 [07:33<02:16,  2.04it/s, loss=0.328, lr=1]\nSteps:  77%|███████▋  | 923/1200 [07:33<02:15,  2.04it/s, loss=0.328, lr=1]\nSteps:  77%|███████▋  | 923/1200 [07:33<02:15,  2.04it/s, loss=0.472, lr=1]\nSteps:  77%|███████▋  | 924/1200 [07:34<02:15,  2.04it/s, loss=0.472, lr=1]\nSteps:  77%|███████▋  | 924/1200 [07:34<02:15,  2.04it/s, loss=0.324, lr=1]\nSteps:  77%|███████▋  | 925/1200 [07:34<02:15,  2.03it/s, loss=0.324, lr=1]\nSteps:  77%|███████▋  | 925/1200 [07:34<02:15,  2.03it/s, loss=0.27, lr=1] \nSteps:  77%|███████▋  | 926/1200 [07:35<02:14,  2.03it/s, loss=0.27, lr=1]\nSteps:  77%|███████▋  | 926/1200 [07:35<02:14,  2.03it/s, loss=0.303, lr=1]\nSteps:  77%|███████▋  | 927/1200 [07:35<02:14,  2.03it/s, loss=0.303, lr=1]\nSteps:  77%|███████▋  | 927/1200 [07:35<02:14,  2.03it/s, loss=0.586, lr=1]\nSteps:  77%|███████▋  | 928/1200 [07:36<02:13,  2.04it/s, loss=0.586, lr=1]\nSteps:  77%|███████▋  | 928/1200 [07:36<02:13,  2.04it/s, loss=0.292, lr=1]\nSteps:  77%|███████▋  | 929/1200 [07:36<02:12,  2.04it/s, loss=0.292, lr=1]\nSteps:  77%|███████▋  | 929/1200 [07:36<02:12,  2.04it/s, loss=0.752, lr=1]\nSteps:  78%|███████▊  | 930/1200 [07:37<02:12,  2.04it/s, loss=0.752, lr=1]\nSteps:  78%|███████▊  | 930/1200 [07:37<02:12,  2.04it/s, loss=0.323, lr=1]\nSteps:  78%|███████▊  | 931/1200 [07:37<02:11,  2.04it/s, loss=0.323, lr=1]\nSteps:  78%|███████▊  | 931/1200 [07:37<02:11,  2.04it/s, loss=0.751, lr=1]\nSteps:  78%|███████▊  | 932/1200 [07:38<02:11,  2.04it/s, loss=0.751, lr=1]\nSteps:  78%|███████▊  | 932/1200 [07:38<02:11,  2.04it/s, loss=0.341, lr=1]\nSteps:  78%|███████▊  | 933/1200 [07:38<02:10,  2.04it/s, loss=0.341, lr=1]\nSteps:  78%|███████▊  | 933/1200 [07:38<02:10,  2.04it/s, loss=0.424, lr=1]\nSteps:  78%|███████▊  | 934/1200 [07:39<02:10,  2.04it/s, loss=0.424, lr=1]\nSteps:  78%|███████▊  | 934/1200 [07:39<02:10,  2.04it/s, loss=0.257, lr=1]\nSteps:  78%|███████▊  | 935/1200 [07:39<02:09,  2.04it/s, loss=0.257, lr=1]\nSteps:  78%|███████▊  | 935/1200 [07:39<02:09,  2.04it/s, loss=0.3, lr=1]  \nSteps:  78%|███████▊  | 936/1200 [07:40<02:09,  2.04it/s, loss=0.3, lr=1]\nSteps:  78%|███████▊  | 936/1200 [07:40<02:09,  2.04it/s, loss=0.639, lr=1]\nSteps:  78%|███████▊  | 937/1200 [07:40<02:09,  2.03it/s, loss=0.639, lr=1]\nSteps:  78%|███████▊  | 937/1200 [07:40<02:09,  2.03it/s, loss=0.566, lr=1]\nSteps:  78%|███████▊  | 938/1200 [07:41<02:08,  2.03it/s, loss=0.566, lr=1]\nSteps:  78%|███████▊  | 938/1200 [07:41<02:08,  2.03it/s, loss=0.377, lr=1]\nSteps:  78%|███████▊  | 939/1200 [07:41<02:08,  2.04it/s, loss=0.377, lr=1]\nSteps:  78%|███████▊  | 939/1200 [07:41<02:08,  2.04it/s, loss=0.689, lr=1]\nSteps:  78%|███████▊  | 940/1200 [07:42<02:07,  2.04it/s, loss=0.689, lr=1]\nSteps:  78%|███████▊  | 940/1200 [07:42<02:07,  2.04it/s, loss=0.87, lr=1] \nSteps:  78%|███████▊  | 941/1200 [07:42<02:07,  2.04it/s, loss=0.87, lr=1]\nSteps:  78%|███████▊  | 941/1200 [07:42<02:07,  2.04it/s, loss=0.862, lr=1]\nSteps:  78%|███████▊  | 942/1200 [07:43<02:06,  2.04it/s, loss=0.862, lr=1]\nSteps:  78%|███████▊  | 942/1200 [07:43<02:06,  2.04it/s, loss=0.915, lr=1]\nSteps:  79%|███████▊  | 943/1200 [07:43<02:06,  2.04it/s, loss=0.915, lr=1]\nSteps:  79%|███████▊  | 943/1200 [07:43<02:06,  2.04it/s, loss=0.485, lr=1]\nSteps:  79%|███████▊  | 944/1200 [07:44<02:05,  2.04it/s, loss=0.485, lr=1]\nSteps:  79%|███████▊  | 944/1200 [07:44<02:05,  2.04it/s, loss=0.586, lr=1]\nSteps:  79%|███████▉  | 945/1200 [07:44<02:05,  2.03it/s, loss=0.586, lr=1]\nSteps:  79%|███████▉  | 945/1200 [07:44<02:05,  2.03it/s, loss=0.413, lr=1]\nSteps:  79%|███████▉  | 946/1200 [07:45<02:05,  2.03it/s, loss=0.413, lr=1]\nSteps:  79%|███████▉  | 946/1200 [07:45<02:05,  2.03it/s, loss=0.266, lr=1]\nSteps:  79%|███████▉  | 947/1200 [07:45<02:04,  2.03it/s, loss=0.266, lr=1]\nSteps:  79%|███████▉  | 947/1200 [07:45<02:04,  2.03it/s, loss=1.02, lr=1] \nSteps:  79%|███████▉  | 948/1200 [07:46<02:03,  2.04it/s, loss=1.02, lr=1]\nSteps:  79%|███████▉  | 948/1200 [07:46<02:03,  2.04it/s, loss=0.338, lr=1]\nSteps:  79%|███████▉  | 949/1200 [07:46<02:03,  2.03it/s, loss=0.338, lr=1]\nSteps:  79%|███████▉  | 949/1200 [07:46<02:03,  2.03it/s, loss=0.601, lr=1]\nSteps:  79%|███████▉  | 950/1200 [07:47<02:03,  2.03it/s, loss=0.601, lr=1]\nSteps:  79%|███████▉  | 950/1200 [07:47<02:03,  2.03it/s, loss=0.353, lr=1]\nSteps:  79%|███████▉  | 951/1200 [07:47<02:02,  2.03it/s, loss=0.353, lr=1]\nSteps:  79%|███████▉  | 951/1200 [07:47<02:02,  2.03it/s, loss=0.402, lr=1]\nSteps:  79%|███████▉  | 952/1200 [07:48<02:01,  2.03it/s, loss=0.402, lr=1]\nSteps:  79%|███████▉  | 952/1200 [07:48<02:01,  2.03it/s, loss=0.257, lr=1]\nSteps:  79%|███████▉  | 953/1200 [07:48<02:01,  2.04it/s, loss=0.257, lr=1]\nSteps:  79%|███████▉  | 953/1200 [07:48<02:01,  2.04it/s, loss=0.578, lr=1]\nSteps:  80%|███████▉  | 954/1200 [07:49<02:00,  2.04it/s, loss=0.578, lr=1]\nSteps:  80%|███████▉  | 954/1200 [07:49<02:00,  2.04it/s, loss=0.763, lr=1]\nSteps:  80%|███████▉  | 955/1200 [07:49<02:00,  2.04it/s, loss=0.763, lr=1]\nSteps:  80%|███████▉  | 955/1200 [07:49<02:00,  2.04it/s, loss=0.83, lr=1] \nSteps:  80%|███████▉  | 956/1200 [07:50<01:59,  2.04it/s, loss=0.83, lr=1]\nSteps:  80%|███████▉  | 956/1200 [07:50<01:59,  2.04it/s, loss=0.423, lr=1]\nSteps:  80%|███████▉  | 957/1200 [07:50<01:59,  2.04it/s, loss=0.423, lr=1]\nSteps:  80%|███████▉  | 957/1200 [07:50<01:59,  2.04it/s, loss=0.584, lr=1]\nSteps:  80%|███████▉  | 958/1200 [07:51<01:58,  2.04it/s, loss=0.584, lr=1]\nSteps:  80%|███████▉  | 958/1200 [07:51<01:58,  2.04it/s, loss=0.608, lr=1]\nSteps:  80%|███████▉  | 959/1200 [07:51<01:58,  2.04it/s, loss=0.608, lr=1]\nSteps:  80%|███████▉  | 959/1200 [07:51<01:58,  2.04it/s, loss=0.439, lr=1]\nSteps:  80%|████████  | 960/1200 [07:51<01:57,  2.04it/s, loss=0.439, lr=1]\nSteps:  80%|████████  | 960/1200 [07:51<01:57,  2.04it/s, loss=0.317, lr=1]\nSteps:  80%|████████  | 961/1200 [07:52<01:57,  2.03it/s, loss=0.317, lr=1]\nSteps:  80%|████████  | 961/1200 [07:52<01:57,  2.03it/s, loss=0.446, lr=1]\nSteps:  80%|████████  | 962/1200 [07:52<01:56,  2.04it/s, loss=0.446, lr=1]\nSteps:  80%|████████  | 962/1200 [07:52<01:56,  2.04it/s, loss=0.377, lr=1]\nSteps:  80%|████████  | 963/1200 [07:53<01:56,  2.04it/s, loss=0.377, lr=1]\nSteps:  80%|████████  | 963/1200 [07:53<01:56,  2.04it/s, loss=0.383, lr=1]\nSteps:  80%|████████  | 964/1200 [07:53<01:55,  2.04it/s, loss=0.383, lr=1]\nSteps:  80%|████████  | 964/1200 [07:53<01:55,  2.04it/s, loss=0.773, lr=1]\nSteps:  80%|████████  | 965/1200 [07:54<01:55,  2.03it/s, loss=0.773, lr=1]\nSteps:  80%|████████  | 965/1200 [07:54<01:55,  2.03it/s, loss=0.32, lr=1] \nSteps:  80%|████████  | 966/1200 [07:54<01:55,  2.03it/s, loss=0.32, lr=1]\nSteps:  80%|████████  | 966/1200 [07:54<01:55,  2.03it/s, loss=0.376, lr=1]\nSteps:  81%|████████  | 967/1200 [07:55<01:54,  2.03it/s, loss=0.376, lr=1]\nSteps:  81%|████████  | 967/1200 [07:55<01:54,  2.03it/s, loss=0.293, lr=1]\nSteps:  81%|████████  | 968/1200 [07:55<01:53,  2.04it/s, loss=0.293, lr=1]\nSteps:  81%|████████  | 968/1200 [07:55<01:53,  2.04it/s, loss=0.299, lr=1]\nSteps:  81%|████████  | 969/1200 [07:56<01:53,  2.04it/s, loss=0.299, lr=1]\nSteps:  81%|████████  | 969/1200 [07:56<01:53,  2.04it/s, loss=0.577, lr=1]\nSteps:  81%|████████  | 970/1200 [07:56<01:52,  2.04it/s, loss=0.577, lr=1]\nSteps:  81%|████████  | 970/1200 [07:56<01:52,  2.04it/s, loss=0.279, lr=1]\nSteps:  81%|████████  | 971/1200 [07:57<01:52,  2.04it/s, loss=0.279, lr=1]\nSteps:  81%|████████  | 971/1200 [07:57<01:52,  2.04it/s, loss=0.283, lr=1]\nSteps:  81%|████████  | 972/1200 [07:57<01:51,  2.04it/s, loss=0.283, lr=1]\nSteps:  81%|████████  | 972/1200 [07:57<01:51,  2.04it/s, loss=0.458, lr=1]\nSteps:  81%|████████  | 973/1200 [07:58<01:51,  2.03it/s, loss=0.458, lr=1]\nSteps:  81%|████████  | 973/1200 [07:58<01:51,  2.03it/s, loss=0.287, lr=1]\nSteps:  81%|████████  | 974/1200 [07:58<01:51,  2.03it/s, loss=0.287, lr=1]\nSteps:  81%|████████  | 974/1200 [07:58<01:51,  2.03it/s, loss=0.356, lr=1]\nSteps:  81%|████████▏ | 975/1200 [07:59<01:50,  2.03it/s, loss=0.356, lr=1]\nSteps:  81%|████████▏ | 975/1200 [07:59<01:50,  2.03it/s, loss=0.321, lr=1]\nSteps:  81%|████████▏ | 976/1200 [07:59<01:49,  2.04it/s, loss=0.321, lr=1]\nSteps:  81%|████████▏ | 976/1200 [07:59<01:49,  2.04it/s, loss=0.836, lr=1]\nSteps:  81%|████████▏ | 977/1200 [08:00<01:49,  2.04it/s, loss=0.836, lr=1]\nSteps:  81%|████████▏ | 977/1200 [08:00<01:49,  2.04it/s, loss=0.579, lr=1]\nSteps:  82%|████████▏ | 978/1200 [08:00<01:48,  2.04it/s, loss=0.579, lr=1]\nSteps:  82%|████████▏ | 978/1200 [08:00<01:48,  2.04it/s, loss=0.332, lr=1]\nSteps:  82%|████████▏ | 979/1200 [08:01<01:48,  2.04it/s, loss=0.332, lr=1]\nSteps:  82%|████████▏ | 979/1200 [08:01<01:48,  2.04it/s, loss=0.323, lr=1]\nSteps:  82%|████████▏ | 980/1200 [08:01<01:47,  2.04it/s, loss=0.323, lr=1]\nSteps:  82%|████████▏ | 980/1200 [08:01<01:47,  2.04it/s, loss=0.425, lr=1]\nSteps:  82%|████████▏ | 981/1200 [08:02<01:47,  2.04it/s, loss=0.425, lr=1]\nSteps:  82%|████████▏ | 981/1200 [08:02<01:47,  2.04it/s, loss=0.386, lr=1]\nSteps:  82%|████████▏ | 982/1200 [08:02<01:46,  2.04it/s, loss=0.386, lr=1]\nSteps:  82%|████████▏ | 982/1200 [08:02<01:46,  2.04it/s, loss=0.599, lr=1]\nSteps:  82%|████████▏ | 983/1200 [08:03<01:46,  2.04it/s, loss=0.599, lr=1]\nSteps:  82%|████████▏ | 983/1200 [08:03<01:46,  2.04it/s, loss=0.606, lr=1]\nSteps:  82%|████████▏ | 984/1200 [08:03<01:45,  2.04it/s, loss=0.606, lr=1]\nSteps:  82%|████████▏ | 984/1200 [08:03<01:45,  2.04it/s, loss=0.631, lr=1]\nSteps:  82%|████████▏ | 985/1200 [08:04<01:59,  1.80it/s, loss=0.631, lr=1]\nSteps:  82%|████████▏ | 985/1200 [08:04<01:59,  1.80it/s, loss=0.332, lr=1]\nSteps:  82%|████████▏ | 986/1200 [08:04<01:54,  1.87it/s, loss=0.332, lr=1]\nSteps:  82%|████████▏ | 986/1200 [08:04<01:54,  1.87it/s, loss=0.285, lr=1]\nSteps:  82%|████████▏ | 987/1200 [08:05<01:51,  1.92it/s, loss=0.285, lr=1]\nSteps:  82%|████████▏ | 987/1200 [08:05<01:51,  1.92it/s, loss=0.693, lr=1]\nSteps:  82%|████████▏ | 988/1200 [08:05<01:48,  1.95it/s, loss=0.693, lr=1]\nSteps:  82%|████████▏ | 988/1200 [08:05<01:48,  1.95it/s, loss=0.782, lr=1]\nSteps:  82%|████████▏ | 989/1200 [08:06<01:46,  1.98it/s, loss=0.782, lr=1]\nSteps:  82%|████████▏ | 989/1200 [08:06<01:46,  1.98it/s, loss=0.382, lr=1]\nSteps:  82%|████████▎ | 990/1200 [08:06<01:45,  2.00it/s, loss=0.382, lr=1]\nSteps:  82%|████████▎ | 990/1200 [08:06<01:45,  2.00it/s, loss=0.315, lr=1]\nSteps:  83%|████████▎ | 991/1200 [08:07<01:44,  2.01it/s, loss=0.315, lr=1]\nSteps:  83%|████████▎ | 991/1200 [08:07<01:44,  2.01it/s, loss=0.622, lr=1]\nSteps:  83%|████████▎ | 992/1200 [08:07<01:43,  2.02it/s, loss=0.622, lr=1]\nSteps:  83%|████████▎ | 992/1200 [08:07<01:43,  2.02it/s, loss=0.555, lr=1]\nSteps:  83%|████████▎ | 993/1200 [08:08<01:42,  2.03it/s, loss=0.555, lr=1]\nSteps:  83%|████████▎ | 993/1200 [08:08<01:42,  2.03it/s, loss=0.424, lr=1]\nSteps:  83%|████████▎ | 994/1200 [08:08<01:41,  2.03it/s, loss=0.424, lr=1]\nSteps:  83%|████████▎ | 994/1200 [08:08<01:41,  2.03it/s, loss=0.53, lr=1] \nSteps:  83%|████████▎ | 995/1200 [08:09<01:40,  2.03it/s, loss=0.53, lr=1]\nSteps:  83%|████████▎ | 995/1200 [08:09<01:40,  2.03it/s, loss=0.308, lr=1]\nSteps:  83%|████████▎ | 996/1200 [08:09<01:40,  2.03it/s, loss=0.308, lr=1]\nSteps:  83%|████████▎ | 996/1200 [08:09<01:40,  2.03it/s, loss=0.596, lr=1]\nSteps:  83%|████████▎ | 997/1200 [08:10<01:40,  2.03it/s, loss=0.596, lr=1]\nSteps:  83%|████████▎ | 997/1200 [08:10<01:40,  2.03it/s, loss=0.709, lr=1]\nSteps:  83%|████████▎ | 998/1200 [08:10<01:39,  2.03it/s, loss=0.709, lr=1]\nSteps:  83%|████████▎ | 998/1200 [08:10<01:39,  2.03it/s, loss=0.631, lr=1]\nSteps:  83%|████████▎ | 999/1200 [08:11<01:38,  2.03it/s, loss=0.631, lr=1]\nSteps:  83%|████████▎ | 999/1200 [08:11<01:38,  2.03it/s, loss=0.565, lr=1]\nSteps:  83%|████████▎ | 1000/1200 [08:11<01:38,  2.03it/s, loss=0.565, lr=1]\nSteps:  83%|████████▎ | 1000/1200 [08:11<01:38,  2.03it/s, loss=0.647, lr=1]\nSteps:  83%|████████▎ | 1001/1200 [08:12<01:37,  2.03it/s, loss=0.647, lr=1]\nSteps:  83%|████████▎ | 1001/1200 [08:12<01:37,  2.03it/s, loss=0.349, lr=1]\nSteps:  84%|████████▎ | 1002/1200 [08:12<01:37,  2.04it/s, loss=0.349, lr=1]\nSteps:  84%|████████▎ | 1002/1200 [08:12<01:37,  2.04it/s, loss=0.4, lr=1]  \nSteps:  84%|████████▎ | 1003/1200 [08:13<01:36,  2.04it/s, loss=0.4, lr=1]\nSteps:  84%|████████▎ | 1003/1200 [08:13<01:36,  2.04it/s, loss=0.538, lr=1]\nSteps:  84%|████████▎ | 1004/1200 [08:13<01:36,  2.04it/s, loss=0.538, lr=1]\nSteps:  84%|████████▎ | 1004/1200 [08:13<01:36,  2.04it/s, loss=0.476, lr=1]\nSteps:  84%|████████▍ | 1005/1200 [08:14<01:35,  2.04it/s, loss=0.476, lr=1]\nSteps:  84%|████████▍ | 1005/1200 [08:14<01:35,  2.04it/s, loss=0.324, lr=1]\nSteps:  84%|████████▍ | 1006/1200 [08:14<01:35,  2.04it/s, loss=0.324, lr=1]\nSteps:  84%|████████▍ | 1006/1200 [08:14<01:35,  2.04it/s, loss=0.636, lr=1]\nSteps:  84%|████████▍ | 1007/1200 [08:15<01:34,  2.04it/s, loss=0.636, lr=1]\nSteps:  84%|████████▍ | 1007/1200 [08:15<01:34,  2.04it/s, loss=0.625, lr=1]\nSteps:  84%|████████▍ | 1008/1200 [08:15<01:34,  2.04it/s, loss=0.625, lr=1]\nSteps:  84%|████████▍ | 1008/1200 [08:15<01:34,  2.04it/s, loss=0.536, lr=1]\nSteps:  84%|████████▍ | 1009/1200 [08:16<01:34,  2.03it/s, loss=0.536, lr=1]\nSteps:  84%|████████▍ | 1009/1200 [08:16<01:34,  2.03it/s, loss=0.467, lr=1]\nSteps:  84%|████████▍ | 1010/1200 [08:16<01:33,  2.03it/s, loss=0.467, lr=1]\nSteps:  84%|████████▍ | 1010/1200 [08:16<01:33,  2.03it/s, loss=0.385, lr=1]\nSteps:  84%|████████▍ | 1011/1200 [08:17<01:32,  2.04it/s, loss=0.385, lr=1]\nSteps:  84%|████████▍ | 1011/1200 [08:17<01:32,  2.04it/s, loss=0.503, lr=1]\nSteps:  84%|████████▍ | 1012/1200 [08:17<01:32,  2.04it/s, loss=0.503, lr=1]\nSteps:  84%|████████▍ | 1012/1200 [08:17<01:32,  2.04it/s, loss=0.623, lr=1]\nSteps:  84%|████████▍ | 1013/1200 [08:18<01:31,  2.03it/s, loss=0.623, lr=1]\nSteps:  84%|████████▍ | 1013/1200 [08:18<01:31,  2.03it/s, loss=0.305, lr=1]\nSteps:  84%|████████▍ | 1014/1200 [08:18<01:31,  2.03it/s, loss=0.305, lr=1]\nSteps:  84%|████████▍ | 1014/1200 [08:18<01:31,  2.03it/s, loss=0.329, lr=1]\nSteps:  85%|████████▍ | 1015/1200 [08:19<01:30,  2.04it/s, loss=0.329, lr=1]\nSteps:  85%|████████▍ | 1015/1200 [08:19<01:30,  2.04it/s, loss=0.583, lr=1]\nSteps:  85%|████████▍ | 1016/1200 [08:19<01:30,  2.04it/s, loss=0.583, lr=1]\nSteps:  85%|████████▍ | 1016/1200 [08:19<01:30,  2.04it/s, loss=0.502, lr=1]\nSteps:  85%|████████▍ | 1017/1200 [08:20<01:29,  2.04it/s, loss=0.502, lr=1]\nSteps:  85%|████████▍ | 1017/1200 [08:20<01:29,  2.04it/s, loss=0.347, lr=1]\nSteps:  85%|████████▍ | 1018/1200 [08:20<01:29,  2.02it/s, loss=0.347, lr=1]\nSteps:  85%|████████▍ | 1018/1200 [08:20<01:29,  2.02it/s, loss=0.33, lr=1] \nSteps:  85%|████████▍ | 1019/1200 [08:21<01:29,  2.03it/s, loss=0.33, lr=1]\nSteps:  85%|████████▍ | 1019/1200 [08:21<01:29,  2.03it/s, loss=0.338, lr=1]\nSteps:  85%|████████▌ | 1020/1200 [08:21<01:28,  2.03it/s, loss=0.338, lr=1]\nSteps:  85%|████████▌ | 1020/1200 [08:21<01:28,  2.03it/s, loss=0.311, lr=1]\nSteps:  85%|████████▌ | 1021/1200 [08:22<01:28,  2.03it/s, loss=0.311, lr=1]\nSteps:  85%|████████▌ | 1021/1200 [08:22<01:28,  2.03it/s, loss=0.748, lr=1]\nSteps:  85%|████████▌ | 1022/1200 [08:22<01:27,  2.03it/s, loss=0.748, lr=1]\nSteps:  85%|████████▌ | 1022/1200 [08:22<01:27,  2.03it/s, loss=0.605, lr=1]\nSteps:  85%|████████▌ | 1023/1200 [08:23<01:27,  2.03it/s, loss=0.605, lr=1]\nSteps:  85%|████████▌ | 1023/1200 [08:23<01:27,  2.03it/s, loss=0.545, lr=1]\nSteps:  85%|████████▌ | 1024/1200 [08:23<01:26,  2.03it/s, loss=0.545, lr=1]\nSteps:  85%|████████▌ | 1024/1200 [08:23<01:26,  2.03it/s, loss=0.876, lr=1]\nSteps:  85%|████████▌ | 1025/1200 [08:24<01:25,  2.04it/s, loss=0.876, lr=1]\nSteps:  85%|████████▌ | 1025/1200 [08:24<01:25,  2.04it/s, loss=0.354, lr=1]\nSteps:  86%|████████▌ | 1026/1200 [08:24<01:25,  2.04it/s, loss=0.354, lr=1]\nSteps:  86%|████████▌ | 1026/1200 [08:24<01:25,  2.04it/s, loss=0.291, lr=1]\nSteps:  86%|████████▌ | 1027/1200 [08:25<01:24,  2.04it/s, loss=0.291, lr=1]\nSteps:  86%|████████▌ | 1027/1200 [08:25<01:24,  2.04it/s, loss=0.298, lr=1]\nSteps:  86%|████████▌ | 1028/1200 [08:25<01:24,  2.04it/s, loss=0.298, lr=1]\nSteps:  86%|████████▌ | 1028/1200 [08:25<01:24,  2.04it/s, loss=0.394, lr=1]\nSteps:  86%|████████▌ | 1029/1200 [08:26<01:23,  2.04it/s, loss=0.394, lr=1]\nSteps:  86%|████████▌ | 1029/1200 [08:26<01:23,  2.04it/s, loss=0.312, lr=1]\nSteps:  86%|████████▌ | 1030/1200 [08:26<01:23,  2.04it/s, loss=0.312, lr=1]\nSteps:  86%|████████▌ | 1030/1200 [08:26<01:23,  2.04it/s, loss=0.585, lr=1]\nSteps:  86%|████████▌ | 1031/1200 [08:27<01:22,  2.04it/s, loss=0.585, lr=1]\nSteps:  86%|████████▌ | 1031/1200 [08:27<01:22,  2.04it/s, loss=1.01, lr=1] \nSteps:  86%|████████▌ | 1032/1200 [08:27<01:22,  2.04it/s, loss=1.01, lr=1]\nSteps:  86%|████████▌ | 1032/1200 [08:27<01:22,  2.04it/s, loss=0.888, lr=1]\nSteps:  86%|████████▌ | 1033/1200 [08:28<01:22,  2.03it/s, loss=0.888, lr=1]\nSteps:  86%|████████▌ | 1033/1200 [08:28<01:22,  2.03it/s, loss=0.774, lr=1]\nSteps:  86%|████████▌ | 1034/1200 [08:28<01:21,  2.03it/s, loss=0.774, lr=1]\nSteps:  86%|████████▌ | 1034/1200 [08:28<01:21,  2.03it/s, loss=1.04, lr=1] \nSteps:  86%|████████▋ | 1035/1200 [08:29<01:20,  2.04it/s, loss=1.04, lr=1]\nSteps:  86%|████████▋ | 1035/1200 [08:29<01:20,  2.04it/s, loss=0.293, lr=1]\nSteps:  86%|████████▋ | 1036/1200 [08:29<01:20,  2.04it/s, loss=0.293, lr=1]\nSteps:  86%|████████▋ | 1036/1200 [08:29<01:20,  2.04it/s, loss=0.62, lr=1] \nSteps:  86%|████████▋ | 1037/1200 [08:30<01:19,  2.04it/s, loss=0.62, lr=1]\nSteps:  86%|████████▋ | 1037/1200 [08:30<01:19,  2.04it/s, loss=0.375, lr=1]\nSteps:  86%|████████▋ | 1038/1200 [08:30<01:19,  2.04it/s, loss=0.375, lr=1]\nSteps:  86%|████████▋ | 1038/1200 [08:30<01:19,  2.04it/s, loss=0.514, lr=1]\nSteps:  87%|████████▋ | 1039/1200 [08:31<01:18,  2.04it/s, loss=0.514, lr=1]\nSteps:  87%|████████▋ | 1039/1200 [08:31<01:18,  2.04it/s, loss=0.292, lr=1]\nSteps:  87%|████████▋ | 1040/1200 [08:31<01:18,  2.04it/s, loss=0.292, lr=1]\nSteps:  87%|████████▋ | 1040/1200 [08:31<01:18,  2.04it/s, loss=0.563, lr=1]\nSteps:  87%|████████▋ | 1041/1200 [08:31<01:18,  2.04it/s, loss=0.563, lr=1]\nSteps:  87%|████████▋ | 1041/1200 [08:31<01:18,  2.04it/s, loss=0.649, lr=1]\nSteps:  87%|████████▋ | 1042/1200 [08:32<01:17,  2.04it/s, loss=0.649, lr=1]\nSteps:  87%|████████▋ | 1042/1200 [08:32<01:17,  2.04it/s, loss=0.536, lr=1]\nSteps:  87%|████████▋ | 1043/1200 [08:32<01:17,  2.04it/s, loss=0.536, lr=1]\nSteps:  87%|████████▋ | 1043/1200 [08:32<01:17,  2.04it/s, loss=0.349, lr=1]\nSteps:  87%|████████▋ | 1044/1200 [08:33<01:16,  2.04it/s, loss=0.349, lr=1]\nSteps:  87%|████████▋ | 1044/1200 [08:33<01:16,  2.04it/s, loss=0.572, lr=1]\nSteps:  87%|████████▋ | 1045/1200 [08:33<01:16,  2.03it/s, loss=0.572, lr=1]\nSteps:  87%|████████▋ | 1045/1200 [08:33<01:16,  2.03it/s, loss=0.646, lr=1]\nSteps:  87%|████████▋ | 1046/1200 [08:34<01:15,  2.03it/s, loss=0.646, lr=1]\nSteps:  87%|████████▋ | 1046/1200 [08:34<01:15,  2.03it/s, loss=0.291, lr=1]\nSteps:  87%|████████▋ | 1047/1200 [08:34<01:15,  2.03it/s, loss=0.291, lr=1]\nSteps:  87%|████████▋ | 1047/1200 [08:34<01:15,  2.03it/s, loss=0.279, lr=1]\nSteps:  87%|████████▋ | 1048/1200 [08:35<01:14,  2.03it/s, loss=0.279, lr=1]\nSteps:  87%|████████▋ | 1048/1200 [08:35<01:14,  2.03it/s, loss=0.459, lr=1]\nSteps:  87%|████████▋ | 1049/1200 [08:35<01:14,  2.03it/s, loss=0.459, lr=1]\nSteps:  87%|████████▋ | 1049/1200 [08:35<01:14,  2.03it/s, loss=0.371, lr=1]\nSteps:  88%|████████▊ | 1050/1200 [08:36<01:13,  2.03it/s, loss=0.371, lr=1]\nSteps:  88%|████████▊ | 1050/1200 [08:36<01:13,  2.03it/s, loss=0.577, lr=1]\nSteps:  88%|████████▊ | 1051/1200 [08:36<01:13,  2.03it/s, loss=0.577, lr=1]\nSteps:  88%|████████▊ | 1051/1200 [08:36<01:13,  2.03it/s, loss=0.296, lr=1]\nSteps:  88%|████████▊ | 1052/1200 [08:37<01:12,  2.04it/s, loss=0.296, lr=1]\nSteps:  88%|████████▊ | 1052/1200 [08:37<01:12,  2.04it/s, loss=0.776, lr=1]\nSteps:  88%|████████▊ | 1053/1200 [08:37<01:12,  2.04it/s, loss=0.776, lr=1]\nSteps:  88%|████████▊ | 1053/1200 [08:37<01:12,  2.04it/s, loss=0.554, lr=1]\nSteps:  88%|████████▊ | 1054/1200 [08:38<01:11,  2.03it/s, loss=0.554, lr=1]\nSteps:  88%|████████▊ | 1054/1200 [08:38<01:11,  2.03it/s, loss=0.657, lr=1]\nSteps:  88%|████████▊ | 1055/1200 [08:38<01:11,  2.03it/s, loss=0.657, lr=1]\nSteps:  88%|████████▊ | 1055/1200 [08:38<01:11,  2.03it/s, loss=0.355, lr=1]\nSteps:  88%|████████▊ | 1056/1200 [08:39<01:10,  2.03it/s, loss=0.355, lr=1]\nSteps:  88%|████████▊ | 1056/1200 [08:39<01:10,  2.03it/s, loss=0.53, lr=1] \nSteps:  88%|████████▊ | 1057/1200 [08:39<01:10,  2.03it/s, loss=0.53, lr=1]\nSteps:  88%|████████▊ | 1057/1200 [08:39<01:10,  2.03it/s, loss=0.543, lr=1]\nSteps:  88%|████████▊ | 1058/1200 [08:40<01:09,  2.03it/s, loss=0.543, lr=1]\nSteps:  88%|████████▊ | 1058/1200 [08:40<01:09,  2.03it/s, loss=0.468, lr=1]\nSteps:  88%|████████▊ | 1059/1200 [08:40<01:09,  2.03it/s, loss=0.468, lr=1]\nSteps:  88%|████████▊ | 1059/1200 [08:40<01:09,  2.03it/s, loss=0.405, lr=1]\nSteps:  88%|████████▊ | 1060/1200 [08:41<01:08,  2.03it/s, loss=0.405, lr=1]\nSteps:  88%|████████▊ | 1060/1200 [08:41<01:08,  2.03it/s, loss=0.379, lr=1]\nSteps:  88%|████████▊ | 1061/1200 [08:41<01:08,  2.04it/s, loss=0.379, lr=1]\nSteps:  88%|████████▊ | 1061/1200 [08:41<01:08,  2.04it/s, loss=0.464, lr=1]\nSteps:  88%|████████▊ | 1062/1200 [08:42<01:07,  2.04it/s, loss=0.464, lr=1]\nSteps:  88%|████████▊ | 1062/1200 [08:42<01:07,  2.04it/s, loss=0.444, lr=1]\nSteps:  89%|████████▊ | 1063/1200 [08:42<01:07,  2.04it/s, loss=0.444, lr=1]\nSteps:  89%|████████▊ | 1063/1200 [08:42<01:07,  2.04it/s, loss=0.665, lr=1]\nSteps:  89%|████████▊ | 1064/1200 [08:43<01:06,  2.04it/s, loss=0.665, lr=1]\nSteps:  89%|████████▊ | 1064/1200 [08:43<01:06,  2.04it/s, loss=0.349, lr=1]\nSteps:  89%|████████▉ | 1065/1200 [08:43<01:06,  2.04it/s, loss=0.349, lr=1]\nSteps:  89%|████████▉ | 1065/1200 [08:43<01:06,  2.04it/s, loss=0.279, lr=1]\nSteps:  89%|████████▉ | 1066/1200 [08:44<01:05,  2.04it/s, loss=0.279, lr=1]\nSteps:  89%|████████▉ | 1066/1200 [08:44<01:05,  2.04it/s, loss=0.572, lr=1]\nSteps:  89%|████████▉ | 1067/1200 [08:44<01:05,  2.04it/s, loss=0.572, lr=1]\nSteps:  89%|████████▉ | 1067/1200 [08:44<01:05,  2.04it/s, loss=0.423, lr=1]\nSteps:  89%|████████▉ | 1068/1200 [08:45<01:04,  2.04it/s, loss=0.423, lr=1]\nSteps:  89%|████████▉ | 1068/1200 [08:45<01:04,  2.04it/s, loss=0.486, lr=1]\nSteps:  89%|████████▉ | 1069/1200 [08:45<01:04,  2.03it/s, loss=0.486, lr=1]\nSteps:  89%|████████▉ | 1069/1200 [08:45<01:04,  2.03it/s, loss=0.287, lr=1]\nSteps:  89%|████████▉ | 1070/1200 [08:46<01:03,  2.03it/s, loss=0.287, lr=1]\nSteps:  89%|████████▉ | 1070/1200 [08:46<01:03,  2.03it/s, loss=0.27, lr=1] \nSteps:  89%|████████▉ | 1071/1200 [08:46<01:03,  2.04it/s, loss=0.27, lr=1]\nSteps:  89%|████████▉ | 1071/1200 [08:46<01:03,  2.04it/s, loss=0.365, lr=1]\nSteps:  89%|████████▉ | 1072/1200 [08:47<01:02,  2.04it/s, loss=0.365, lr=1]\nSteps:  89%|████████▉ | 1072/1200 [08:47<01:02,  2.04it/s, loss=0.588, lr=1]\nSteps:  89%|████████▉ | 1073/1200 [08:47<01:02,  2.04it/s, loss=0.588, lr=1]\nSteps:  89%|████████▉ | 1073/1200 [08:47<01:02,  2.04it/s, loss=0.35, lr=1] \nSteps:  90%|████████▉ | 1074/1200 [08:48<01:01,  2.04it/s, loss=0.35, lr=1]\nSteps:  90%|████████▉ | 1074/1200 [08:48<01:01,  2.04it/s, loss=0.29, lr=1]\nSteps:  90%|████████▉ | 1075/1200 [08:48<01:01,  2.04it/s, loss=0.29, lr=1]\nSteps:  90%|████████▉ | 1075/1200 [08:48<01:01,  2.04it/s, loss=0.351, lr=1]\nSteps:  90%|████████▉ | 1076/1200 [08:49<01:00,  2.04it/s, loss=0.351, lr=1]\nSteps:  90%|████████▉ | 1076/1200 [08:49<01:00,  2.04it/s, loss=0.36, lr=1] \nSteps:  90%|████████▉ | 1077/1200 [08:49<01:00,  2.04it/s, loss=0.36, lr=1]\nSteps:  90%|████████▉ | 1077/1200 [08:49<01:00,  2.04it/s, loss=0.623, lr=1]\nSteps:  90%|████████▉ | 1078/1200 [08:50<00:59,  2.04it/s, loss=0.623, lr=1]\nSteps:  90%|████████▉ | 1078/1200 [08:50<00:59,  2.04it/s, loss=0.753, lr=1]\nSteps:  90%|████████▉ | 1079/1200 [08:50<00:59,  2.04it/s, loss=0.753, lr=1]\nSteps:  90%|████████▉ | 1079/1200 [08:50<00:59,  2.04it/s, loss=0.287, lr=1]\nSteps:  90%|█████████ | 1080/1200 [08:51<00:58,  2.04it/s, loss=0.287, lr=1]\nSteps:  90%|█████████ | 1080/1200 [08:51<00:58,  2.04it/s, loss=0.265, lr=1]\nSteps:  90%|█████████ | 1081/1200 [08:51<00:58,  2.03it/s, loss=0.265, lr=1]\nSteps:  90%|█████████ | 1081/1200 [08:51<00:58,  2.03it/s, loss=0.404, lr=1]\nSteps:  90%|█████████ | 1082/1200 [08:52<00:58,  2.03it/s, loss=0.404, lr=1]\nSteps:  90%|█████████ | 1082/1200 [08:52<00:58,  2.03it/s, loss=0.71, lr=1] \nSteps:  90%|█████████ | 1083/1200 [08:52<00:57,  2.04it/s, loss=0.71, lr=1]\nSteps:  90%|█████████ | 1083/1200 [08:52<00:57,  2.04it/s, loss=0.337, lr=1]\nSteps:  90%|█████████ | 1084/1200 [08:53<00:56,  2.04it/s, loss=0.337, lr=1]\nSteps:  90%|█████████ | 1084/1200 [08:53<00:56,  2.04it/s, loss=0.368, lr=1]\nSteps:  90%|█████████ | 1085/1200 [08:53<00:56,  2.04it/s, loss=0.368, lr=1]\nSteps:  90%|█████████ | 1085/1200 [08:53<00:56,  2.04it/s, loss=0.627, lr=1]\nSteps:  90%|█████████ | 1086/1200 [08:54<00:55,  2.04it/s, loss=0.627, lr=1]\nSteps:  90%|█████████ | 1086/1200 [08:54<00:55,  2.04it/s, loss=0.837, lr=1]\nSteps:  91%|█████████ | 1087/1200 [08:54<00:55,  2.04it/s, loss=0.837, lr=1]\nSteps:  91%|█████████ | 1087/1200 [08:54<00:55,  2.04it/s, loss=0.628, lr=1]\nSteps:  91%|█████████ | 1088/1200 [08:55<00:54,  2.04it/s, loss=0.628, lr=1]\nSteps:  91%|█████████ | 1088/1200 [08:55<00:54,  2.04it/s, loss=0.364, lr=1]\nSteps:  91%|█████████ | 1089/1200 [08:55<00:54,  2.04it/s, loss=0.364, lr=1]\nSteps:  91%|█████████ | 1089/1200 [08:55<00:54,  2.04it/s, loss=0.565, lr=1]\nSteps:  91%|█████████ | 1090/1200 [08:56<00:53,  2.04it/s, loss=0.565, lr=1]\nSteps:  91%|█████████ | 1090/1200 [08:56<00:53,  2.04it/s, loss=0.315, lr=1]\nSteps:  91%|█████████ | 1091/1200 [08:56<00:53,  2.04it/s, loss=0.315, lr=1]\nSteps:  91%|█████████ | 1091/1200 [08:56<00:53,  2.04it/s, loss=0.527, lr=1]\nSteps:  91%|█████████ | 1092/1200 [08:57<00:52,  2.04it/s, loss=0.527, lr=1]\nSteps:  91%|█████████ | 1092/1200 [08:57<00:52,  2.04it/s, loss=0.662, lr=1]\nSteps:  91%|█████████ | 1093/1200 [08:57<00:52,  2.03it/s, loss=0.662, lr=1]\nSteps:  91%|█████████ | 1093/1200 [08:57<00:52,  2.03it/s, loss=0.784, lr=1]\nSteps:  91%|█████████ | 1094/1200 [08:58<00:52,  2.04it/s, loss=0.784, lr=1]\nSteps:  91%|█████████ | 1094/1200 [08:58<00:52,  2.04it/s, loss=0.546, lr=1]\nSteps:  91%|█████████▏| 1095/1200 [08:58<00:51,  2.04it/s, loss=0.546, lr=1]\nSteps:  91%|█████████▏| 1095/1200 [08:58<00:51,  2.04it/s, loss=0.423, lr=1]\nSteps:  91%|█████████▏| 1096/1200 [08:58<00:50,  2.04it/s, loss=0.423, lr=1]\nSteps:  91%|█████████▏| 1096/1200 [08:58<00:50,  2.04it/s, loss=0.497, lr=1]\nSteps:  91%|█████████▏| 1097/1200 [08:59<00:50,  2.04it/s, loss=0.497, lr=1]\nSteps:  91%|█████████▏| 1097/1200 [08:59<00:50,  2.04it/s, loss=1, lr=1]    \nSteps:  92%|█████████▏| 1098/1200 [08:59<00:49,  2.04it/s, loss=1, lr=1]\nSteps:  92%|█████████▏| 1098/1200 [08:59<00:49,  2.04it/s, loss=0.791, lr=1]\nSteps:  92%|█████████▏| 1099/1200 [09:00<00:49,  2.04it/s, loss=0.791, lr=1]\nSteps:  92%|█████████▏| 1099/1200 [09:00<00:49,  2.04it/s, loss=0.572, lr=1]\nSteps:  92%|█████████▏| 1100/1200 [09:00<00:48,  2.04it/s, loss=0.572, lr=1]\nSteps:  92%|█████████▏| 1100/1200 [09:00<00:48,  2.04it/s, loss=0.541, lr=1]\nSteps:  92%|█████████▏| 1101/1200 [09:01<00:48,  2.04it/s, loss=0.541, lr=1]\nSteps:  92%|█████████▏| 1101/1200 [09:01<00:48,  2.04it/s, loss=0.51, lr=1] \nSteps:  92%|█████████▏| 1102/1200 [09:01<00:48,  2.04it/s, loss=0.51, lr=1]\nSteps:  92%|█████████▏| 1102/1200 [09:01<00:48,  2.04it/s, loss=0.279, lr=1]\nSteps:  92%|█████████▏| 1103/1200 [09:02<00:47,  2.04it/s, loss=0.279, lr=1]\nSteps:  92%|█████████▏| 1103/1200 [09:02<00:47,  2.04it/s, loss=0.277, lr=1]\nSteps:  92%|█████████▏| 1104/1200 [09:02<00:47,  2.04it/s, loss=0.277, lr=1]\nSteps:  92%|█████████▏| 1104/1200 [09:02<00:47,  2.04it/s, loss=0.87, lr=1] \nSteps:  92%|█████████▏| 1105/1200 [09:03<00:46,  2.03it/s, loss=0.87, lr=1]\nSteps:  92%|█████████▏| 1105/1200 [09:03<00:46,  2.03it/s, loss=0.589, lr=1]\nSteps:  92%|█████████▏| 1106/1200 [09:03<00:46,  2.04it/s, loss=0.589, lr=1]\nSteps:  92%|█████████▏| 1106/1200 [09:03<00:46,  2.04it/s, loss=0.486, lr=1]\nSteps:  92%|█████████▏| 1107/1200 [09:04<00:45,  2.04it/s, loss=0.486, lr=1]\nSteps:  92%|█████████▏| 1107/1200 [09:04<00:45,  2.04it/s, loss=0.625, lr=1]\nSteps:  92%|█████████▏| 1108/1200 [09:04<00:45,  2.04it/s, loss=0.625, lr=1]\nSteps:  92%|█████████▏| 1108/1200 [09:04<00:45,  2.04it/s, loss=0.675, lr=1]\nSteps:  92%|█████████▏| 1109/1200 [09:05<00:44,  2.04it/s, loss=0.675, lr=1]\nSteps:  92%|█████████▏| 1109/1200 [09:05<00:44,  2.04it/s, loss=0.54, lr=1] \nSteps:  92%|█████████▎| 1110/1200 [09:05<00:44,  2.04it/s, loss=0.54, lr=1]\nSteps:  92%|█████████▎| 1110/1200 [09:05<00:44,  2.04it/s, loss=0.481, lr=1]\nSteps:  93%|█████████▎| 1111/1200 [09:06<00:43,  2.04it/s, loss=0.481, lr=1]\nSteps:  93%|█████████▎| 1111/1200 [09:06<00:43,  2.04it/s, loss=0.432, lr=1]\nSteps:  93%|█████████▎| 1112/1200 [09:06<00:43,  2.04it/s, loss=0.432, lr=1]\nSteps:  93%|█████████▎| 1112/1200 [09:06<00:43,  2.04it/s, loss=0.484, lr=1]\nSteps:  93%|█████████▎| 1113/1200 [09:07<00:42,  2.04it/s, loss=0.484, lr=1]\nSteps:  93%|█████████▎| 1113/1200 [09:07<00:42,  2.04it/s, loss=0.273, lr=1]\nSteps:  93%|█████████▎| 1114/1200 [09:07<00:42,  2.04it/s, loss=0.273, lr=1]\nSteps:  93%|█████████▎| 1114/1200 [09:07<00:42,  2.04it/s, loss=0.526, lr=1]\nSteps:  93%|█████████▎| 1115/1200 [09:08<00:41,  2.04it/s, loss=0.526, lr=1]\nSteps:  93%|█████████▎| 1115/1200 [09:08<00:41,  2.04it/s, loss=0.543, lr=1]\nSteps:  93%|█████████▎| 1116/1200 [09:08<00:41,  2.04it/s, loss=0.543, lr=1]\nSteps:  93%|█████████▎| 1116/1200 [09:08<00:41,  2.04it/s, loss=0.37, lr=1] \nSteps:  93%|█████████▎| 1117/1200 [09:09<00:40,  2.03it/s, loss=0.37, lr=1]\nSteps:  93%|█████████▎| 1117/1200 [09:09<00:40,  2.03it/s, loss=0.4, lr=1] \nSteps:  93%|█████████▎| 1118/1200 [09:09<00:40,  2.04it/s, loss=0.4, lr=1]\nSteps:  93%|█████████▎| 1118/1200 [09:09<00:40,  2.04it/s, loss=0.641, lr=1]\nSteps:  93%|█████████▎| 1119/1200 [09:10<00:39,  2.04it/s, loss=0.641, lr=1]\nSteps:  93%|█████████▎| 1119/1200 [09:10<00:39,  2.04it/s, loss=0.588, lr=1]\nSteps:  93%|█████████▎| 1120/1200 [09:10<00:39,  2.04it/s, loss=0.588, lr=1]\nSteps:  93%|█████████▎| 1120/1200 [09:10<00:39,  2.04it/s, loss=0.306, lr=1]\nSteps:  93%|█████████▎| 1121/1200 [09:11<00:38,  2.04it/s, loss=0.306, lr=1]\nSteps:  93%|█████████▎| 1121/1200 [09:11<00:38,  2.04it/s, loss=0.674, lr=1]\nSteps:  94%|█████████▎| 1122/1200 [09:11<00:38,  2.04it/s, loss=0.674, lr=1]\nSteps:  94%|█████████▎| 1122/1200 [09:11<00:38,  2.04it/s, loss=0.431, lr=1]\nSteps:  94%|█████████▎| 1123/1200 [09:12<00:37,  2.04it/s, loss=0.431, lr=1]\nSteps:  94%|█████████▎| 1123/1200 [09:12<00:37,  2.04it/s, loss=0.624, lr=1]\nSteps:  94%|█████████▎| 1124/1200 [09:12<00:37,  2.04it/s, loss=0.624, lr=1]\nSteps:  94%|█████████▎| 1124/1200 [09:12<00:37,  2.04it/s, loss=0.636, lr=1]\nSteps:  94%|█████████▍| 1125/1200 [09:13<00:36,  2.04it/s, loss=0.636, lr=1]\nSteps:  94%|█████████▍| 1125/1200 [09:13<00:36,  2.04it/s, loss=0.275, lr=1]\nSteps:  94%|█████████▍| 1126/1200 [09:13<00:36,  2.04it/s, loss=0.275, lr=1]\nSteps:  94%|█████████▍| 1126/1200 [09:13<00:36,  2.04it/s, loss=0.574, lr=1]\nSteps:  94%|█████████▍| 1127/1200 [09:14<00:35,  2.04it/s, loss=0.574, lr=1]\nSteps:  94%|█████████▍| 1127/1200 [09:14<00:35,  2.04it/s, loss=0.72, lr=1] \nSteps:  94%|█████████▍| 1128/1200 [09:14<00:35,  2.04it/s, loss=0.72, lr=1]\nSteps:  94%|█████████▍| 1128/1200 [09:14<00:35,  2.04it/s, loss=0.282, lr=1]\nSteps:  94%|█████████▍| 1129/1200 [09:15<00:34,  2.03it/s, loss=0.282, lr=1]\nSteps:  94%|█████████▍| 1129/1200 [09:15<00:34,  2.03it/s, loss=0.544, lr=1]\nSteps:  94%|█████████▍| 1130/1200 [09:15<00:34,  2.03it/s, loss=0.544, lr=1]\nSteps:  94%|█████████▍| 1130/1200 [09:15<00:34,  2.03it/s, loss=0.392, lr=1]\nSteps:  94%|█████████▍| 1131/1200 [09:16<00:33,  2.04it/s, loss=0.392, lr=1]\nSteps:  94%|█████████▍| 1131/1200 [09:16<00:33,  2.04it/s, loss=0.419, lr=1]\nSteps:  94%|█████████▍| 1132/1200 [09:16<00:33,  2.04it/s, loss=0.419, lr=1]\nSteps:  94%|█████████▍| 1132/1200 [09:16<00:33,  2.04it/s, loss=0.762, lr=1]\nSteps:  94%|█████████▍| 1133/1200 [09:17<00:32,  2.04it/s, loss=0.762, lr=1]\nSteps:  94%|█████████▍| 1133/1200 [09:17<00:32,  2.04it/s, loss=0.754, lr=1]\nSteps:  94%|█████████▍| 1134/1200 [09:17<00:32,  2.04it/s, loss=0.754, lr=1]\nSteps:  94%|█████████▍| 1134/1200 [09:17<00:32,  2.04it/s, loss=0.354, lr=1]\nSteps:  95%|█████████▍| 1135/1200 [09:18<00:31,  2.04it/s, loss=0.354, lr=1]\nSteps:  95%|█████████▍| 1135/1200 [09:18<00:31,  2.04it/s, loss=0.774, lr=1]\nSteps:  95%|█████████▍| 1136/1200 [09:18<00:31,  2.04it/s, loss=0.774, lr=1]\nSteps:  95%|█████████▍| 1136/1200 [09:18<00:31,  2.04it/s, loss=0.639, lr=1]\nSteps:  95%|█████████▍| 1137/1200 [09:19<00:30,  2.04it/s, loss=0.639, lr=1]\nSteps:  95%|█████████▍| 1137/1200 [09:19<00:30,  2.04it/s, loss=0.404, lr=1]\nSteps:  95%|█████████▍| 1138/1200 [09:19<00:30,  2.04it/s, loss=0.404, lr=1]\nSteps:  95%|█████████▍| 1138/1200 [09:19<00:30,  2.04it/s, loss=0.587, lr=1]\nSteps:  95%|█████████▍| 1139/1200 [09:20<00:29,  2.04it/s, loss=0.587, lr=1]\nSteps:  95%|█████████▍| 1139/1200 [09:20<00:29,  2.04it/s, loss=0.561, lr=1]\nSteps:  95%|█████████▌| 1140/1200 [09:20<00:29,  2.04it/s, loss=0.561, lr=1]\nSteps:  95%|█████████▌| 1140/1200 [09:20<00:29,  2.04it/s, loss=0.432, lr=1]\nSteps:  95%|█████████▌| 1141/1200 [09:21<00:29,  2.03it/s, loss=0.432, lr=1]\nSteps:  95%|█████████▌| 1141/1200 [09:21<00:29,  2.03it/s, loss=0.462, lr=1]\nSteps:  95%|█████████▌| 1142/1200 [09:21<00:28,  2.04it/s, loss=0.462, lr=1]\nSteps:  95%|█████████▌| 1142/1200 [09:21<00:28,  2.04it/s, loss=0.291, lr=1]\nSteps:  95%|█████████▌| 1143/1200 [09:22<00:27,  2.04it/s, loss=0.291, lr=1]\nSteps:  95%|█████████▌| 1143/1200 [09:22<00:27,  2.04it/s, loss=0.481, lr=1]\nSteps:  95%|█████████▌| 1144/1200 [09:22<00:27,  2.04it/s, loss=0.481, lr=1]\nSteps:  95%|█████████▌| 1144/1200 [09:22<00:27,  2.04it/s, loss=0.798, lr=1]\nSteps:  95%|█████████▌| 1145/1200 [09:23<00:26,  2.04it/s, loss=0.798, lr=1]\nSteps:  95%|█████████▌| 1145/1200 [09:23<00:26,  2.04it/s, loss=0.697, lr=1]\nSteps:  96%|█████████▌| 1146/1200 [09:23<00:26,  2.04it/s, loss=0.697, lr=1]\nSteps:  96%|█████████▌| 1146/1200 [09:23<00:26,  2.04it/s, loss=0.277, lr=1]\nSteps:  96%|█████████▌| 1147/1200 [09:24<00:25,  2.04it/s, loss=0.277, lr=1]\nSteps:  96%|█████████▌| 1147/1200 [09:24<00:25,  2.04it/s, loss=0.275, lr=1]\nSteps:  96%|█████████▌| 1148/1200 [09:24<00:25,  2.04it/s, loss=0.275, lr=1]\nSteps:  96%|█████████▌| 1148/1200 [09:24<00:25,  2.04it/s, loss=1.01, lr=1] \nSteps:  96%|█████████▌| 1149/1200 [09:24<00:25,  2.04it/s, loss=1.01, lr=1]\nSteps:  96%|█████████▌| 1149/1200 [09:24<00:25,  2.04it/s, loss=0.632, lr=1]\nSteps:  96%|█████████▌| 1150/1200 [09:25<00:24,  2.04it/s, loss=0.632, lr=1]\nSteps:  96%|█████████▌| 1150/1200 [09:25<00:24,  2.04it/s, loss=0.371, lr=1]\nSteps:  96%|█████████▌| 1151/1200 [09:25<00:24,  2.04it/s, loss=0.371, lr=1]\nSteps:  96%|█████████▌| 1151/1200 [09:25<00:24,  2.04it/s, loss=0.629, lr=1]\nSteps:  96%|█████████▌| 1152/1200 [09:26<00:23,  2.04it/s, loss=0.629, lr=1]\nSteps:  96%|█████████▌| 1152/1200 [09:26<00:23,  2.04it/s, loss=0.425, lr=1]\nSteps:  96%|█████████▌| 1153/1200 [09:26<00:23,  2.03it/s, loss=0.425, lr=1]\nSteps:  96%|█████████▌| 1153/1200 [09:26<00:23,  2.03it/s, loss=0.368, lr=1]\nSteps:  96%|█████████▌| 1154/1200 [09:27<00:22,  2.03it/s, loss=0.368, lr=1]\nSteps:  96%|█████████▌| 1154/1200 [09:27<00:22,  2.03it/s, loss=0.339, lr=1]\nSteps:  96%|█████████▋| 1155/1200 [09:27<00:22,  2.04it/s, loss=0.339, lr=1]\nSteps:  96%|█████████▋| 1155/1200 [09:27<00:22,  2.04it/s, loss=0.599, lr=1]\nSteps:  96%|█████████▋| 1156/1200 [09:28<00:21,  2.04it/s, loss=0.599, lr=1]\nSteps:  96%|█████████▋| 1156/1200 [09:28<00:21,  2.04it/s, loss=0.441, lr=1]\nSteps:  96%|█████████▋| 1157/1200 [09:28<00:21,  2.04it/s, loss=0.441, lr=1]\nSteps:  96%|█████████▋| 1157/1200 [09:28<00:21,  2.04it/s, loss=0.476, lr=1]\nSteps:  96%|█████████▋| 1158/1200 [09:29<00:20,  2.04it/s, loss=0.476, lr=1]\nSteps:  96%|█████████▋| 1158/1200 [09:29<00:20,  2.04it/s, loss=0.553, lr=1]\nSteps:  97%|█████████▋| 1159/1200 [09:29<00:20,  2.04it/s, loss=0.553, lr=1]\nSteps:  97%|█████████▋| 1159/1200 [09:29<00:20,  2.04it/s, loss=0.462, lr=1]\nSteps:  97%|█████████▋| 1160/1200 [09:30<00:19,  2.04it/s, loss=0.462, lr=1]\nSteps:  97%|█████████▋| 1160/1200 [09:30<00:19,  2.04it/s, loss=0.266, lr=1]\nSteps:  97%|█████████▋| 1161/1200 [09:30<00:19,  2.04it/s, loss=0.266, lr=1]\nSteps:  97%|█████████▋| 1161/1200 [09:30<00:19,  2.04it/s, loss=0.295, lr=1]\nSteps:  97%|█████████▋| 1162/1200 [09:31<00:18,  2.04it/s, loss=0.295, lr=1]\nSteps:  97%|█████████▋| 1162/1200 [09:31<00:18,  2.04it/s, loss=0.45, lr=1] \nSteps:  97%|█████████▋| 1163/1200 [09:31<00:18,  2.04it/s, loss=0.45, lr=1]\nSteps:  97%|█████████▋| 1163/1200 [09:31<00:18,  2.04it/s, loss=0.324, lr=1]\nSteps:  97%|█████████▋| 1164/1200 [09:32<00:17,  2.04it/s, loss=0.324, lr=1]\nSteps:  97%|█████████▋| 1164/1200 [09:32<00:17,  2.04it/s, loss=0.393, lr=1]\nSteps:  97%|█████████▋| 1165/1200 [09:32<00:17,  2.03it/s, loss=0.393, lr=1]\nSteps:  97%|█████████▋| 1165/1200 [09:32<00:17,  2.03it/s, loss=0.535, lr=1]\nSteps:  97%|█████████▋| 1166/1200 [09:33<00:16,  2.03it/s, loss=0.535, lr=1]\nSteps:  97%|█████████▋| 1166/1200 [09:33<00:16,  2.03it/s, loss=0.323, lr=1]\nSteps:  97%|█████████▋| 1167/1200 [09:33<00:16,  2.04it/s, loss=0.323, lr=1]\nSteps:  97%|█████████▋| 1167/1200 [09:33<00:16,  2.04it/s, loss=0.371, lr=1]\nSteps:  97%|█████████▋| 1168/1200 [09:34<00:15,  2.04it/s, loss=0.371, lr=1]\nSteps:  97%|█████████▋| 1168/1200 [09:34<00:15,  2.04it/s, loss=0.368, lr=1]\nSteps:  97%|█████████▋| 1169/1200 [09:34<00:15,  2.04it/s, loss=0.368, lr=1]\nSteps:  97%|█████████▋| 1169/1200 [09:34<00:15,  2.04it/s, loss=0.311, lr=1]\nSteps:  98%|█████████▊| 1170/1200 [09:35<00:14,  2.04it/s, loss=0.311, lr=1]\nSteps:  98%|█████████▊| 1170/1200 [09:35<00:14,  2.04it/s, loss=0.34, lr=1] \nSteps:  98%|█████████▊| 1171/1200 [09:35<00:14,  2.04it/s, loss=0.34, lr=1]\nSteps:  98%|█████████▊| 1171/1200 [09:35<00:14,  2.04it/s, loss=0.389, lr=1]\nSteps:  98%|█████████▊| 1172/1200 [09:36<00:13,  2.04it/s, loss=0.389, lr=1]\nSteps:  98%|█████████▊| 1172/1200 [09:36<00:13,  2.04it/s, loss=0.711, lr=1]\nSteps:  98%|█████████▊| 1173/1200 [09:36<00:13,  2.04it/s, loss=0.711, lr=1]\nSteps:  98%|█████████▊| 1173/1200 [09:36<00:13,  2.04it/s, loss=0.331, lr=1]\nSteps:  98%|█████████▊| 1174/1200 [09:37<00:12,  2.04it/s, loss=0.331, lr=1]\nSteps:  98%|█████████▊| 1174/1200 [09:37<00:12,  2.04it/s, loss=0.571, lr=1]\nSteps:  98%|█████████▊| 1175/1200 [09:37<00:12,  2.04it/s, loss=0.571, lr=1]\nSteps:  98%|█████████▊| 1175/1200 [09:37<00:12,  2.04it/s, loss=0.593, lr=1]\nSteps:  98%|█████████▊| 1176/1200 [09:38<00:11,  2.04it/s, loss=0.593, lr=1]\nSteps:  98%|█████████▊| 1176/1200 [09:38<00:11,  2.04it/s, loss=0.487, lr=1]\nSteps:  98%|█████████▊| 1177/1200 [09:38<00:11,  2.03it/s, loss=0.487, lr=1]\nSteps:  98%|█████████▊| 1177/1200 [09:38<00:11,  2.03it/s, loss=0.339, lr=1]\nSteps:  98%|█████████▊| 1178/1200 [09:39<00:10,  2.04it/s, loss=0.339, lr=1]\nSteps:  98%|█████████▊| 1178/1200 [09:39<00:10,  2.04it/s, loss=0.356, lr=1]\nSteps:  98%|█████████▊| 1179/1200 [09:39<00:10,  2.04it/s, loss=0.356, lr=1]\nSteps:  98%|█████████▊| 1179/1200 [09:39<00:10,  2.04it/s, loss=0.281, lr=1]\nSteps:  98%|█████████▊| 1180/1200 [09:40<00:09,  2.04it/s, loss=0.281, lr=1]\nSteps:  98%|█████████▊| 1180/1200 [09:40<00:09,  2.04it/s, loss=0.324, lr=1]\nSteps:  98%|█████████▊| 1181/1200 [09:40<00:09,  2.04it/s, loss=0.324, lr=1]\nSteps:  98%|█████████▊| 1181/1200 [09:40<00:09,  2.04it/s, loss=0.295, lr=1]\nSteps:  98%|█████████▊| 1182/1200 [09:41<00:08,  2.04it/s, loss=0.295, lr=1]\nSteps:  98%|█████████▊| 1182/1200 [09:41<00:08,  2.04it/s, loss=0.532, lr=1]\nSteps:  99%|█████████▊| 1183/1200 [09:41<00:08,  2.04it/s, loss=0.532, lr=1]\nSteps:  99%|█████████▊| 1183/1200 [09:41<00:08,  2.04it/s, loss=0.616, lr=1]\nSteps:  99%|█████████▊| 1184/1200 [09:42<00:07,  2.04it/s, loss=0.616, lr=1]\nSteps:  99%|█████████▊| 1184/1200 [09:42<00:07,  2.04it/s, loss=0.538, lr=1]\nSteps:  99%|█████████▉| 1185/1200 [09:42<00:07,  2.04it/s, loss=0.538, lr=1]\nSteps:  99%|█████████▉| 1185/1200 [09:42<00:07,  2.04it/s, loss=0.424, lr=1]\nSteps:  99%|█████████▉| 1186/1200 [09:43<00:06,  2.04it/s, loss=0.424, lr=1]\nSteps:  99%|█████████▉| 1186/1200 [09:43<00:06,  2.04it/s, loss=0.591, lr=1]\nSteps:  99%|█████████▉| 1187/1200 [09:43<00:06,  2.04it/s, loss=0.591, lr=1]\nSteps:  99%|█████████▉| 1187/1200 [09:43<00:06,  2.04it/s, loss=0.283, lr=1]\nSteps:  99%|█████████▉| 1188/1200 [09:44<00:05,  2.04it/s, loss=0.283, lr=1]\nSteps:  99%|█████████▉| 1188/1200 [09:44<00:05,  2.04it/s, loss=0.63, lr=1] \nSteps:  99%|█████████▉| 1189/1200 [09:44<00:05,  2.03it/s, loss=0.63, lr=1]\nSteps:  99%|█████████▉| 1189/1200 [09:44<00:05,  2.03it/s, loss=0.63, lr=1]\nSteps:  99%|█████████▉| 1190/1200 [09:45<00:04,  2.04it/s, loss=0.63, lr=1]\nSteps:  99%|█████████▉| 1190/1200 [09:45<00:04,  2.04it/s, loss=0.565, lr=1]\nSteps:  99%|█████████▉| 1191/1200 [09:45<00:04,  2.04it/s, loss=0.565, lr=1]\nSteps:  99%|█████████▉| 1191/1200 [09:45<00:04,  2.04it/s, loss=0.491, lr=1]\nSteps:  99%|█████████▉| 1192/1200 [09:46<00:03,  2.04it/s, loss=0.491, lr=1]\nSteps:  99%|█████████▉| 1192/1200 [09:46<00:03,  2.04it/s, loss=0.702, lr=1]\nSteps:  99%|█████████▉| 1193/1200 [09:46<00:03,  2.04it/s, loss=0.702, lr=1]\nSteps:  99%|█████████▉| 1193/1200 [09:46<00:03,  2.04it/s, loss=0.411, lr=1]\nSteps: 100%|█████████▉| 1194/1200 [09:47<00:02,  2.04it/s, loss=0.411, lr=1]\nSteps: 100%|█████████▉| 1194/1200 [09:47<00:02,  2.04it/s, loss=0.504, lr=1]\nSteps: 100%|█████████▉| 1195/1200 [09:47<00:02,  2.04it/s, loss=0.504, lr=1]\nSteps: 100%|█████████▉| 1195/1200 [09:47<00:02,  2.04it/s, loss=0.328, lr=1]\nSteps: 100%|█████████▉| 1196/1200 [09:48<00:01,  2.04it/s, loss=0.328, lr=1]\nSteps: 100%|█████████▉| 1196/1200 [09:48<00:01,  2.04it/s, loss=0.257, lr=1]\nSteps: 100%|█████████▉| 1197/1200 [09:48<00:01,  2.04it/s, loss=0.257, lr=1]\nSteps: 100%|█████████▉| 1197/1200 [09:48<00:01,  2.04it/s, loss=0.398, lr=1]\nSteps: 100%|█████████▉| 1198/1200 [09:49<00:00,  2.04it/s, loss=0.398, lr=1]\nSteps: 100%|█████████▉| 1198/1200 [09:49<00:00,  2.04it/s, loss=0.545, lr=1]\nSteps: 100%|█████████▉| 1199/1200 [09:49<00:00,  2.04it/s, loss=0.545, lr=1]\nSteps: 100%|█████████▉| 1199/1200 [09:49<00:00,  2.04it/s, loss=0.521, lr=1]\nSteps: 100%|██████████| 1200/1200 [09:49<00:00,  2.04it/s, loss=0.521, lr=1]\nSteps: 100%|██████████| 1200/1200 [09:49<00:00,  2.04it/s, loss=0.651, lr=1]Model weights saved in /tmp/train/output/flux_train_replicate/pytorch_lora_weights.safetensors\nLoading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]\u001b[A\nLoading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]\u001b[A\u001b[A\nLoading checkpoint shards:  50%|█████     | 1/2 [00:00<00:00,  6.56it/s]\u001b[A\u001b[A\nLoading checkpoint shards: 100%|██████████| 2/2 [00:00<00:00,  7.64it/s]\u001b[A\u001b[A\nLoading checkpoint shards: 100%|██████████| 2/2 [00:00<00:00,  7.45it/s]\nLoaded text_encoder_2 as T5EncoderModel from `text_encoder_2` subfolder of FLUX.1-dev.\nLoading pipeline components...:  14%|█▍        | 1/7 [00:00<00:01,  3.16it/s]\u001b[ALoaded text_encoder as CLIPTextModel from `text_encoder` subfolder of FLUX.1-dev.\nLoading pipeline components...:  29%|██▊       | 2/7 [00:00<00:01,  4.66it/s]\u001b[ALoaded scheduler as FlowMatchEulerDiscreteScheduler from `scheduler` subfolder of FLUX.1-dev.\nLoaded tokenizer as CLIPTokenizer from `tokenizer` subfolder of FLUX.1-dev.\n{'axes_dims_rope'} was not found in config. Values will be initialized to default values.\nLoaded transformer as FluxTransformer2DModel from `transformer` subfolder of FLUX.1-dev.\nLoading pipeline components...:  71%|███████▏  | 5/7 [00:01<00:00,  4.99it/s]\u001b[ALoaded vae as AutoencoderKL from `vae` subfolder of FLUX.1-dev.\nLoaded tokenizer_2 as T5TokenizerFast from `tokenizer_2` subfolder of FLUX.1-dev.\nLoading pipeline components...: 100%|██████████| 7/7 [00:01<00:00,  6.05it/s]\u001b[A\nLoading pipeline components...: 100%|██████████| 7/7 [00:01<00:00,  5.50it/s]\nSteps: 100%|██████████| 1200/1200 [09:51<00:00,  2.03it/s, loss=0.651, lr=1]\n./\n./output/\n./output/flux_train_replicate/\n./output/flux_train_replicate/lora.safetensors",
  "metrics": {
    "predict_time": 658.339050409,
    "total_time": 699.206253
  },
  "output": "https://replicate.delivery/yhqm/DnoVJxiDrezdDCqw3LLtIQf47Gy3V8TqZNg5KxuPEcBAYdlTA/trained_model.tar",
  "started_at": "2024-10-10T18:48:14.469202Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/gpqzpvzqw9rj60cjez0rtm2604",
    "cancel": "https://api.replicate.com/v1/predictions/gpqzpvzqw9rj60cjez0rtm2604/cancel"
  },
  "version": "fc7489622d50e8dfbd15ed0dea991263613e04180978aac97fb3e9eba7cf36f1"
}

Generated in

10 minutes 58 seconds

Tweak it ShareReport

Using seed: 2514880356
Extracted 12 files from zip to input_images
Using params: ['accelerate', 'launch', '--dynamo_backend', 'no', 'train_dreambooth_lora_flux.py', '--pretrained_model_name_or_path', 'FLUX.1-dev', '--instance_data_dir', 'input_images', '--rank', '4', '--output_dir', '/tmp/train/output/flux_train_replicate', '--mixed_precision', 'bf16', '--instance_prompt', 'a photo of QSO dog', '--resolution', '512', '--train_batch_size', '1', '--gradient_accumulation_steps', '1', '--optimizer=prodigy', '--learning_rate', '1.0', '--lr_scheduler', 'constant', '--lr_warmup_steps', '0', '--max_train_steps', '1200', '--checkpointing_steps', '1201', '--seed', '2514880356', '--logging_dir', '/tmp/logs']
10/10/2024 18:48:24 - INFO - __main__ - Distributed environment: DistributedType.NO
Num processes: 1
Process index: 0
Local process index: 0
Device: cuda
Mixed precision type: bf16
You set `add_prefix_space`. The tokenizer needs to be converted from the slow tokenizers
You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.
You are using a model of type t5 to instantiate a model of type . This is not supported for all configurations of models and can yield errors.
Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards:  50%|█████     | 1/2 [00:04<00:04,  4.14s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00,  3.82s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00,  3.87s/it]
{'axes_dims_rope'} was not found in config. Values will be initialized to default values.
Using decoupled weight decay
10/10/2024 18:49:19 - INFO - __main__ - ***** Running training *****
10/10/2024 18:49:19 - INFO - __main__ -   Num examples = 12
10/10/2024 18:49:19 - INFO - __main__ -   Num batches each epoch = 12
10/10/2024 18:49:19 - INFO - __main__ -   Num Epochs = 100
10/10/2024 18:49:19 - INFO - __main__ -   Instantaneous batch size per device = 1
10/10/2024 18:49:19 - INFO - __main__ -   Total train batch size (w. parallel, distributed & accumulation) = 1
10/10/2024 18:49:19 - INFO - __main__ -   Gradient Accumulation steps = 1
10/10/2024 18:49:19 - INFO - __main__ -   Total optimization steps = 1200
Steps:   0%|          | 0/1200 [00:00<?, ?it/s]
Steps:   0%|          | 1/1200 [00:00<14:51,  1.35it/s]
Steps:   0%|          | 1/1200 [00:00<14:51,  1.35it/s, loss=0.66, lr=1]
Steps:   0%|          | 2/1200 [00:01<11:51,  1.68it/s, loss=0.66, lr=1]
Steps:   0%|          | 2/1200 [00:01<11:51,  1.68it/s, loss=0.62, lr=1]
Steps:   0%|          | 3/1200 [00:01<10:53,  1.83it/s, loss=0.62, lr=1]
Steps:   0%|          | 3/1200 [00:01<10:53,  1.83it/s, loss=0.363, lr=1]
Steps:   0%|          | 4/1200 [00:02<10:27,  1.91it/s, loss=0.363, lr=1]
Steps:   0%|          | 4/1200 [00:02<10:27,  1.91it/s, loss=0.442, lr=1]
Steps:   0%|          | 5/1200 [00:02<10:11,  1.95it/s, loss=0.442, lr=1]
Steps:   0%|          | 5/1200 [00:02<10:11,  1.95it/s, loss=1.11, lr=1] 
Steps:   0%|          | 6/1200 [00:03<10:01,  1.98it/s, loss=1.11, lr=1]
Steps:   0%|          | 6/1200 [00:03<10:01,  1.98it/s, loss=0.856, lr=1]
Steps:   1%|          | 7/1200 [00:03<09:55,  2.00it/s, loss=0.856, lr=1]
Steps:   1%|          | 7/1200 [00:03<09:55,  2.00it/s, loss=0.584, lr=1]
Steps:   1%|          | 8/1200 [00:04<09:51,  2.02it/s, loss=0.584, lr=1]
Steps:   1%|          | 8/1200 [00:04<09:51,  2.02it/s, loss=0.503, lr=1]
Steps:   1%|          | 9/1200 [00:04<09:49,  2.02it/s, loss=0.503, lr=1]
Steps:   1%|          | 9/1200 [00:04<09:49,  2.02it/s, loss=0.676, lr=1]
Steps:   1%|          | 10/1200 [00:05<09:47,  2.03it/s, loss=0.676, lr=1]
Steps:   1%|          | 10/1200 [00:05<09:47,  2.03it/s, loss=0.797, lr=1]
Steps:   1%|          | 11/1200 [00:05<09:45,  2.03it/s, loss=0.797, lr=1]
Steps:   1%|          | 11/1200 [00:05<09:45,  2.03it/s, loss=0.543, lr=1]
Steps:   1%|          | 12/1200 [00:06<09:43,  2.04it/s, loss=0.543, lr=1]
Steps:   1%|          | 12/1200 [00:06<09:43,  2.04it/s, loss=0.589, lr=1]
Steps:   1%|          | 13/1200 [00:06<09:45,  2.03it/s, loss=0.589, lr=1]
Steps:   1%|          | 13/1200 [00:06<09:45,  2.03it/s, loss=0.629, lr=1]
Steps:   1%|          | 14/1200 [00:07<09:43,  2.03it/s, loss=0.629, lr=1]
Steps:   1%|          | 14/1200 [00:07<09:43,  2.03it/s, loss=0.384, lr=1]
Steps:   1%|▏         | 15/1200 [00:07<09:42,  2.03it/s, loss=0.384, lr=1]
Steps:   1%|▏         | 15/1200 [00:07<09:42,  2.03it/s, loss=0.651, lr=1]
Steps:   1%|▏         | 16/1200 [00:08<09:41,  2.04it/s, loss=0.651, lr=1]
Steps:   1%|▏         | 16/1200 [00:08<09:41,  2.04it/s, loss=0.589, lr=1]
Steps:   1%|▏         | 17/1200 [00:08<09:40,  2.04it/s, loss=0.589, lr=1]
Steps:   1%|▏         | 17/1200 [00:08<09:40,  2.04it/s, loss=0.747, lr=1]
Steps:   2%|▏         | 18/1200 [00:09<09:39,  2.04it/s, loss=0.747, lr=1]
Steps:   2%|▏         | 18/1200 [00:09<09:39,  2.04it/s, loss=0.566, lr=1]
Steps:   2%|▏         | 19/1200 [00:09<09:39,  2.04it/s, loss=0.566, lr=1]
Steps:   2%|▏         | 19/1200 [00:09<09:39,  2.04it/s, loss=0.646, lr=1]
Steps:   2%|▏         | 20/1200 [00:10<09:38,  2.04it/s, loss=0.646, lr=1]
Steps:   2%|▏         | 20/1200 [00:10<09:38,  2.04it/s, loss=0.455, lr=1]
Steps:   2%|▏         | 21/1200 [00:10<09:38,  2.04it/s, loss=0.455, lr=1]
Steps:   2%|▏         | 21/1200 [00:10<09:38,  2.04it/s, loss=1.01, lr=1] 
Steps:   2%|▏         | 22/1200 [00:11<09:37,  2.04it/s, loss=1.01, lr=1]
Steps:   2%|▏         | 22/1200 [00:11<09:37,  2.04it/s, loss=0.765, lr=1]
Steps:   2%|▏         | 23/1200 [00:11<09:37,  2.04it/s, loss=0.765, lr=1]
Steps:   2%|▏         | 23/1200 [00:11<09:37,  2.04it/s, loss=0.686, lr=1]
Steps:   2%|▏         | 24/1200 [00:12<09:36,  2.04it/s, loss=0.686, lr=1]
Steps:   2%|▏         | 24/1200 [00:12<09:36,  2.04it/s, loss=0.392, lr=1]
Steps:   2%|▏         | 25/1200 [00:12<09:38,  2.03it/s, loss=0.392, lr=1]
Steps:   2%|▏         | 25/1200 [00:12<09:38,  2.03it/s, loss=0.751, lr=1]
Steps:   2%|▏         | 26/1200 [00:13<09:37,  2.03it/s, loss=0.751, lr=1]
Steps:   2%|▏         | 26/1200 [00:13<09:37,  2.03it/s, loss=0.917, lr=1]
Steps:   2%|▏         | 27/1200 [00:13<09:35,  2.04it/s, loss=0.917, lr=1]
Steps:   2%|▏         | 27/1200 [00:13<09:35,  2.04it/s, loss=0.658, lr=1]
Steps:   2%|▏         | 28/1200 [00:13<09:34,  2.04it/s, loss=0.658, lr=1]
Steps:   2%|▏         | 28/1200 [00:13<09:34,  2.04it/s, loss=0.574, lr=1]
Steps:   2%|▏         | 29/1200 [00:14<09:34,  2.04it/s, loss=0.574, lr=1]
Steps:   2%|▏         | 29/1200 [00:14<09:34,  2.04it/s, loss=0.639, lr=1]
Steps:   2%|▎         | 30/1200 [00:14<09:33,  2.04it/s, loss=0.639, lr=1]
Steps:   2%|▎         | 30/1200 [00:14<09:33,  2.04it/s, loss=0.637, lr=1]
Steps:   3%|▎         | 31/1200 [00:15<09:33,  2.04it/s, loss=0.637, lr=1]
Steps:   3%|▎         | 31/1200 [00:15<09:33,  2.04it/s, loss=0.401, lr=1]
Steps:   3%|▎         | 32/1200 [00:15<09:32,  2.04it/s, loss=0.401, lr=1]
Steps:   3%|▎         | 32/1200 [00:15<09:32,  2.04it/s, loss=0.534, lr=1]
Steps:   3%|▎         | 33/1200 [00:16<09:31,  2.04it/s, loss=0.534, lr=1]
Steps:   3%|▎         | 33/1200 [00:16<09:31,  2.04it/s, loss=0.667, lr=1]
Steps:   3%|▎         | 34/1200 [00:16<09:31,  2.04it/s, loss=0.667, lr=1]
Steps:   3%|▎         | 34/1200 [00:16<09:31,  2.04it/s, loss=0.627, lr=1]
Steps:   3%|▎         | 35/1200 [00:17<09:31,  2.04it/s, loss=0.627, lr=1]
Steps:   3%|▎         | 35/1200 [00:17<09:31,  2.04it/s, loss=0.502, lr=1]
Steps:   3%|▎         | 36/1200 [00:17<09:30,  2.04it/s, loss=0.502, lr=1]
Steps:   3%|▎         | 36/1200 [00:17<09:30,  2.04it/s, loss=0.402, lr=1]
Steps:   3%|▎         | 37/1200 [00:18<09:32,  2.03it/s, loss=0.402, lr=1]
Steps:   3%|▎         | 37/1200 [00:18<09:32,  2.03it/s, loss=0.77, lr=1] 
Steps:   3%|▎         | 38/1200 [00:18<09:31,  2.03it/s, loss=0.77, lr=1]
Steps:   3%|▎         | 38/1200 [00:18<09:31,  2.03it/s, loss=0.554, lr=1]
Steps:   3%|▎         | 39/1200 [00:19<09:30,  2.04it/s, loss=0.554, lr=1]
Steps:   3%|▎         | 39/1200 [00:19<09:30,  2.04it/s, loss=0.437, lr=1]
Steps:   3%|▎         | 40/1200 [00:19<09:29,  2.04it/s, loss=0.437, lr=1]
Steps:   3%|▎         | 40/1200 [00:19<09:29,  2.04it/s, loss=0.473, lr=1]
Steps:   3%|▎         | 41/1200 [00:20<09:28,  2.04it/s, loss=0.473, lr=1]
Steps:   3%|▎         | 41/1200 [00:20<09:28,  2.04it/s, loss=0.46, lr=1] 
Steps:   4%|▎         | 42/1200 [00:20<09:28,  2.04it/s, loss=0.46, lr=1]
Steps:   4%|▎         | 42/1200 [00:20<09:28,  2.04it/s, loss=0.381, lr=1]
Steps:   4%|▎         | 43/1200 [00:21<09:27,  2.04it/s, loss=0.381, lr=1]
Steps:   4%|▎         | 43/1200 [00:21<09:27,  2.04it/s, loss=0.668, lr=1]
Steps:   4%|▎         | 44/1200 [00:21<09:26,  2.04it/s, loss=0.668, lr=1]
Steps:   4%|▎         | 44/1200 [00:21<09:26,  2.04it/s, loss=0.554, lr=1]
Steps:   4%|▍         | 45/1200 [00:22<09:26,  2.04it/s, loss=0.554, lr=1]
Steps:   4%|▍         | 45/1200 [00:22<09:26,  2.04it/s, loss=0.555, lr=1]
Steps:   4%|▍         | 46/1200 [00:22<09:25,  2.04it/s, loss=0.555, lr=1]
Steps:   4%|▍         | 46/1200 [00:22<09:25,  2.04it/s, loss=0.485, lr=1]
Steps:   4%|▍         | 47/1200 [00:23<09:24,  2.04it/s, loss=0.485, lr=1]
Steps:   4%|▍         | 47/1200 [00:23<09:24,  2.04it/s, loss=0.486, lr=1]
Steps:   4%|▍         | 48/1200 [00:23<09:24,  2.04it/s, loss=0.486, lr=1]
Steps:   4%|▍         | 48/1200 [00:23<09:24,  2.04it/s, loss=0.551, lr=1]
Steps:   4%|▍         | 49/1200 [00:24<09:26,  2.03it/s, loss=0.551, lr=1]
Steps:   4%|▍         | 49/1200 [00:24<09:26,  2.03it/s, loss=0.465, lr=1]
Steps:   4%|▍         | 50/1200 [00:24<09:24,  2.04it/s, loss=0.465, lr=1]
Steps:   4%|▍         | 50/1200 [00:24<09:24,  2.04it/s, loss=1.02, lr=1] 
Steps:   4%|▍         | 51/1200 [00:25<09:23,  2.04it/s, loss=1.02, lr=1]
Steps:   4%|▍         | 51/1200 [00:25<09:23,  2.04it/s, loss=0.563, lr=1]
Steps:   4%|▍         | 52/1200 [00:25<09:22,  2.04it/s, loss=0.563, lr=1]
Steps:   4%|▍         | 52/1200 [00:25<09:22,  2.04it/s, loss=0.362, lr=1]
Steps:   4%|▍         | 53/1200 [00:26<09:22,  2.04it/s, loss=0.362, lr=1]
Steps:   4%|▍         | 53/1200 [00:26<09:22,  2.04it/s, loss=0.504, lr=1]
Steps:   4%|▍         | 54/1200 [00:26<09:21,  2.04it/s, loss=0.504, lr=1]
Steps:   4%|▍         | 54/1200 [00:26<09:21,  2.04it/s, loss=1.05, lr=1] 
Steps:   5%|▍         | 55/1200 [00:27<09:20,  2.04it/s, loss=1.05, lr=1]
Steps:   5%|▍         | 55/1200 [00:27<09:20,  2.04it/s, loss=0.543, lr=1]
Steps:   5%|▍         | 56/1200 [00:27<09:20,  2.04it/s, loss=0.543, lr=1]
Steps:   5%|▍         | 56/1200 [00:27<09:20,  2.04it/s, loss=0.667, lr=1]
Steps:   5%|▍         | 57/1200 [00:28<09:19,  2.04it/s, loss=0.667, lr=1]
Steps:   5%|▍         | 57/1200 [00:28<09:19,  2.04it/s, loss=0.418, lr=1]
Steps:   5%|▍         | 58/1200 [00:28<09:19,  2.04it/s, loss=0.418, lr=1]
Steps:   5%|▍         | 58/1200 [00:28<09:19,  2.04it/s, loss=0.653, lr=1]
Steps:   5%|▍         | 59/1200 [00:29<09:18,  2.04it/s, loss=0.653, lr=1]
Steps:   5%|▍         | 59/1200 [00:29<09:18,  2.04it/s, loss=0.541, lr=1]
Steps:   5%|▌         | 60/1200 [00:29<09:18,  2.04it/s, loss=0.541, lr=1]
Steps:   5%|▌         | 60/1200 [00:29<09:18,  2.04it/s, loss=0.688, lr=1]
Steps:   5%|▌         | 61/1200 [00:30<09:20,  2.03it/s, loss=0.688, lr=1]
Steps:   5%|▌         | 61/1200 [00:30<09:20,  2.03it/s, loss=0.564, lr=1]
Steps:   5%|▌         | 62/1200 [00:30<09:19,  2.03it/s, loss=0.564, lr=1]
Steps:   5%|▌         | 62/1200 [00:30<09:19,  2.03it/s, loss=0.493, lr=1]
Steps:   5%|▌         | 63/1200 [00:31<09:18,  2.04it/s, loss=0.493, lr=1]
Steps:   5%|▌         | 63/1200 [00:31<09:18,  2.04it/s, loss=0.456, lr=1]
Steps:   5%|▌         | 64/1200 [00:31<09:17,  2.04it/s, loss=0.456, lr=1]
Steps:   5%|▌         | 64/1200 [00:31<09:17,  2.04it/s, loss=1.38, lr=1] 
Steps:   5%|▌         | 65/1200 [00:32<09:16,  2.04it/s, loss=1.38, lr=1]
Steps:   5%|▌         | 65/1200 [00:32<09:16,  2.04it/s, loss=0.672, lr=1]
Steps:   6%|▌         | 66/1200 [00:32<09:16,  2.04it/s, loss=0.672, lr=1]
Steps:   6%|▌         | 66/1200 [00:32<09:16,  2.04it/s, loss=0.809, lr=1]
Steps:   6%|▌         | 67/1200 [00:33<09:15,  2.04it/s, loss=0.809, lr=1]
Steps:   6%|▌         | 67/1200 [00:33<09:15,  2.04it/s, loss=0.517, lr=1]
Steps:   6%|▌         | 68/1200 [00:33<09:15,  2.04it/s, loss=0.517, lr=1]
Steps:   6%|▌         | 68/1200 [00:33<09:15,  2.04it/s, loss=0.482, lr=1]
Steps:   6%|▌         | 69/1200 [00:34<09:14,  2.04it/s, loss=0.482, lr=1]
Steps:   6%|▌         | 69/1200 [00:34<09:14,  2.04it/s, loss=0.499, lr=1]
Steps:   6%|▌         | 70/1200 [00:34<09:14,  2.04it/s, loss=0.499, lr=1]
Steps:   6%|▌         | 70/1200 [00:34<09:14,  2.04it/s, loss=0.528, lr=1]
Steps:   6%|▌         | 71/1200 [00:35<09:13,  2.04it/s, loss=0.528, lr=1]
Steps:   6%|▌         | 71/1200 [00:35<09:13,  2.04it/s, loss=0.481, lr=1]
Steps:   6%|▌         | 72/1200 [00:35<09:13,  2.04it/s, loss=0.481, lr=1]
Steps:   6%|▌         | 72/1200 [00:35<09:13,  2.04it/s, loss=0.531, lr=1]
Steps:   6%|▌         | 73/1200 [00:36<09:14,  2.03it/s, loss=0.531, lr=1]
Steps:   6%|▌         | 73/1200 [00:36<09:14,  2.03it/s, loss=0.51, lr=1] 
Steps:   6%|▌         | 74/1200 [00:36<09:13,  2.03it/s, loss=0.51, lr=1]
Steps:   6%|▌         | 74/1200 [00:36<09:13,  2.03it/s, loss=0.578, lr=1]
Steps:   6%|▋         | 75/1200 [00:37<09:12,  2.04it/s, loss=0.578, lr=1]
Steps:   6%|▋         | 75/1200 [00:37<09:12,  2.04it/s, loss=0.601, lr=1]
Steps:   6%|▋         | 76/1200 [00:37<09:11,  2.04it/s, loss=0.601, lr=1]
Steps:   6%|▋         | 76/1200 [00:37<09:11,  2.04it/s, loss=0.434, lr=1]
Steps:   6%|▋         | 77/1200 [00:38<09:10,  2.04it/s, loss=0.434, lr=1]
Steps:   6%|▋         | 77/1200 [00:38<09:10,  2.04it/s, loss=0.436, lr=1]
Steps:   6%|▋         | 78/1200 [00:38<09:09,  2.04it/s, loss=0.436, lr=1]
Steps:   6%|▋         | 78/1200 [00:38<09:09,  2.04it/s, loss=0.62, lr=1] 
Steps:   7%|▋         | 79/1200 [00:39<09:09,  2.04it/s, loss=0.62, lr=1]
Steps:   7%|▋         | 79/1200 [00:39<09:09,  2.04it/s, loss=0.813, lr=1]
Steps:   7%|▋         | 80/1200 [00:39<09:08,  2.04it/s, loss=0.813, lr=1]
Steps:   7%|▋         | 80/1200 [00:39<09:08,  2.04it/s, loss=0.472, lr=1]
Steps:   7%|▋         | 81/1200 [00:39<09:07,  2.04it/s, loss=0.472, lr=1]
Steps:   7%|▋         | 81/1200 [00:39<09:07,  2.04it/s, loss=0.439, lr=1]
Steps:   7%|▋         | 82/1200 [00:40<09:07,  2.04it/s, loss=0.439, lr=1]
Steps:   7%|▋         | 82/1200 [00:40<09:07,  2.04it/s, loss=0.556, lr=1]
Steps:   7%|▋         | 83/1200 [00:40<09:06,  2.04it/s, loss=0.556, lr=1]
Steps:   7%|▋         | 83/1200 [00:40<09:06,  2.04it/s, loss=0.73, lr=1] 
Steps:   7%|▋         | 84/1200 [00:41<09:06,  2.04it/s, loss=0.73, lr=1]
Steps:   7%|▋         | 84/1200 [00:41<09:06,  2.04it/s, loss=0.503, lr=1]
Steps:   7%|▋         | 85/1200 [00:41<09:08,  2.03it/s, loss=0.503, lr=1]
Steps:   7%|▋         | 85/1200 [00:41<09:08,  2.03it/s, loss=0.696, lr=1]
Steps:   7%|▋         | 86/1200 [00:42<09:07,  2.03it/s, loss=0.696, lr=1]
Steps:   7%|▋         | 86/1200 [00:42<09:07,  2.03it/s, loss=0.613, lr=1]
Steps:   7%|▋         | 87/1200 [00:42<09:06,  2.04it/s, loss=0.613, lr=1]
Steps:   7%|▋         | 87/1200 [00:42<09:06,  2.04it/s, loss=0.468, lr=1]
Steps:   7%|▋         | 88/1200 [00:43<09:05,  2.04it/s, loss=0.468, lr=1]
Steps:   7%|▋         | 88/1200 [00:43<09:05,  2.04it/s, loss=0.57, lr=1] 
Steps:   7%|▋         | 89/1200 [00:43<09:04,  2.04it/s, loss=0.57, lr=1]
Steps:   7%|▋         | 89/1200 [00:43<09:04,  2.04it/s, loss=0.591, lr=1]
Steps:   8%|▊         | 90/1200 [00:44<09:04,  2.04it/s, loss=0.591, lr=1]
Steps:   8%|▊         | 90/1200 [00:44<09:04,  2.04it/s, loss=0.529, lr=1]
Steps:   8%|▊         | 91/1200 [00:44<09:04,  2.04it/s, loss=0.529, lr=1]
Steps:   8%|▊         | 91/1200 [00:44<09:04,  2.04it/s, loss=0.901, lr=1]
Steps:   8%|▊         | 92/1200 [00:45<09:03,  2.04it/s, loss=0.901, lr=1]
Steps:   8%|▊         | 92/1200 [00:45<09:03,  2.04it/s, loss=0.87, lr=1] 
Steps:   8%|▊         | 93/1200 [00:45<09:03,  2.04it/s, loss=0.87, lr=1]
Steps:   8%|▊         | 93/1200 [00:45<09:03,  2.04it/s, loss=0.423, lr=1]
Steps:   8%|▊         | 94/1200 [00:46<09:02,  2.04it/s, loss=0.423, lr=1]
Steps:   8%|▊         | 94/1200 [00:46<09:02,  2.04it/s, loss=0.412, lr=1]
Steps:   8%|▊         | 95/1200 [00:46<09:02,  2.04it/s, loss=0.412, lr=1]
Steps:   8%|▊         | 95/1200 [00:46<09:02,  2.04it/s, loss=0.578, lr=1]
Steps:   8%|▊         | 96/1200 [00:47<09:01,  2.04it/s, loss=0.578, lr=1]
Steps:   8%|▊         | 96/1200 [00:47<09:01,  2.04it/s, loss=0.641, lr=1]
Steps:   8%|▊         | 97/1200 [00:47<09:03,  2.03it/s, loss=0.641, lr=1]
Steps:   8%|▊         | 97/1200 [00:47<09:03,  2.03it/s, loss=0.79, lr=1] 
Steps:   8%|▊         | 98/1200 [00:48<09:02,  2.03it/s, loss=0.79, lr=1]
Steps:   8%|▊         | 98/1200 [00:48<09:02,  2.03it/s, loss=0.469, lr=1]
Steps:   8%|▊         | 99/1200 [00:48<09:01,  2.03it/s, loss=0.469, lr=1]
Steps:   8%|▊         | 99/1200 [00:48<09:01,  2.03it/s, loss=0.844, lr=1]
Steps:   8%|▊         | 100/1200 [00:49<09:00,  2.04it/s, loss=0.844, lr=1]
Steps:   8%|▊         | 100/1200 [00:49<09:00,  2.04it/s, loss=0.979, lr=1]
Steps:   8%|▊         | 101/1200 [00:49<08:59,  2.04it/s, loss=0.979, lr=1]
Steps:   8%|▊         | 101/1200 [00:49<08:59,  2.04it/s, loss=0.627, lr=1]
Steps:   8%|▊         | 102/1200 [00:50<08:58,  2.04it/s, loss=0.627, lr=1]
Steps:   8%|▊         | 102/1200 [00:50<08:58,  2.04it/s, loss=0.407, lr=1]
Steps:   9%|▊         | 103/1200 [00:50<08:57,  2.04it/s, loss=0.407, lr=1]
Steps:   9%|▊         | 103/1200 [00:50<08:57,  2.04it/s, loss=0.517, lr=1]
Steps:   9%|▊         | 104/1200 [00:51<08:57,  2.04it/s, loss=0.517, lr=1]
Steps:   9%|▊         | 104/1200 [00:51<08:57,  2.04it/s, loss=0.535, lr=1]
Steps:   9%|▉         | 105/1200 [00:51<08:56,  2.04it/s, loss=0.535, lr=1]
Steps:   9%|▉         | 105/1200 [00:51<08:56,  2.04it/s, loss=0.906, lr=1]
Steps:   9%|▉         | 106/1200 [00:52<08:55,  2.04it/s, loss=0.906, lr=1]
Steps:   9%|▉         | 106/1200 [00:52<08:55,  2.04it/s, loss=0.484, lr=1]
Steps:   9%|▉         | 107/1200 [00:52<08:55,  2.04it/s, loss=0.484, lr=1]
Steps:   9%|▉         | 107/1200 [00:52<08:55,  2.04it/s, loss=0.427, lr=1]
Steps:   9%|▉         | 108/1200 [00:53<08:54,  2.04it/s, loss=0.427, lr=1]
Steps:   9%|▉         | 108/1200 [00:53<08:54,  2.04it/s, loss=0.633, lr=1]
Steps:   9%|▉         | 109/1200 [00:53<08:56,  2.04it/s, loss=0.633, lr=1]
Steps:   9%|▉         | 109/1200 [00:53<08:56,  2.04it/s, loss=0.353, lr=1]
Steps:   9%|▉         | 110/1200 [00:54<08:54,  2.04it/s, loss=0.353, lr=1]
Steps:   9%|▉         | 110/1200 [00:54<08:54,  2.04it/s, loss=0.441, lr=1]
Steps:   9%|▉         | 111/1200 [00:54<08:53,  2.04it/s, loss=0.441, lr=1]
Steps:   9%|▉         | 111/1200 [00:54<08:53,  2.04it/s, loss=0.484, lr=1]
Steps:   9%|▉         | 112/1200 [00:55<08:53,  2.04it/s, loss=0.484, lr=1]
Steps:   9%|▉         | 112/1200 [00:55<08:53,  2.04it/s, loss=0.433, lr=1]
Steps:   9%|▉         | 113/1200 [00:55<08:52,  2.04it/s, loss=0.433, lr=1]
Steps:   9%|▉         | 113/1200 [00:55<08:52,  2.04it/s, loss=0.516, lr=1]
Steps:  10%|▉         | 114/1200 [00:56<08:52,  2.04it/s, loss=0.516, lr=1]
Steps:  10%|▉         | 114/1200 [00:56<08:52,  2.04it/s, loss=0.659, lr=1]
Steps:  10%|▉         | 115/1200 [00:56<08:51,  2.04it/s, loss=0.659, lr=1]
Steps:  10%|▉         | 115/1200 [00:56<08:51,  2.04it/s, loss=0.626, lr=1]
Steps:  10%|▉         | 116/1200 [00:57<08:51,  2.04it/s, loss=0.626, lr=1]
Steps:  10%|▉         | 116/1200 [00:57<08:51,  2.04it/s, loss=0.608, lr=1]
Steps:  10%|▉         | 117/1200 [00:57<08:50,  2.04it/s, loss=0.608, lr=1]
Steps:  10%|▉         | 117/1200 [00:57<08:50,  2.04it/s, loss=0.656, lr=1]
Steps:  10%|▉         | 118/1200 [00:58<08:50,  2.04it/s, loss=0.656, lr=1]
Steps:  10%|▉         | 118/1200 [00:58<08:50,  2.04it/s, loss=0.603, lr=1]
Steps:  10%|▉         | 119/1200 [00:58<08:49,  2.04it/s, loss=0.603, lr=1]
Steps:  10%|▉         | 119/1200 [00:58<08:49,  2.04it/s, loss=1.02, lr=1] 
Steps:  10%|█         | 120/1200 [00:59<08:49,  2.04it/s, loss=1.02, lr=1]
Steps:  10%|█         | 120/1200 [00:59<08:49,  2.04it/s, loss=0.422, lr=1]
Steps:  10%|█         | 121/1200 [00:59<08:50,  2.03it/s, loss=0.422, lr=1]
Steps:  10%|█         | 121/1200 [00:59<08:50,  2.03it/s, loss=0.468, lr=1]
Steps:  10%|█         | 122/1200 [01:00<08:49,  2.03it/s, loss=0.468, lr=1]
Steps:  10%|█         | 122/1200 [01:00<08:49,  2.03it/s, loss=0.645, lr=1]
Steps:  10%|█         | 123/1200 [01:00<08:49,  2.04it/s, loss=0.645, lr=1]
Steps:  10%|█         | 123/1200 [01:00<08:49,  2.04it/s, loss=0.6, lr=1]  
Steps:  10%|█         | 124/1200 [01:01<08:48,  2.04it/s, loss=0.6, lr=1]
Steps:  10%|█         | 124/1200 [01:01<08:48,  2.04it/s, loss=0.333, lr=1]
Steps:  10%|█         | 125/1200 [01:01<08:47,  2.04it/s, loss=0.333, lr=1]
Steps:  10%|█         | 125/1200 [01:01<08:47,  2.04it/s, loss=0.605, lr=1]
Steps:  10%|█         | 126/1200 [01:02<08:46,  2.04it/s, loss=0.605, lr=1]
Steps:  10%|█         | 126/1200 [01:02<08:46,  2.04it/s, loss=0.475, lr=1]
Steps:  11%|█         | 127/1200 [01:02<08:45,  2.04it/s, loss=0.475, lr=1]
Steps:  11%|█         | 127/1200 [01:02<08:45,  2.04it/s, loss=0.406, lr=1]
Steps:  11%|█         | 128/1200 [01:03<08:45,  2.04it/s, loss=0.406, lr=1]
Steps:  11%|█         | 128/1200 [01:03<08:45,  2.04it/s, loss=0.378, lr=1]
Steps:  11%|█         | 129/1200 [01:03<08:44,  2.04it/s, loss=0.378, lr=1]
Steps:  11%|█         | 129/1200 [01:03<08:44,  2.04it/s, loss=0.661, lr=1]
Steps:  11%|█         | 130/1200 [01:04<08:44,  2.04it/s, loss=0.661, lr=1]
Steps:  11%|█         | 130/1200 [01:04<08:44,  2.04it/s, loss=0.439, lr=1]
Steps:  11%|█         | 131/1200 [01:04<08:43,  2.04it/s, loss=0.439, lr=1]
Steps:  11%|█         | 131/1200 [01:04<08:43,  2.04it/s, loss=0.661, lr=1]
Steps:  11%|█         | 132/1200 [01:04<08:42,  2.04it/s, loss=0.661, lr=1]
Steps:  11%|█         | 132/1200 [01:04<08:42,  2.04it/s, loss=0.34, lr=1] 
Steps:  11%|█         | 133/1200 [01:05<08:44,  2.03it/s, loss=0.34, lr=1]
Steps:  11%|█         | 133/1200 [01:05<08:44,  2.03it/s, loss=0.644, lr=1]
Steps:  11%|█         | 134/1200 [01:05<08:43,  2.04it/s, loss=0.644, lr=1]
Steps:  11%|█         | 134/1200 [01:05<08:43,  2.04it/s, loss=0.343, lr=1]
Steps:  11%|█▏        | 135/1200 [01:06<08:42,  2.04it/s, loss=0.343, lr=1]
Steps:  11%|█▏        | 135/1200 [01:06<08:42,  2.04it/s, loss=0.427, lr=1]
Steps:  11%|█▏        | 136/1200 [01:06<08:41,  2.04it/s, loss=0.427, lr=1]
Steps:  11%|█▏        | 136/1200 [01:06<08:41,  2.04it/s, loss=0.345, lr=1]
Steps:  11%|█▏        | 137/1200 [01:07<08:40,  2.04it/s, loss=0.345, lr=1]
Steps:  11%|█▏        | 137/1200 [01:07<08:40,  2.04it/s, loss=0.61, lr=1] 
Steps:  12%|█▏        | 138/1200 [01:07<08:40,  2.04it/s, loss=0.61, lr=1]
Steps:  12%|█▏        | 138/1200 [01:07<08:40,  2.04it/s, loss=0.668, lr=1]
Steps:  12%|█▏        | 139/1200 [01:08<08:40,  2.04it/s, loss=0.668, lr=1]
Steps:  12%|█▏        | 139/1200 [01:08<08:40,  2.04it/s, loss=0.426, lr=1]
Steps:  12%|█▏        | 140/1200 [01:08<08:39,  2.04it/s, loss=0.426, lr=1]
Steps:  12%|█▏        | 140/1200 [01:08<08:39,  2.04it/s, loss=0.315, lr=1]
Steps:  12%|█▏        | 141/1200 [01:09<08:38,  2.04it/s, loss=0.315, lr=1]
Steps:  12%|█▏        | 141/1200 [01:09<08:38,  2.04it/s, loss=0.64, lr=1] 
Steps:  12%|█▏        | 142/1200 [01:09<08:38,  2.04it/s, loss=0.64, lr=1]
Steps:  12%|█▏        | 142/1200 [01:09<08:38,  2.04it/s, loss=0.43, lr=1]
Steps:  12%|█▏        | 143/1200 [01:10<08:37,  2.04it/s, loss=0.43, lr=1]
Steps:  12%|█▏        | 143/1200 [01:10<08:37,  2.04it/s, loss=0.662, lr=1]
Steps:  12%|█▏        | 144/1200 [01:10<08:37,  2.04it/s, loss=0.662, lr=1]
Steps:  12%|█▏        | 144/1200 [01:10<08:37,  2.04it/s, loss=0.419, lr=1]
Steps:  12%|█▏        | 145/1200 [01:11<08:39,  2.03it/s, loss=0.419, lr=1]
Steps:  12%|█▏        | 145/1200 [01:11<08:39,  2.03it/s, loss=0.278, lr=1]
Steps:  12%|█▏        | 146/1200 [01:11<08:38,  2.03it/s, loss=0.278, lr=1]
Steps:  12%|█▏        | 146/1200 [01:11<08:38,  2.03it/s, loss=0.363, lr=1]
Steps:  12%|█▏        | 147/1200 [01:12<08:37,  2.04it/s, loss=0.363, lr=1]
Steps:  12%|█▏        | 147/1200 [01:12<08:37,  2.04it/s, loss=0.343, lr=1]
Steps:  12%|█▏        | 148/1200 [01:12<08:36,  2.04it/s, loss=0.343, lr=1]
Steps:  12%|█▏        | 148/1200 [01:12<08:36,  2.04it/s, loss=0.624, lr=1]
Steps:  12%|█▏        | 149/1200 [01:13<08:35,  2.04it/s, loss=0.624, lr=1]
Steps:  12%|█▏        | 149/1200 [01:13<08:35,  2.04it/s, loss=0.814, lr=1]
Steps:  12%|█▎        | 150/1200 [01:13<08:34,  2.04it/s, loss=0.814, lr=1]
Steps:  12%|█▎        | 150/1200 [01:13<08:34,  2.04it/s, loss=0.875, lr=1]
Steps:  13%|█▎        | 151/1200 [01:14<08:34,  2.04it/s, loss=0.875, lr=1]
Steps:  13%|█▎        | 151/1200 [01:14<08:34,  2.04it/s, loss=0.332, lr=1]
Steps:  13%|█▎        | 152/1200 [01:14<08:33,  2.04it/s, loss=0.332, lr=1]
Steps:  13%|█▎        | 152/1200 [01:14<08:33,  2.04it/s, loss=0.293, lr=1]
Steps:  13%|█▎        | 153/1200 [01:15<08:33,  2.04it/s, loss=0.293, lr=1]
Steps:  13%|█▎        | 153/1200 [01:15<08:33,  2.04it/s, loss=0.339, lr=1]
Steps:  13%|█▎        | 154/1200 [01:15<08:33,  2.04it/s, loss=0.339, lr=1]
Steps:  13%|█▎        | 154/1200 [01:15<08:33,  2.04it/s, loss=0.336, lr=1]
Steps:  13%|█▎        | 155/1200 [01:16<08:32,  2.04it/s, loss=0.336, lr=1]
Steps:  13%|█▎        | 155/1200 [01:16<08:32,  2.04it/s, loss=0.572, lr=1]
Steps:  13%|█▎        | 156/1200 [01:16<08:31,  2.04it/s, loss=0.572, lr=1]
Steps:  13%|█▎        | 156/1200 [01:16<08:31,  2.04it/s, loss=0.528, lr=1]
Steps:  13%|█▎        | 157/1200 [01:17<08:33,  2.03it/s, loss=0.528, lr=1]
Steps:  13%|█▎        | 157/1200 [01:17<08:33,  2.03it/s, loss=1.1, lr=1]  
Steps:  13%|█▎        | 158/1200 [01:17<08:31,  2.04it/s, loss=1.1, lr=1]
Steps:  13%|█▎        | 158/1200 [01:17<08:31,  2.04it/s, loss=0.652, lr=1]
Steps:  13%|█▎        | 159/1200 [01:18<08:30,  2.04it/s, loss=0.652, lr=1]
Steps:  13%|█▎        | 159/1200 [01:18<08:30,  2.04it/s, loss=0.503, lr=1]
Steps:  13%|█▎        | 160/1200 [01:18<08:30,  2.04it/s, loss=0.503, lr=1]
Steps:  13%|█▎        | 160/1200 [01:18<08:30,  2.04it/s, loss=0.389, lr=1]
Steps:  13%|█▎        | 161/1200 [01:19<08:29,  2.04it/s, loss=0.389, lr=1]
Steps:  13%|█▎        | 161/1200 [01:19<08:29,  2.04it/s, loss=0.384, lr=1]
Steps:  14%|█▎        | 162/1200 [01:19<08:28,  2.04it/s, loss=0.384, lr=1]
Steps:  14%|█▎        | 162/1200 [01:19<08:28,  2.04it/s, loss=0.573, lr=1]
Steps:  14%|█▎        | 163/1200 [01:20<08:27,  2.04it/s, loss=0.573, lr=1]
Steps:  14%|█▎        | 163/1200 [01:20<08:27,  2.04it/s, loss=0.673, lr=1]
Steps:  14%|█▎        | 164/1200 [01:20<08:27,  2.04it/s, loss=0.673, lr=1]
Steps:  14%|█▎        | 164/1200 [01:20<08:27,  2.04it/s, loss=0.431, lr=1]
Steps:  14%|█▍        | 165/1200 [01:21<08:26,  2.04it/s, loss=0.431, lr=1]
Steps:  14%|█▍        | 165/1200 [01:21<08:26,  2.04it/s, loss=0.646, lr=1]
Steps:  14%|█▍        | 166/1200 [01:21<08:26,  2.04it/s, loss=0.646, lr=1]
Steps:  14%|█▍        | 166/1200 [01:21<08:26,  2.04it/s, loss=0.581, lr=1]
Steps:  14%|█▍        | 167/1200 [01:22<08:25,  2.04it/s, loss=0.581, lr=1]
Steps:  14%|█▍        | 167/1200 [01:22<08:25,  2.04it/s, loss=0.576, lr=1]
Steps:  14%|█▍        | 168/1200 [01:22<08:25,  2.04it/s, loss=0.576, lr=1]
Steps:  14%|█▍        | 168/1200 [01:22<08:25,  2.04it/s, loss=0.793, lr=1]
Steps:  14%|█▍        | 169/1200 [01:23<08:27,  2.03it/s, loss=0.793, lr=1]
Steps:  14%|█▍        | 169/1200 [01:23<08:27,  2.03it/s, loss=0.793, lr=1]
Steps:  14%|█▍        | 170/1200 [01:23<08:25,  2.04it/s, loss=0.793, lr=1]
Steps:  14%|█▍        | 170/1200 [01:23<08:25,  2.04it/s, loss=0.345, lr=1]
Steps:  14%|█▍        | 171/1200 [01:24<08:25,  2.04it/s, loss=0.345, lr=1]
Steps:  14%|█▍        | 171/1200 [01:24<08:25,  2.04it/s, loss=0.305, lr=1]
Steps:  14%|█▍        | 172/1200 [01:24<08:24,  2.04it/s, loss=0.305, lr=1]
Steps:  14%|█▍        | 172/1200 [01:24<08:24,  2.04it/s, loss=0.334, lr=1]
Steps:  14%|█▍        | 173/1200 [01:25<08:23,  2.04it/s, loss=0.334, lr=1]
Steps:  14%|█▍        | 173/1200 [01:25<08:23,  2.04it/s, loss=0.296, lr=1]
Steps:  14%|█▍        | 174/1200 [01:25<08:23,  2.04it/s, loss=0.296, lr=1]
Steps:  14%|█▍        | 174/1200 [01:25<08:23,  2.04it/s, loss=0.39, lr=1] 
Steps:  15%|█▍        | 175/1200 [01:26<08:22,  2.04it/s, loss=0.39, lr=1]
Steps:  15%|█▍        | 175/1200 [01:26<08:22,  2.04it/s, loss=0.939, lr=1]
Steps:  15%|█▍        | 176/1200 [01:26<08:21,  2.04it/s, loss=0.939, lr=1]
Steps:  15%|█▍        | 176/1200 [01:26<08:21,  2.04it/s, loss=0.605, lr=1]
Steps:  15%|█▍        | 177/1200 [01:27<08:21,  2.04it/s, loss=0.605, lr=1]
Steps:  15%|█▍        | 177/1200 [01:27<08:21,  2.04it/s, loss=0.361, lr=1]
Steps:  15%|█▍        | 178/1200 [01:27<08:20,  2.04it/s, loss=0.361, lr=1]
Steps:  15%|█▍        | 178/1200 [01:27<08:20,  2.04it/s, loss=0.298, lr=1]
Steps:  15%|█▍        | 179/1200 [01:28<08:19,  2.04it/s, loss=0.298, lr=1]
Steps:  15%|█▍        | 179/1200 [01:28<08:19,  2.04it/s, loss=0.691, lr=1]
Steps:  15%|█▌        | 180/1200 [01:28<08:19,  2.04it/s, loss=0.691, lr=1]
Steps:  15%|█▌        | 180/1200 [01:28<08:19,  2.04it/s, loss=0.405, lr=1]
Steps:  15%|█▌        | 181/1200 [01:29<08:21,  2.03it/s, loss=0.405, lr=1]
Steps:  15%|█▌        | 181/1200 [01:29<08:21,  2.03it/s, loss=0.406, lr=1]
Steps:  15%|█▌        | 182/1200 [01:29<08:19,  2.04it/s, loss=0.406, lr=1]
Steps:  15%|█▌        | 182/1200 [01:29<08:19,  2.04it/s, loss=0.398, lr=1]
Steps:  15%|█▌        | 183/1200 [01:30<08:18,  2.04it/s, loss=0.398, lr=1]
Steps:  15%|█▌        | 183/1200 [01:30<08:18,  2.04it/s, loss=0.293, lr=1]
Steps:  15%|█▌        | 184/1200 [01:30<08:18,  2.04it/s, loss=0.293, lr=1]
Steps:  15%|█▌        | 184/1200 [01:30<08:18,  2.04it/s, loss=0.333, lr=1]
Steps:  15%|█▌        | 185/1200 [01:30<08:17,  2.04it/s, loss=0.333, lr=1]
Steps:  15%|█▌        | 185/1200 [01:30<08:17,  2.04it/s, loss=0.367, lr=1]
Steps:  16%|█▌        | 186/1200 [01:31<08:17,  2.04it/s, loss=0.367, lr=1]
Steps:  16%|█▌        | 186/1200 [01:31<08:17,  2.04it/s, loss=0.272, lr=1]
Steps:  16%|█▌        | 187/1200 [01:31<08:16,  2.04it/s, loss=0.272, lr=1]
Steps:  16%|█▌        | 187/1200 [01:31<08:16,  2.04it/s, loss=0.4, lr=1]  
Steps:  16%|█▌        | 188/1200 [01:32<08:16,  2.04it/s, loss=0.4, lr=1]
Steps:  16%|█▌        | 188/1200 [01:32<08:16,  2.04it/s, loss=0.364, lr=1]
Steps:  16%|█▌        | 189/1200 [01:32<08:15,  2.04it/s, loss=0.364, lr=1]
Steps:  16%|█▌        | 189/1200 [01:32<08:15,  2.04it/s, loss=0.3, lr=1]  
Steps:  16%|█▌        | 190/1200 [01:33<08:15,  2.04it/s, loss=0.3, lr=1]
Steps:  16%|█▌        | 190/1200 [01:33<08:15,  2.04it/s, loss=0.784, lr=1]
Steps:  16%|█▌        | 191/1200 [01:33<08:14,  2.04it/s, loss=0.784, lr=1]
Steps:  16%|█▌        | 191/1200 [01:33<08:14,  2.04it/s, loss=0.299, lr=1]
Steps:  16%|█▌        | 192/1200 [01:34<08:14,  2.04it/s, loss=0.299, lr=1]
Steps:  16%|█▌        | 192/1200 [01:34<08:14,  2.04it/s, loss=0.63, lr=1] 
Steps:  16%|█▌        | 193/1200 [01:34<08:16,  2.03it/s, loss=0.63, lr=1]
Steps:  16%|█▌        | 193/1200 [01:34<08:16,  2.03it/s, loss=0.797, lr=1]
Steps:  16%|█▌        | 194/1200 [01:35<08:14,  2.03it/s, loss=0.797, lr=1]
Steps:  16%|█▌        | 194/1200 [01:35<08:14,  2.03it/s, loss=0.707, lr=1]
Steps:  16%|█▋        | 195/1200 [01:35<08:13,  2.04it/s, loss=0.707, lr=1]
Steps:  16%|█▋        | 195/1200 [01:35<08:13,  2.04it/s, loss=0.369, lr=1]
Steps:  16%|█▋        | 196/1200 [01:36<08:12,  2.04it/s, loss=0.369, lr=1]
Steps:  16%|█▋        | 196/1200 [01:36<08:12,  2.04it/s, loss=0.648, lr=1]
Steps:  16%|█▋        | 197/1200 [01:36<08:12,  2.04it/s, loss=0.648, lr=1]
Steps:  16%|█▋        | 197/1200 [01:36<08:12,  2.04it/s, loss=0.599, lr=1]
Steps:  16%|█▋        | 198/1200 [01:37<08:11,  2.04it/s, loss=0.599, lr=1]
Steps:  16%|█▋        | 198/1200 [01:37<08:11,  2.04it/s, loss=0.423, lr=1]
Steps:  17%|█▋        | 199/1200 [01:37<08:11,  2.04it/s, loss=0.423, lr=1]
Steps:  17%|█▋        | 199/1200 [01:37<08:11,  2.04it/s, loss=0.81, lr=1] 
Steps:  17%|█▋        | 200/1200 [01:38<08:10,  2.04it/s, loss=0.81, lr=1]
Steps:  17%|█▋        | 200/1200 [01:38<08:10,  2.04it/s, loss=0.378, lr=1]
Steps:  17%|█▋        | 201/1200 [01:38<08:09,  2.04it/s, loss=0.378, lr=1]
Steps:  17%|█▋        | 201/1200 [01:38<08:09,  2.04it/s, loss=0.522, lr=1]
Steps:  17%|█▋        | 202/1200 [01:39<08:09,  2.04it/s, loss=0.522, lr=1]
Steps:  17%|█▋        | 202/1200 [01:39<08:09,  2.04it/s, loss=0.593, lr=1]
Steps:  17%|█▋        | 203/1200 [01:39<08:08,  2.04it/s, loss=0.593, lr=1]
Steps:  17%|█▋        | 203/1200 [01:39<08:08,  2.04it/s, loss=0.309, lr=1]
Steps:  17%|█▋        | 204/1200 [01:40<08:08,  2.04it/s, loss=0.309, lr=1]
Steps:  17%|█▋        | 204/1200 [01:40<08:08,  2.04it/s, loss=0.312, lr=1]
Steps:  17%|█▋        | 205/1200 [01:40<08:09,  2.03it/s, loss=0.312, lr=1]
Steps:  17%|█▋        | 205/1200 [01:40<08:09,  2.03it/s, loss=0.313, lr=1]
Steps:  17%|█▋        | 206/1200 [01:41<08:08,  2.04it/s, loss=0.313, lr=1]
Steps:  17%|█▋        | 206/1200 [01:41<08:08,  2.04it/s, loss=0.342, lr=1]
Steps:  17%|█▋        | 207/1200 [01:41<08:07,  2.04it/s, loss=0.342, lr=1]
Steps:  17%|█▋        | 207/1200 [01:41<08:07,  2.04it/s, loss=0.568, lr=1]
Steps:  17%|█▋        | 208/1200 [01:42<08:06,  2.04it/s, loss=0.568, lr=1]
Steps:  17%|█▋        | 208/1200 [01:42<08:06,  2.04it/s, loss=0.566, lr=1]
Steps:  17%|█▋        | 209/1200 [01:42<08:05,  2.04it/s, loss=0.566, lr=1]
Steps:  17%|█▋        | 209/1200 [01:42<08:05,  2.04it/s, loss=0.609, lr=1]
Steps:  18%|█▊        | 210/1200 [01:43<08:04,  2.04it/s, loss=0.609, lr=1]
Steps:  18%|█▊        | 210/1200 [01:43<08:04,  2.04it/s, loss=0.561, lr=1]
Steps:  18%|█▊        | 211/1200 [01:43<08:04,  2.04it/s, loss=0.561, lr=1]
Steps:  18%|█▊        | 211/1200 [01:43<08:04,  2.04it/s, loss=0.268, lr=1]
Steps:  18%|█▊        | 212/1200 [01:44<08:03,  2.04it/s, loss=0.268, lr=1]
Steps:  18%|█▊        | 212/1200 [01:44<08:03,  2.04it/s, loss=0.53, lr=1] 
Steps:  18%|█▊        | 213/1200 [01:44<08:02,  2.04it/s, loss=0.53, lr=1]
Steps:  18%|█▊        | 213/1200 [01:44<08:02,  2.04it/s, loss=0.477, lr=1]
Steps:  18%|█▊        | 214/1200 [01:45<08:02,  2.04it/s, loss=0.477, lr=1]
Steps:  18%|█▊        | 214/1200 [01:45<08:02,  2.04it/s, loss=0.655, lr=1]
Steps:  18%|█▊        | 215/1200 [01:45<08:02,  2.04it/s, loss=0.655, lr=1]
Steps:  18%|█▊        | 215/1200 [01:45<08:02,  2.04it/s, loss=0.642, lr=1]
Steps:  18%|█▊        | 216/1200 [01:46<08:01,  2.04it/s, loss=0.642, lr=1]
Steps:  18%|█▊        | 216/1200 [01:46<08:01,  2.04it/s, loss=0.655, lr=1]
Steps:  18%|█▊        | 217/1200 [01:46<08:03,  2.03it/s, loss=0.655, lr=1]
Steps:  18%|█▊        | 217/1200 [01:46<08:03,  2.03it/s, loss=0.538, lr=1]
Steps:  18%|█▊        | 218/1200 [01:47<08:01,  2.04it/s, loss=0.538, lr=1]
Steps:  18%|█▊        | 218/1200 [01:47<08:01,  2.04it/s, loss=0.291, lr=1]
Steps:  18%|█▊        | 219/1200 [01:47<08:01,  2.04it/s, loss=0.291, lr=1]
Steps:  18%|█▊        | 219/1200 [01:47<08:01,  2.04it/s, loss=0.554, lr=1]
Steps:  18%|█▊        | 220/1200 [01:48<08:00,  2.04it/s, loss=0.554, lr=1]
Steps:  18%|█▊        | 220/1200 [01:48<08:00,  2.04it/s, loss=0.369, lr=1]
Steps:  18%|█▊        | 221/1200 [01:48<08:00,  2.04it/s, loss=0.369, lr=1]
Steps:  18%|█▊        | 221/1200 [01:48<08:00,  2.04it/s, loss=0.398, lr=1]
Steps:  18%|█▊        | 222/1200 [01:49<07:59,  2.04it/s, loss=0.398, lr=1]
Steps:  18%|█▊        | 222/1200 [01:49<07:59,  2.04it/s, loss=0.327, lr=1]
Steps:  19%|█▊        | 223/1200 [01:49<07:58,  2.04it/s, loss=0.327, lr=1]
Steps:  19%|█▊        | 223/1200 [01:49<07:58,  2.04it/s, loss=0.379, lr=1]
Steps:  19%|█▊        | 224/1200 [01:50<07:57,  2.04it/s, loss=0.379, lr=1]
Steps:  19%|█▊        | 224/1200 [01:50<07:57,  2.04it/s, loss=0.597, lr=1]
Steps:  19%|█▉        | 225/1200 [01:50<07:57,  2.04it/s, loss=0.597, lr=1]
Steps:  19%|█▉        | 225/1200 [01:50<07:57,  2.04it/s, loss=0.677, lr=1]
Steps:  19%|█▉        | 226/1200 [01:51<07:56,  2.04it/s, loss=0.677, lr=1]
Steps:  19%|█▉        | 226/1200 [01:51<07:56,  2.04it/s, loss=0.595, lr=1]
Steps:  19%|█▉        | 227/1200 [01:51<07:56,  2.04it/s, loss=0.595, lr=1]
Steps:  19%|█▉        | 227/1200 [01:51<07:56,  2.04it/s, loss=0.404, lr=1]
Steps:  19%|█▉        | 228/1200 [01:52<07:55,  2.04it/s, loss=0.404, lr=1]
Steps:  19%|█▉        | 228/1200 [01:52<07:55,  2.04it/s, loss=0.314, lr=1]
Steps:  19%|█▉        | 229/1200 [01:52<07:57,  2.03it/s, loss=0.314, lr=1]
Steps:  19%|█▉        | 229/1200 [01:52<07:57,  2.03it/s, loss=0.417, lr=1]
Steps:  19%|█▉        | 230/1200 [01:53<07:55,  2.04it/s, loss=0.417, lr=1]
Steps:  19%|█▉        | 230/1200 [01:53<07:55,  2.04it/s, loss=0.36, lr=1] 
Steps:  19%|█▉        | 231/1200 [01:53<07:54,  2.04it/s, loss=0.36, lr=1]
Steps:  19%|█▉        | 231/1200 [01:53<07:54,  2.04it/s, loss=0.333, lr=1]
Steps:  19%|█▉        | 232/1200 [01:54<07:54,  2.04it/s, loss=0.333, lr=1]
Steps:  19%|█▉        | 232/1200 [01:54<07:54,  2.04it/s, loss=0.29, lr=1] 
Steps:  19%|█▉        | 233/1200 [01:54<07:53,  2.04it/s, loss=0.29, lr=1]
Steps:  19%|█▉        | 233/1200 [01:54<07:53,  2.04it/s, loss=0.312, lr=1]
Steps:  20%|█▉        | 234/1200 [01:55<07:52,  2.04it/s, loss=0.312, lr=1]
Steps:  20%|█▉        | 234/1200 [01:55<07:52,  2.04it/s, loss=0.507, lr=1]
Steps:  20%|█▉        | 235/1200 [01:55<07:52,  2.04it/s, loss=0.507, lr=1]
Steps:  20%|█▉        | 235/1200 [01:55<07:52,  2.04it/s, loss=0.324, lr=1]
Steps:  20%|█▉        | 236/1200 [01:55<07:51,  2.04it/s, loss=0.324, lr=1]
Steps:  20%|█▉        | 236/1200 [01:55<07:51,  2.04it/s, loss=0.311, lr=1]
Steps:  20%|█▉        | 237/1200 [01:56<07:51,  2.04it/s, loss=0.311, lr=1]
Steps:  20%|█▉        | 237/1200 [01:56<07:51,  2.04it/s, loss=0.357, lr=1]
Steps:  20%|█▉        | 238/1200 [01:56<07:51,  2.04it/s, loss=0.357, lr=1]
Steps:  20%|█▉        | 238/1200 [01:56<07:51,  2.04it/s, loss=0.323, lr=1]
Steps:  20%|█▉        | 239/1200 [01:57<07:51,  2.04it/s, loss=0.323, lr=1]
Steps:  20%|█▉        | 239/1200 [01:57<07:51,  2.04it/s, loss=0.647, lr=1]
Steps:  20%|██        | 240/1200 [01:57<07:50,  2.04it/s, loss=0.647, lr=1]
Steps:  20%|██        | 240/1200 [01:57<07:50,  2.04it/s, loss=0.279, lr=1]
Steps:  20%|██        | 241/1200 [01:58<07:52,  2.03it/s, loss=0.279, lr=1]
Steps:  20%|██        | 241/1200 [01:58<07:52,  2.03it/s, loss=0.295, lr=1]
Steps:  20%|██        | 242/1200 [01:58<07:50,  2.03it/s, loss=0.295, lr=1]
Steps:  20%|██        | 242/1200 [01:58<07:50,  2.03it/s, loss=0.295, lr=1]
Steps:  20%|██        | 243/1200 [01:59<07:49,  2.04it/s, loss=0.295, lr=1]
Steps:  20%|██        | 243/1200 [01:59<07:49,  2.04it/s, loss=0.88, lr=1] 
Steps:  20%|██        | 244/1200 [01:59<07:49,  2.04it/s, loss=0.88, lr=1]
Steps:  20%|██        | 244/1200 [01:59<07:49,  2.04it/s, loss=0.362, lr=1]
Steps:  20%|██        | 245/1200 [02:00<07:48,  2.04it/s, loss=0.362, lr=1]
Steps:  20%|██        | 245/1200 [02:00<07:48,  2.04it/s, loss=0.403, lr=1]
Steps:  20%|██        | 246/1200 [02:00<07:47,  2.04it/s, loss=0.403, lr=1]
Steps:  20%|██        | 246/1200 [02:00<07:47,  2.04it/s, loss=0.493, lr=1]
Steps:  21%|██        | 247/1200 [02:01<07:47,  2.04it/s, loss=0.493, lr=1]
Steps:  21%|██        | 247/1200 [02:01<07:47,  2.04it/s, loss=0.77, lr=1] 
Steps:  21%|██        | 248/1200 [02:01<07:46,  2.04it/s, loss=0.77, lr=1]
Steps:  21%|██        | 248/1200 [02:01<07:46,  2.04it/s, loss=0.734, lr=1]
Steps:  21%|██        | 249/1200 [02:02<07:46,  2.04it/s, loss=0.734, lr=1]
Steps:  21%|██        | 249/1200 [02:02<07:46,  2.04it/s, loss=0.296, lr=1]
Steps:  21%|██        | 250/1200 [02:02<07:46,  2.04it/s, loss=0.296, lr=1]
Steps:  21%|██        | 250/1200 [02:02<07:46,  2.04it/s, loss=0.599, lr=1]
Steps:  21%|██        | 251/1200 [02:03<07:45,  2.04it/s, loss=0.599, lr=1]
Steps:  21%|██        | 251/1200 [02:03<07:45,  2.04it/s, loss=0.792, lr=1]
Steps:  21%|██        | 252/1200 [02:03<07:45,  2.04it/s, loss=0.792, lr=1]
Steps:  21%|██        | 252/1200 [02:03<07:45,  2.04it/s, loss=0.636, lr=1]
Steps:  21%|██        | 253/1200 [02:04<07:48,  2.02it/s, loss=0.636, lr=1]
Steps:  21%|██        | 253/1200 [02:04<07:48,  2.02it/s, loss=0.303, lr=1]
Steps:  21%|██        | 254/1200 [02:04<07:47,  2.03it/s, loss=0.303, lr=1]
Steps:  21%|██        | 254/1200 [02:04<07:47,  2.03it/s, loss=0.597, lr=1]
Steps:  21%|██▏       | 255/1200 [02:05<07:45,  2.03it/s, loss=0.597, lr=1]
Steps:  21%|██▏       | 255/1200 [02:05<07:45,  2.03it/s, loss=0.587, lr=1]
Steps:  21%|██▏       | 256/1200 [02:05<07:44,  2.03it/s, loss=0.587, lr=1]
Steps:  21%|██▏       | 256/1200 [02:05<07:44,  2.03it/s, loss=0.391, lr=1]
Steps:  21%|██▏       | 257/1200 [02:06<07:43,  2.03it/s, loss=0.391, lr=1]
Steps:  21%|██▏       | 257/1200 [02:06<07:43,  2.03it/s, loss=0.389, lr=1]
Steps:  22%|██▏       | 258/1200 [02:06<07:42,  2.04it/s, loss=0.389, lr=1]
Steps:  22%|██▏       | 258/1200 [02:06<07:42,  2.04it/s, loss=0.786, lr=1]
Steps:  22%|██▏       | 259/1200 [02:07<07:42,  2.04it/s, loss=0.786, lr=1]
Steps:  22%|██▏       | 259/1200 [02:07<07:42,  2.04it/s, loss=0.778, lr=1]
Steps:  22%|██▏       | 260/1200 [02:07<07:41,  2.04it/s, loss=0.778, lr=1]
Steps:  22%|██▏       | 260/1200 [02:07<07:41,  2.04it/s, loss=0.331, lr=1]
Steps:  22%|██▏       | 261/1200 [02:08<07:40,  2.04it/s, loss=0.331, lr=1]
Steps:  22%|██▏       | 261/1200 [02:08<07:40,  2.04it/s, loss=0.326, lr=1]
Steps:  22%|██▏       | 262/1200 [02:08<07:40,  2.04it/s, loss=0.326, lr=1]
Steps:  22%|██▏       | 262/1200 [02:08<07:40,  2.04it/s, loss=0.63, lr=1] 
Steps:  22%|██▏       | 263/1200 [02:09<08:21,  1.87it/s, loss=0.63, lr=1]
Steps:  22%|██▏       | 263/1200 [02:09<08:21,  1.87it/s, loss=0.464, lr=1]
Steps:  22%|██▏       | 264/1200 [02:09<08:08,  1.92it/s, loss=0.464, lr=1]
Steps:  22%|██▏       | 264/1200 [02:09<08:08,  1.92it/s, loss=0.96, lr=1] 
Steps:  22%|██▏       | 265/1200 [02:10<08:01,  1.94it/s, loss=0.96, lr=1]
Steps:  22%|██▏       | 265/1200 [02:10<08:01,  1.94it/s, loss=0.335, lr=1]
Steps:  22%|██▏       | 266/1200 [02:10<07:54,  1.97it/s, loss=0.335, lr=1]
Steps:  22%|██▏       | 266/1200 [02:10<07:54,  1.97it/s, loss=0.794, lr=1]
Steps:  22%|██▏       | 267/1200 [02:11<07:49,  1.99it/s, loss=0.794, lr=1]
Steps:  22%|██▏       | 267/1200 [02:11<07:49,  1.99it/s, loss=0.604, lr=1]
Steps:  22%|██▏       | 268/1200 [02:11<07:45,  2.00it/s, loss=0.604, lr=1]
Steps:  22%|██▏       | 268/1200 [02:11<07:45,  2.00it/s, loss=0.327, lr=1]
Steps:  22%|██▏       | 269/1200 [02:12<07:42,  2.01it/s, loss=0.327, lr=1]
Steps:  22%|██▏       | 269/1200 [02:12<07:42,  2.01it/s, loss=0.646, lr=1]
Steps:  22%|██▎       | 270/1200 [02:12<07:40,  2.02it/s, loss=0.646, lr=1]
Steps:  22%|██▎       | 270/1200 [02:12<07:40,  2.02it/s, loss=0.317, lr=1]
Steps:  23%|██▎       | 271/1200 [02:13<07:39,  2.02it/s, loss=0.317, lr=1]
Steps:  23%|██▎       | 271/1200 [02:13<07:39,  2.02it/s, loss=0.588, lr=1]
Steps:  23%|██▎       | 272/1200 [02:13<07:37,  2.03it/s, loss=0.588, lr=1]
Steps:  23%|██▎       | 272/1200 [02:13<07:37,  2.03it/s, loss=0.404, lr=1]
Steps:  23%|██▎       | 273/1200 [02:14<07:37,  2.03it/s, loss=0.404, lr=1]
Steps:  23%|██▎       | 273/1200 [02:14<07:37,  2.03it/s, loss=0.773, lr=1]
Steps:  23%|██▎       | 274/1200 [02:14<07:36,  2.03it/s, loss=0.773, lr=1]
Steps:  23%|██▎       | 274/1200 [02:14<07:36,  2.03it/s, loss=0.607, lr=1]
Steps:  23%|██▎       | 275/1200 [02:15<07:35,  2.03it/s, loss=0.607, lr=1]
Steps:  23%|██▎       | 275/1200 [02:15<07:35,  2.03it/s, loss=0.592, lr=1]
Steps:  23%|██▎       | 276/1200 [02:15<07:34,  2.03it/s, loss=0.592, lr=1]
Steps:  23%|██▎       | 276/1200 [02:15<07:34,  2.03it/s, loss=0.353, lr=1]
Steps:  23%|██▎       | 277/1200 [02:16<07:36,  2.02it/s, loss=0.353, lr=1]
Steps:  23%|██▎       | 277/1200 [02:16<07:36,  2.02it/s, loss=0.955, lr=1]
Steps:  23%|██▎       | 278/1200 [02:16<07:34,  2.03it/s, loss=0.955, lr=1]
Steps:  23%|██▎       | 278/1200 [02:16<07:34,  2.03it/s, loss=0.788, lr=1]
Steps:  23%|██▎       | 279/1200 [02:17<07:33,  2.03it/s, loss=0.788, lr=1]
Steps:  23%|██▎       | 279/1200 [02:17<07:33,  2.03it/s, loss=0.691, lr=1]
Steps:  23%|██▎       | 280/1200 [02:17<07:32,  2.03it/s, loss=0.691, lr=1]
Steps:  23%|██▎       | 280/1200 [02:17<07:32,  2.03it/s, loss=0.323, lr=1]
Steps:  23%|██▎       | 281/1200 [02:18<07:31,  2.03it/s, loss=0.323, lr=1]
Steps:  23%|██▎       | 281/1200 [02:18<07:31,  2.03it/s, loss=0.471, lr=1]
Steps:  24%|██▎       | 282/1200 [02:18<07:31,  2.03it/s, loss=0.471, lr=1]
Steps:  24%|██▎       | 282/1200 [02:18<07:31,  2.03it/s, loss=0.868, lr=1]
Steps:  24%|██▎       | 283/1200 [02:19<07:30,  2.04it/s, loss=0.868, lr=1]
Steps:  24%|██▎       | 283/1200 [02:19<07:30,  2.04it/s, loss=0.917, lr=1]
Steps:  24%|██▎       | 284/1200 [02:19<07:29,  2.04it/s, loss=0.917, lr=1]
Steps:  24%|██▎       | 284/1200 [02:19<07:29,  2.04it/s, loss=0.64, lr=1] 
Steps:  24%|██▍       | 285/1200 [02:20<07:29,  2.04it/s, loss=0.64, lr=1]
Steps:  24%|██▍       | 285/1200 [02:20<07:29,  2.04it/s, loss=0.307, lr=1]
Steps:  24%|██▍       | 286/1200 [02:20<07:28,  2.04it/s, loss=0.307, lr=1]
Steps:  24%|██▍       | 286/1200 [02:20<07:28,  2.04it/s, loss=0.273, lr=1]
Steps:  24%|██▍       | 287/1200 [02:21<07:27,  2.04it/s, loss=0.273, lr=1]
Steps:  24%|██▍       | 287/1200 [02:21<07:27,  2.04it/s, loss=0.805, lr=1]
Steps:  24%|██▍       | 288/1200 [02:21<07:27,  2.04it/s, loss=0.805, lr=1]
Steps:  24%|██▍       | 288/1200 [02:21<07:27,  2.04it/s, loss=0.618, lr=1]
Steps:  24%|██▍       | 289/1200 [02:22<07:28,  2.03it/s, loss=0.618, lr=1]
Steps:  24%|██▍       | 289/1200 [02:22<07:28,  2.03it/s, loss=0.297, lr=1]
Steps:  24%|██▍       | 290/1200 [02:22<07:27,  2.03it/s, loss=0.297, lr=1]
Steps:  24%|██▍       | 290/1200 [02:22<07:27,  2.03it/s, loss=0.645, lr=1]
Steps:  24%|██▍       | 291/1200 [02:23<07:26,  2.03it/s, loss=0.645, lr=1]
Steps:  24%|██▍       | 291/1200 [02:23<07:26,  2.03it/s, loss=0.318, lr=1]
Steps:  24%|██▍       | 292/1200 [02:23<07:26,  2.04it/s, loss=0.318, lr=1]
Steps:  24%|██▍       | 292/1200 [02:23<07:26,  2.04it/s, loss=0.294, lr=1]
Steps:  24%|██▍       | 293/1200 [02:24<07:25,  2.04it/s, loss=0.294, lr=1]
Steps:  24%|██▍       | 293/1200 [02:24<07:25,  2.04it/s, loss=0.33, lr=1] 
Steps:  24%|██▍       | 294/1200 [02:24<07:24,  2.04it/s, loss=0.33, lr=1]
Steps:  24%|██▍       | 294/1200 [02:24<07:24,  2.04it/s, loss=0.786, lr=1]
Steps:  25%|██▍       | 295/1200 [02:25<07:24,  2.04it/s, loss=0.786, lr=1]
Steps:  25%|██▍       | 295/1200 [02:25<07:24,  2.04it/s, loss=0.945, lr=1]
Steps:  25%|██▍       | 296/1200 [02:25<07:23,  2.04it/s, loss=0.945, lr=1]
Steps:  25%|██▍       | 296/1200 [02:25<07:23,  2.04it/s, loss=0.372, lr=1]
Steps:  25%|██▍       | 297/1200 [02:26<07:23,  2.04it/s, loss=0.372, lr=1]
Steps:  25%|██▍       | 297/1200 [02:26<07:23,  2.04it/s, loss=0.384, lr=1]
Steps:  25%|██▍       | 298/1200 [02:26<07:22,  2.04it/s, loss=0.384, lr=1]
Steps:  25%|██▍       | 298/1200 [02:26<07:22,  2.04it/s, loss=0.313, lr=1]
Steps:  25%|██▍       | 299/1200 [02:27<07:21,  2.04it/s, loss=0.313, lr=1]
Steps:  25%|██▍       | 299/1200 [02:27<07:21,  2.04it/s, loss=0.351, lr=1]
Steps:  25%|██▌       | 300/1200 [02:27<07:21,  2.04it/s, loss=0.351, lr=1]
Steps:  25%|██▌       | 300/1200 [02:27<07:21,  2.04it/s, loss=0.782, lr=1]
Steps:  25%|██▌       | 301/1200 [02:28<07:22,  2.03it/s, loss=0.782, lr=1]
Steps:  25%|██▌       | 301/1200 [02:28<07:22,  2.03it/s, loss=0.558, lr=1]
Steps:  25%|██▌       | 302/1200 [02:28<07:21,  2.03it/s, loss=0.558, lr=1]
Steps:  25%|██▌       | 302/1200 [02:28<07:21,  2.03it/s, loss=0.4, lr=1]  
Steps:  25%|██▌       | 303/1200 [02:29<07:20,  2.03it/s, loss=0.4, lr=1]
Steps:  25%|██▌       | 303/1200 [02:29<07:20,  2.03it/s, loss=0.31, lr=1]
Steps:  25%|██▌       | 304/1200 [02:29<07:20,  2.04it/s, loss=0.31, lr=1]
Steps:  25%|██▌       | 304/1200 [02:29<07:20,  2.04it/s, loss=0.499, lr=1]
Steps:  25%|██▌       | 305/1200 [02:30<07:19,  2.04it/s, loss=0.499, lr=1]
Steps:  25%|██▌       | 305/1200 [02:30<07:19,  2.04it/s, loss=0.503, lr=1]
Steps:  26%|██▌       | 306/1200 [02:30<07:18,  2.04it/s, loss=0.503, lr=1]
Steps:  26%|██▌       | 306/1200 [02:30<07:18,  2.04it/s, loss=0.353, lr=1]
Steps:  26%|██▌       | 307/1200 [02:31<07:18,  2.04it/s, loss=0.353, lr=1]
Steps:  26%|██▌       | 307/1200 [02:31<07:18,  2.04it/s, loss=0.49, lr=1] 
Steps:  26%|██▌       | 308/1200 [02:31<07:17,  2.04it/s, loss=0.49, lr=1]
Steps:  26%|██▌       | 308/1200 [02:31<07:17,  2.04it/s, loss=0.623, lr=1]
Steps:  26%|██▌       | 309/1200 [02:32<07:16,  2.04it/s, loss=0.623, lr=1]
Steps:  26%|██▌       | 309/1200 [02:32<07:16,  2.04it/s, loss=0.265, lr=1]
Steps:  26%|██▌       | 310/1200 [02:32<07:16,  2.04it/s, loss=0.265, lr=1]
Steps:  26%|██▌       | 310/1200 [02:32<07:16,  2.04it/s, loss=0.639, lr=1]
Steps:  26%|██▌       | 311/1200 [02:32<07:15,  2.04it/s, loss=0.639, lr=1]
Steps:  26%|██▌       | 311/1200 [02:32<07:15,  2.04it/s, loss=0.367, lr=1]
Steps:  26%|██▌       | 312/1200 [02:33<07:15,  2.04it/s, loss=0.367, lr=1]
Steps:  26%|██▌       | 312/1200 [02:33<07:15,  2.04it/s, loss=0.362, lr=1]
Steps:  26%|██▌       | 313/1200 [02:33<07:16,  2.03it/s, loss=0.362, lr=1]
Steps:  26%|██▌       | 313/1200 [02:33<07:16,  2.03it/s, loss=0.757, lr=1]
Steps:  26%|██▌       | 314/1200 [02:34<07:15,  2.03it/s, loss=0.757, lr=1]
Steps:  26%|██▌       | 314/1200 [02:34<07:15,  2.03it/s, loss=0.379, lr=1]
Steps:  26%|██▋       | 315/1200 [02:34<07:14,  2.04it/s, loss=0.379, lr=1]
Steps:  26%|██▋       | 315/1200 [02:34<07:14,  2.04it/s, loss=0.377, lr=1]
Steps:  26%|██▋       | 316/1200 [02:35<07:14,  2.04it/s, loss=0.377, lr=1]
Steps:  26%|██▋       | 316/1200 [02:35<07:14,  2.04it/s, loss=0.604, lr=1]
Steps:  26%|██▋       | 317/1200 [02:35<07:13,  2.04it/s, loss=0.604, lr=1]
Steps:  26%|██▋       | 317/1200 [02:35<07:13,  2.04it/s, loss=0.32, lr=1] 
Steps:  26%|██▋       | 318/1200 [02:36<07:12,  2.04it/s, loss=0.32, lr=1]
Steps:  26%|██▋       | 318/1200 [02:36<07:12,  2.04it/s, loss=0.515, lr=1]
Steps:  27%|██▋       | 319/1200 [02:36<07:12,  2.04it/s, loss=0.515, lr=1]
Steps:  27%|██▋       | 319/1200 [02:36<07:12,  2.04it/s, loss=0.522, lr=1]
Steps:  27%|██▋       | 320/1200 [02:37<07:11,  2.04it/s, loss=0.522, lr=1]
Steps:  27%|██▋       | 320/1200 [02:37<07:11,  2.04it/s, loss=0.916, lr=1]
Steps:  27%|██▋       | 321/1200 [02:37<07:11,  2.04it/s, loss=0.916, lr=1]
Steps:  27%|██▋       | 321/1200 [02:37<07:11,  2.04it/s, loss=0.334, lr=1]
Steps:  27%|██▋       | 322/1200 [02:38<07:11,  2.04it/s, loss=0.334, lr=1]
Steps:  27%|██▋       | 322/1200 [02:38<07:11,  2.04it/s, loss=0.638, lr=1]
Steps:  27%|██▋       | 323/1200 [02:38<07:10,  2.04it/s, loss=0.638, lr=1]
Steps:  27%|██▋       | 323/1200 [02:38<07:10,  2.04it/s, loss=0.361, lr=1]
Steps:  27%|██▋       | 324/1200 [02:39<07:10,  2.04it/s, loss=0.361, lr=1]
Steps:  27%|██▋       | 324/1200 [02:39<07:10,  2.04it/s, loss=0.408, lr=1]
Steps:  27%|██▋       | 325/1200 [02:39<07:11,  2.03it/s, loss=0.408, lr=1]
Steps:  27%|██▋       | 325/1200 [02:39<07:11,  2.03it/s, loss=0.41, lr=1] 
Steps:  27%|██▋       | 326/1200 [02:40<07:10,  2.03it/s, loss=0.41, lr=1]
Steps:  27%|██▋       | 326/1200 [02:40<07:10,  2.03it/s, loss=0.402, lr=1]
Steps:  27%|██▋       | 327/1200 [02:40<07:09,  2.03it/s, loss=0.402, lr=1]
Steps:  27%|██▋       | 327/1200 [02:40<07:09,  2.03it/s, loss=0.636, lr=1]
Steps:  27%|██▋       | 328/1200 [02:41<07:08,  2.03it/s, loss=0.636, lr=1]
Steps:  27%|██▋       | 328/1200 [02:41<07:08,  2.03it/s, loss=0.687, lr=1]
Steps:  27%|██▋       | 329/1200 [02:41<07:07,  2.04it/s, loss=0.687, lr=1]
Steps:  27%|██▋       | 329/1200 [02:41<07:07,  2.04it/s, loss=0.46, lr=1] 
Steps:  28%|██▊       | 330/1200 [02:42<07:07,  2.04it/s, loss=0.46, lr=1]
Steps:  28%|██▊       | 330/1200 [02:42<07:07,  2.04it/s, loss=0.369, lr=1]
Steps:  28%|██▊       | 331/1200 [02:42<07:06,  2.04it/s, loss=0.369, lr=1]
Steps:  28%|██▊       | 331/1200 [02:42<07:06,  2.04it/s, loss=0.599, lr=1]
Steps:  28%|██▊       | 332/1200 [02:43<07:05,  2.04it/s, loss=0.599, lr=1]
Steps:  28%|██▊       | 332/1200 [02:43<07:05,  2.04it/s, loss=0.332, lr=1]
Steps:  28%|██▊       | 333/1200 [02:43<07:05,  2.04it/s, loss=0.332, lr=1]
Steps:  28%|██▊       | 333/1200 [02:43<07:05,  2.04it/s, loss=0.634, lr=1]
Steps:  28%|██▊       | 334/1200 [02:44<07:04,  2.04it/s, loss=0.634, lr=1]
Steps:  28%|██▊       | 334/1200 [02:44<07:04,  2.04it/s, loss=0.381, lr=1]
Steps:  28%|██▊       | 335/1200 [02:44<07:04,  2.04it/s, loss=0.381, lr=1]
Steps:  28%|██▊       | 335/1200 [02:44<07:04,  2.04it/s, loss=0.544, lr=1]
Steps:  28%|██▊       | 336/1200 [02:45<07:03,  2.04it/s, loss=0.544, lr=1]
Steps:  28%|██▊       | 336/1200 [02:45<07:03,  2.04it/s, loss=0.356, lr=1]
Steps:  28%|██▊       | 337/1200 [02:45<07:05,  2.03it/s, loss=0.356, lr=1]
Steps:  28%|██▊       | 337/1200 [02:45<07:05,  2.03it/s, loss=0.477, lr=1]
Steps:  28%|██▊       | 338/1200 [02:46<07:04,  2.03it/s, loss=0.477, lr=1]
Steps:  28%|██▊       | 338/1200 [02:46<07:04,  2.03it/s, loss=0.572, lr=1]
Steps:  28%|██▊       | 339/1200 [02:46<07:03,  2.03it/s, loss=0.572, lr=1]
Steps:  28%|██▊       | 339/1200 [02:46<07:03,  2.03it/s, loss=0.347, lr=1]
Steps:  28%|██▊       | 340/1200 [02:47<07:02,  2.03it/s, loss=0.347, lr=1]
Steps:  28%|██▊       | 340/1200 [02:47<07:02,  2.03it/s, loss=0.309, lr=1]
Steps:  28%|██▊       | 341/1200 [02:47<07:01,  2.04it/s, loss=0.309, lr=1]
Steps:  28%|██▊       | 341/1200 [02:47<07:01,  2.04it/s, loss=0.286, lr=1]
Steps:  28%|██▊       | 342/1200 [02:48<07:01,  2.04it/s, loss=0.286, lr=1]
Steps:  28%|██▊       | 342/1200 [02:48<07:01,  2.04it/s, loss=0.608, lr=1]
Steps:  29%|██▊       | 343/1200 [02:48<07:00,  2.04it/s, loss=0.608, lr=1]
Steps:  29%|██▊       | 343/1200 [02:48<07:00,  2.04it/s, loss=0.523, lr=1]
Steps:  29%|██▊       | 344/1200 [02:49<06:59,  2.04it/s, loss=0.523, lr=1]
Steps:  29%|██▊       | 344/1200 [02:49<06:59,  2.04it/s, loss=0.592, lr=1]
Steps:  29%|██▉       | 345/1200 [02:49<06:59,  2.04it/s, loss=0.592, lr=1]
Steps:  29%|██▉       | 345/1200 [02:49<06:59,  2.04it/s, loss=0.302, lr=1]
Steps:  29%|██▉       | 346/1200 [02:50<06:58,  2.04it/s, loss=0.302, lr=1]
Steps:  29%|██▉       | 346/1200 [02:50<06:58,  2.04it/s, loss=0.607, lr=1]
Steps:  29%|██▉       | 347/1200 [02:50<06:58,  2.04it/s, loss=0.607, lr=1]
Steps:  29%|██▉       | 347/1200 [02:50<06:58,  2.04it/s, loss=0.671, lr=1]
Steps:  29%|██▉       | 348/1200 [02:51<06:57,  2.04it/s, loss=0.671, lr=1]
Steps:  29%|██▉       | 348/1200 [02:51<06:57,  2.04it/s, loss=0.308, lr=1]
Steps:  29%|██▉       | 349/1200 [02:51<06:59,  2.03it/s, loss=0.308, lr=1]
Steps:  29%|██▉       | 349/1200 [02:51<06:59,  2.03it/s, loss=0.616, lr=1]
Steps:  29%|██▉       | 350/1200 [02:52<06:58,  2.03it/s, loss=0.616, lr=1]
Steps:  29%|██▉       | 350/1200 [02:52<06:58,  2.03it/s, loss=0.327, lr=1]
Steps:  29%|██▉       | 351/1200 [02:52<06:57,  2.03it/s, loss=0.327, lr=1]
Steps:  29%|██▉       | 351/1200 [02:52<06:57,  2.03it/s, loss=0.323, lr=1]
Steps:  29%|██▉       | 352/1200 [02:53<06:56,  2.04it/s, loss=0.323, lr=1]
Steps:  29%|██▉       | 352/1200 [02:53<06:56,  2.04it/s, loss=0.425, lr=1]
Steps:  29%|██▉       | 353/1200 [02:53<06:56,  2.04it/s, loss=0.425, lr=1]
Steps:  29%|██▉       | 353/1200 [02:53<06:56,  2.04it/s, loss=0.438, lr=1]
Steps:  30%|██▉       | 354/1200 [02:54<06:55,  2.04it/s, loss=0.438, lr=1]
Steps:  30%|██▉       | 354/1200 [02:54<06:55,  2.04it/s, loss=0.383, lr=1]
Steps:  30%|██▉       | 355/1200 [02:54<06:55,  2.03it/s, loss=0.383, lr=1]
Steps:  30%|██▉       | 355/1200 [02:54<06:55,  2.03it/s, loss=0.591, lr=1]
Steps:  30%|██▉       | 356/1200 [02:55<06:54,  2.04it/s, loss=0.591, lr=1]
Steps:  30%|██▉       | 356/1200 [02:55<06:54,  2.04it/s, loss=1.06, lr=1] 
Steps:  30%|██▉       | 357/1200 [02:55<06:54,  2.04it/s, loss=1.06, lr=1]
Steps:  30%|██▉       | 357/1200 [02:55<06:54,  2.04it/s, loss=0.631, lr=1]
Steps:  30%|██▉       | 358/1200 [02:56<06:53,  2.04it/s, loss=0.631, lr=1]
Steps:  30%|██▉       | 358/1200 [02:56<06:53,  2.04it/s, loss=0.646, lr=1]
Steps:  30%|██▉       | 359/1200 [02:56<06:52,  2.04it/s, loss=0.646, lr=1]
Steps:  30%|██▉       | 359/1200 [02:56<06:52,  2.04it/s, loss=0.473, lr=1]
Steps:  30%|███       | 360/1200 [02:57<06:52,  2.04it/s, loss=0.473, lr=1]
Steps:  30%|███       | 360/1200 [02:57<06:52,  2.04it/s, loss=0.318, lr=1]
Steps:  30%|███       | 361/1200 [02:57<06:53,  2.03it/s, loss=0.318, lr=1]
Steps:  30%|███       | 361/1200 [02:57<06:53,  2.03it/s, loss=0.302, lr=1]
Steps:  30%|███       | 362/1200 [02:58<06:52,  2.03it/s, loss=0.302, lr=1]
Steps:  30%|███       | 362/1200 [02:58<06:52,  2.03it/s, loss=0.322, lr=1]
Steps:  30%|███       | 363/1200 [02:58<06:51,  2.03it/s, loss=0.322, lr=1]
Steps:  30%|███       | 363/1200 [02:58<06:51,  2.03it/s, loss=0.542, lr=1]
Steps:  30%|███       | 364/1200 [02:59<06:50,  2.04it/s, loss=0.542, lr=1]
Steps:  30%|███       | 364/1200 [02:59<06:50,  2.04it/s, loss=0.281, lr=1]
Steps:  30%|███       | 365/1200 [02:59<06:49,  2.04it/s, loss=0.281, lr=1]
Steps:  30%|███       | 365/1200 [02:59<06:49,  2.04it/s, loss=1.07, lr=1] 
Steps:  30%|███       | 366/1200 [03:00<06:49,  2.04it/s, loss=1.07, lr=1]
Steps:  30%|███       | 366/1200 [03:00<06:49,  2.04it/s, loss=0.342, lr=1]
Steps:  31%|███       | 367/1200 [03:00<06:48,  2.04it/s, loss=0.342, lr=1]
Steps:  31%|███       | 367/1200 [03:00<06:48,  2.04it/s, loss=0.602, lr=1]
Steps:  31%|███       | 368/1200 [03:00<06:48,  2.04it/s, loss=0.602, lr=1]
Steps:  31%|███       | 368/1200 [03:00<06:48,  2.04it/s, loss=0.436, lr=1]
Steps:  31%|███       | 369/1200 [03:01<06:47,  2.04it/s, loss=0.436, lr=1]
Steps:  31%|███       | 369/1200 [03:01<06:47,  2.04it/s, loss=0.688, lr=1]
Steps:  31%|███       | 370/1200 [03:01<06:47,  2.03it/s, loss=0.688, lr=1]
Steps:  31%|███       | 370/1200 [03:01<06:47,  2.03it/s, loss=0.353, lr=1]
Steps:  31%|███       | 371/1200 [03:02<06:47,  2.04it/s, loss=0.353, lr=1]
Steps:  31%|███       | 371/1200 [03:02<06:47,  2.04it/s, loss=0.537, lr=1]
Steps:  31%|███       | 372/1200 [03:02<06:46,  2.04it/s, loss=0.537, lr=1]
Steps:  31%|███       | 372/1200 [03:02<06:46,  2.04it/s, loss=0.547, lr=1]
Steps:  31%|███       | 373/1200 [03:03<06:47,  2.03it/s, loss=0.547, lr=1]
Steps:  31%|███       | 373/1200 [03:03<06:47,  2.03it/s, loss=0.443, lr=1]
Steps:  31%|███       | 374/1200 [03:03<06:46,  2.03it/s, loss=0.443, lr=1]
Steps:  31%|███       | 374/1200 [03:03<06:46,  2.03it/s, loss=0.983, lr=1]
Steps:  31%|███▏      | 375/1200 [03:04<06:47,  2.03it/s, loss=0.983, lr=1]
Steps:  31%|███▏      | 375/1200 [03:04<06:47,  2.03it/s, loss=0.298, lr=1]
Steps:  31%|███▏      | 376/1200 [03:04<06:46,  2.03it/s, loss=0.298, lr=1]
Steps:  31%|███▏      | 376/1200 [03:04<06:46,  2.03it/s, loss=0.601, lr=1]
Steps:  31%|███▏      | 377/1200 [03:05<06:45,  2.03it/s, loss=0.601, lr=1]
Steps:  31%|███▏      | 377/1200 [03:05<06:45,  2.03it/s, loss=0.714, lr=1]
Steps:  32%|███▏      | 378/1200 [03:05<06:44,  2.03it/s, loss=0.714, lr=1]
Steps:  32%|███▏      | 378/1200 [03:05<06:44,  2.03it/s, loss=0.646, lr=1]
Steps:  32%|███▏      | 379/1200 [03:06<06:43,  2.03it/s, loss=0.646, lr=1]
Steps:  32%|███▏      | 379/1200 [03:06<06:43,  2.03it/s, loss=0.778, lr=1]
Steps:  32%|███▏      | 380/1200 [03:06<06:43,  2.03it/s, loss=0.778, lr=1]
Steps:  32%|███▏      | 380/1200 [03:06<06:43,  2.03it/s, loss=0.351, lr=1]
Steps:  32%|███▏      | 381/1200 [03:07<06:42,  2.04it/s, loss=0.351, lr=1]
Steps:  32%|███▏      | 381/1200 [03:07<06:42,  2.04it/s, loss=0.271, lr=1]
Steps:  32%|███▏      | 382/1200 [03:07<06:41,  2.03it/s, loss=0.271, lr=1]
Steps:  32%|███▏      | 382/1200 [03:07<06:41,  2.03it/s, loss=0.581, lr=1]
Steps:  32%|███▏      | 383/1200 [03:08<06:41,  2.04it/s, loss=0.581, lr=1]
Steps:  32%|███▏      | 383/1200 [03:08<06:41,  2.04it/s, loss=0.376, lr=1]
Steps:  32%|███▏      | 384/1200 [03:08<06:40,  2.04it/s, loss=0.376, lr=1]
Steps:  32%|███▏      | 384/1200 [03:08<06:40,  2.04it/s, loss=0.918, lr=1]
Steps:  32%|███▏      | 385/1200 [03:09<06:42,  2.03it/s, loss=0.918, lr=1]
Steps:  32%|███▏      | 385/1200 [03:09<06:42,  2.03it/s, loss=0.33, lr=1] 
Steps:  32%|███▏      | 386/1200 [03:09<06:41,  2.03it/s, loss=0.33, lr=1]
Steps:  32%|███▏      | 386/1200 [03:09<06:41,  2.03it/s, loss=0.298, lr=1]
Steps:  32%|███▏      | 387/1200 [03:10<06:40,  2.03it/s, loss=0.298, lr=1]
Steps:  32%|███▏      | 387/1200 [03:10<06:40,  2.03it/s, loss=0.596, lr=1]
Steps:  32%|███▏      | 388/1200 [03:10<06:39,  2.03it/s, loss=0.596, lr=1]
Steps:  32%|███▏      | 388/1200 [03:10<06:39,  2.03it/s, loss=0.358, lr=1]
Steps:  32%|███▏      | 389/1200 [03:11<06:39,  2.03it/s, loss=0.358, lr=1]
Steps:  32%|███▏      | 389/1200 [03:11<06:39,  2.03it/s, loss=0.489, lr=1]
Steps:  32%|███▎      | 390/1200 [03:11<06:38,  2.03it/s, loss=0.489, lr=1]
Steps:  32%|███▎      | 390/1200 [03:11<06:38,  2.03it/s, loss=0.618, lr=1]
Steps:  33%|███▎      | 391/1200 [03:12<06:37,  2.03it/s, loss=0.618, lr=1]
Steps:  33%|███▎      | 391/1200 [03:12<06:37,  2.03it/s, loss=0.433, lr=1]
Steps:  33%|███▎      | 392/1200 [03:12<06:37,  2.04it/s, loss=0.433, lr=1]
Steps:  33%|███▎      | 392/1200 [03:12<06:37,  2.04it/s, loss=0.621, lr=1]
Steps:  33%|███▎      | 393/1200 [03:13<06:36,  2.04it/s, loss=0.621, lr=1]
Steps:  33%|███▎      | 393/1200 [03:13<06:36,  2.04it/s, loss=0.439, lr=1]
Steps:  33%|███▎      | 394/1200 [03:13<06:35,  2.04it/s, loss=0.439, lr=1]
Steps:  33%|███▎      | 394/1200 [03:13<06:35,  2.04it/s, loss=0.622, lr=1]
Steps:  33%|███▎      | 395/1200 [03:14<06:35,  2.04it/s, loss=0.622, lr=1]
Steps:  33%|███▎      | 395/1200 [03:14<06:35,  2.04it/s, loss=0.44, lr=1] 
Steps:  33%|███▎      | 396/1200 [03:14<06:35,  2.03it/s, loss=0.44, lr=1]
Steps:  33%|███▎      | 396/1200 [03:14<06:35,  2.03it/s, loss=0.618, lr=1]
Steps:  33%|███▎      | 397/1200 [03:15<06:36,  2.03it/s, loss=0.618, lr=1]
Steps:  33%|███▎      | 397/1200 [03:15<06:36,  2.03it/s, loss=0.329, lr=1]
Steps:  33%|███▎      | 398/1200 [03:15<06:35,  2.03it/s, loss=0.329, lr=1]
Steps:  33%|███▎      | 398/1200 [03:15<06:35,  2.03it/s, loss=0.431, lr=1]
Steps:  33%|███▎      | 399/1200 [03:16<06:34,  2.03it/s, loss=0.431, lr=1]
Steps:  33%|███▎      | 399/1200 [03:16<06:34,  2.03it/s, loss=0.345, lr=1]
Steps:  33%|███▎      | 400/1200 [03:16<06:33,  2.03it/s, loss=0.345, lr=1]
Steps:  33%|███▎      | 400/1200 [03:16<06:33,  2.03it/s, loss=0.515, lr=1]
Steps:  33%|███▎      | 401/1200 [03:17<06:32,  2.03it/s, loss=0.515, lr=1]
Steps:  33%|███▎      | 401/1200 [03:17<06:32,  2.03it/s, loss=0.636, lr=1]
Steps:  34%|███▎      | 402/1200 [03:17<06:32,  2.03it/s, loss=0.636, lr=1]
Steps:  34%|███▎      | 402/1200 [03:17<06:32,  2.03it/s, loss=0.327, lr=1]
Steps:  34%|███▎      | 403/1200 [03:18<06:31,  2.04it/s, loss=0.327, lr=1]
Steps:  34%|███▎      | 403/1200 [03:18<06:31,  2.04it/s, loss=0.33, lr=1] 
Steps:  34%|███▎      | 404/1200 [03:18<06:30,  2.04it/s, loss=0.33, lr=1]
Steps:  34%|███▎      | 404/1200 [03:18<06:30,  2.04it/s, loss=0.394, lr=1]
Steps:  34%|███▍      | 405/1200 [03:19<06:30,  2.04it/s, loss=0.394, lr=1]
Steps:  34%|███▍      | 405/1200 [03:19<06:30,  2.04it/s, loss=0.629, lr=1]
Steps:  34%|███▍      | 406/1200 [03:19<06:29,  2.04it/s, loss=0.629, lr=1]
Steps:  34%|███▍      | 406/1200 [03:19<06:29,  2.04it/s, loss=0.374, lr=1]
Steps:  34%|███▍      | 407/1200 [03:20<06:29,  2.04it/s, loss=0.374, lr=1]
Steps:  34%|███▍      | 407/1200 [03:20<06:29,  2.04it/s, loss=0.721, lr=1]
Steps:  34%|███▍      | 408/1200 [03:20<06:28,  2.04it/s, loss=0.721, lr=1]
Steps:  34%|███▍      | 408/1200 [03:20<06:28,  2.04it/s, loss=0.656, lr=1]
Steps:  34%|███▍      | 409/1200 [03:21<06:30,  2.03it/s, loss=0.656, lr=1]
Steps:  34%|███▍      | 409/1200 [03:21<06:30,  2.03it/s, loss=0.412, lr=1]
Steps:  34%|███▍      | 410/1200 [03:21<06:29,  2.03it/s, loss=0.412, lr=1]
Steps:  34%|███▍      | 410/1200 [03:21<06:29,  2.03it/s, loss=0.342, lr=1]
Steps:  34%|███▍      | 411/1200 [03:22<06:28,  2.03it/s, loss=0.342, lr=1]
Steps:  34%|███▍      | 411/1200 [03:22<06:28,  2.03it/s, loss=0.42, lr=1] 
Steps:  34%|███▍      | 412/1200 [03:22<06:27,  2.03it/s, loss=0.42, lr=1]
Steps:  34%|███▍      | 412/1200 [03:22<06:27,  2.03it/s, loss=0.326, lr=1]
Steps:  34%|███▍      | 413/1200 [03:23<06:27,  2.03it/s, loss=0.326, lr=1]
Steps:  34%|███▍      | 413/1200 [03:23<06:27,  2.03it/s, loss=0.419, lr=1]
Steps:  34%|███▍      | 414/1200 [03:23<06:26,  2.03it/s, loss=0.419, lr=1]
Steps:  34%|███▍      | 414/1200 [03:23<06:26,  2.03it/s, loss=0.59, lr=1] 
Steps:  35%|███▍      | 415/1200 [03:24<06:25,  2.04it/s, loss=0.59, lr=1]
Steps:  35%|███▍      | 415/1200 [03:24<06:25,  2.04it/s, loss=0.414, lr=1]
Steps:  35%|███▍      | 416/1200 [03:24<06:26,  2.03it/s, loss=0.414, lr=1]
Steps:  35%|███▍      | 416/1200 [03:24<06:26,  2.03it/s, loss=0.36, lr=1] 
Steps:  35%|███▍      | 417/1200 [03:25<06:25,  2.03it/s, loss=0.36, lr=1]
Steps:  35%|███▍      | 417/1200 [03:25<06:25,  2.03it/s, loss=0.54, lr=1]
Steps:  35%|███▍      | 418/1200 [03:25<06:25,  2.03it/s, loss=0.54, lr=1]
Steps:  35%|███▍      | 418/1200 [03:25<06:25,  2.03it/s, loss=0.317, lr=1]
Steps:  35%|███▍      | 419/1200 [03:26<06:24,  2.03it/s, loss=0.317, lr=1]
Steps:  35%|███▍      | 419/1200 [03:26<06:24,  2.03it/s, loss=0.45, lr=1] 
Steps:  35%|███▌      | 420/1200 [03:26<06:23,  2.03it/s, loss=0.45, lr=1]
Steps:  35%|███▌      | 420/1200 [03:26<06:23,  2.03it/s, loss=0.356, lr=1]
Steps:  35%|███▌      | 421/1200 [03:27<06:24,  2.03it/s, loss=0.356, lr=1]
Steps:  35%|███▌      | 421/1200 [03:27<06:24,  2.03it/s, loss=0.439, lr=1]
Steps:  35%|███▌      | 422/1200 [03:27<06:23,  2.03it/s, loss=0.439, lr=1]
Steps:  35%|███▌      | 422/1200 [03:27<06:23,  2.03it/s, loss=0.294, lr=1]
Steps:  35%|███▌      | 423/1200 [03:28<06:22,  2.03it/s, loss=0.294, lr=1]
Steps:  35%|███▌      | 423/1200 [03:28<06:22,  2.03it/s, loss=0.282, lr=1]
Steps:  35%|███▌      | 424/1200 [03:28<06:21,  2.03it/s, loss=0.282, lr=1]
Steps:  35%|███▌      | 424/1200 [03:28<06:21,  2.03it/s, loss=0.328, lr=1]
Steps:  35%|███▌      | 425/1200 [03:29<06:20,  2.04it/s, loss=0.328, lr=1]
Steps:  35%|███▌      | 425/1200 [03:29<06:20,  2.04it/s, loss=0.348, lr=1]
Steps:  36%|███▌      | 426/1200 [03:29<06:19,  2.04it/s, loss=0.348, lr=1]
Steps:  36%|███▌      | 426/1200 [03:29<06:19,  2.04it/s, loss=0.393, lr=1]
Steps:  36%|███▌      | 427/1200 [03:30<06:19,  2.04it/s, loss=0.393, lr=1]
Steps:  36%|███▌      | 427/1200 [03:30<06:19,  2.04it/s, loss=0.326, lr=1]
Steps:  36%|███▌      | 428/1200 [03:30<06:18,  2.04it/s, loss=0.326, lr=1]
Steps:  36%|███▌      | 428/1200 [03:30<06:18,  2.04it/s, loss=0.602, lr=1]
Steps:  36%|███▌      | 429/1200 [03:30<06:18,  2.04it/s, loss=0.602, lr=1]
Steps:  36%|███▌      | 429/1200 [03:30<06:18,  2.04it/s, loss=0.498, lr=1]
Steps:  36%|███▌      | 430/1200 [03:31<06:17,  2.04it/s, loss=0.498, lr=1]
Steps:  36%|███▌      | 430/1200 [03:31<06:17,  2.04it/s, loss=0.347, lr=1]
Steps:  36%|███▌      | 431/1200 [03:31<06:17,  2.04it/s, loss=0.347, lr=1]
Steps:  36%|███▌      | 431/1200 [03:31<06:17,  2.04it/s, loss=0.379, lr=1]
Steps:  36%|███▌      | 432/1200 [03:32<06:16,  2.04it/s, loss=0.379, lr=1]
Steps:  36%|███▌      | 432/1200 [03:32<06:16,  2.04it/s, loss=0.335, lr=1]
Steps:  36%|███▌      | 433/1200 [03:32<06:18,  2.03it/s, loss=0.335, lr=1]
Steps:  36%|███▌      | 433/1200 [03:32<06:18,  2.03it/s, loss=0.328, lr=1]
Steps:  36%|███▌      | 434/1200 [03:33<06:17,  2.03it/s, loss=0.328, lr=1]
Steps:  36%|███▌      | 434/1200 [03:33<06:17,  2.03it/s, loss=0.447, lr=1]
Steps:  36%|███▋      | 435/1200 [03:33<06:16,  2.03it/s, loss=0.447, lr=1]
Steps:  36%|███▋      | 435/1200 [03:33<06:16,  2.03it/s, loss=1.04, lr=1] 
Steps:  36%|███▋      | 436/1200 [03:34<06:16,  2.03it/s, loss=1.04, lr=1]
Steps:  36%|███▋      | 436/1200 [03:34<06:16,  2.03it/s, loss=0.426, lr=1]
Steps:  36%|███▋      | 437/1200 [03:34<06:15,  2.03it/s, loss=0.426, lr=1]
Steps:  36%|███▋      | 437/1200 [03:34<06:15,  2.03it/s, loss=0.288, lr=1]
Steps:  36%|███▋      | 438/1200 [03:35<06:15,  2.03it/s, loss=0.288, lr=1]
Steps:  36%|███▋      | 438/1200 [03:35<06:15,  2.03it/s, loss=0.451, lr=1]
Steps:  37%|███▋      | 439/1200 [03:35<06:14,  2.03it/s, loss=0.451, lr=1]
Steps:  37%|███▋      | 439/1200 [03:35<06:14,  2.03it/s, loss=0.386, lr=1]
Steps:  37%|███▋      | 440/1200 [03:36<06:13,  2.03it/s, loss=0.386, lr=1]
Steps:  37%|███▋      | 440/1200 [03:36<06:13,  2.03it/s, loss=0.415, lr=1]
Steps:  37%|███▋      | 441/1200 [03:36<06:13,  2.03it/s, loss=0.415, lr=1]
Steps:  37%|███▋      | 441/1200 [03:36<06:13,  2.03it/s, loss=0.438, lr=1]
Steps:  37%|███▋      | 442/1200 [03:37<06:12,  2.03it/s, loss=0.438, lr=1]
Steps:  37%|███▋      | 442/1200 [03:37<06:12,  2.03it/s, loss=0.574, lr=1]
Steps:  37%|███▋      | 443/1200 [03:37<06:12,  2.03it/s, loss=0.574, lr=1]
Steps:  37%|███▋      | 443/1200 [03:37<06:12,  2.03it/s, loss=0.983, lr=1]
Steps:  37%|███▋      | 444/1200 [03:38<06:11,  2.03it/s, loss=0.983, lr=1]
Steps:  37%|███▋      | 444/1200 [03:38<06:11,  2.03it/s, loss=0.774, lr=1]
Steps:  37%|███▋      | 445/1200 [03:38<06:12,  2.03it/s, loss=0.774, lr=1]
Steps:  37%|███▋      | 445/1200 [03:38<06:12,  2.03it/s, loss=0.324, lr=1]
Steps:  37%|███▋      | 446/1200 [03:39<06:11,  2.03it/s, loss=0.324, lr=1]
Steps:  37%|███▋      | 446/1200 [03:39<06:11,  2.03it/s, loss=0.576, lr=1]
Steps:  37%|███▋      | 447/1200 [03:39<06:10,  2.03it/s, loss=0.576, lr=1]
Steps:  37%|███▋      | 447/1200 [03:39<06:10,  2.03it/s, loss=0.464, lr=1]
Steps:  37%|███▋      | 448/1200 [03:40<06:10,  2.03it/s, loss=0.464, lr=1]
Steps:  37%|███▋      | 448/1200 [03:40<06:10,  2.03it/s, loss=0.975, lr=1]
Steps:  37%|███▋      | 449/1200 [03:40<06:09,  2.03it/s, loss=0.975, lr=1]
Steps:  37%|███▋      | 449/1200 [03:40<06:09,  2.03it/s, loss=0.63, lr=1] 
Steps:  38%|███▊      | 450/1200 [03:41<06:08,  2.03it/s, loss=0.63, lr=1]
Steps:  38%|███▊      | 450/1200 [03:41<06:08,  2.03it/s, loss=0.635, lr=1]
Steps:  38%|███▊      | 451/1200 [03:41<06:08,  2.03it/s, loss=0.635, lr=1]
Steps:  38%|███▊      | 451/1200 [03:41<06:08,  2.03it/s, loss=0.603, lr=1]
Steps:  38%|███▊      | 452/1200 [03:42<06:07,  2.03it/s, loss=0.603, lr=1]
Steps:  38%|███▊      | 452/1200 [03:42<06:07,  2.03it/s, loss=0.291, lr=1]
Steps:  38%|███▊      | 453/1200 [03:42<06:07,  2.03it/s, loss=0.291, lr=1]
Steps:  38%|███▊      | 453/1200 [03:42<06:07,  2.03it/s, loss=0.632, lr=1]
Steps:  38%|███▊      | 454/1200 [03:43<06:06,  2.03it/s, loss=0.632, lr=1]
Steps:  38%|███▊      | 454/1200 [03:43<06:06,  2.03it/s, loss=0.609, lr=1]
Steps:  38%|███▊      | 455/1200 [03:43<06:05,  2.04it/s, loss=0.609, lr=1]
Steps:  38%|███▊      | 455/1200 [03:43<06:05,  2.04it/s, loss=0.353, lr=1]
Steps:  38%|███▊      | 456/1200 [03:44<06:05,  2.03it/s, loss=0.353, lr=1]
Steps:  38%|███▊      | 456/1200 [03:44<06:05,  2.03it/s, loss=0.537, lr=1]
Steps:  38%|███▊      | 457/1200 [03:44<06:06,  2.02it/s, loss=0.537, lr=1]
Steps:  38%|███▊      | 457/1200 [03:44<06:06,  2.02it/s, loss=0.399, lr=1]
Steps:  38%|███▊      | 458/1200 [03:45<06:05,  2.03it/s, loss=0.399, lr=1]
Steps:  38%|███▊      | 458/1200 [03:45<06:05,  2.03it/s, loss=0.511, lr=1]
Steps:  38%|███▊      | 459/1200 [03:45<06:04,  2.03it/s, loss=0.511, lr=1]
Steps:  38%|███▊      | 459/1200 [03:45<06:04,  2.03it/s, loss=0.605, lr=1]
Steps:  38%|███▊      | 460/1200 [03:46<06:03,  2.03it/s, loss=0.605, lr=1]
Steps:  38%|███▊      | 460/1200 [03:46<06:03,  2.03it/s, loss=0.289, lr=1]
Steps:  38%|███▊      | 461/1200 [03:46<06:02,  2.04it/s, loss=0.289, lr=1]
Steps:  38%|███▊      | 461/1200 [03:46<06:02,  2.04it/s, loss=0.515, lr=1]
Steps:  38%|███▊      | 462/1200 [03:47<06:02,  2.04it/s, loss=0.515, lr=1]
Steps:  38%|███▊      | 462/1200 [03:47<06:02,  2.04it/s, loss=0.331, lr=1]
Steps:  39%|███▊      | 463/1200 [03:47<06:01,  2.04it/s, loss=0.331, lr=1]
Steps:  39%|███▊      | 463/1200 [03:47<06:01,  2.04it/s, loss=0.371, lr=1]
Steps:  39%|███▊      | 464/1200 [03:48<06:01,  2.04it/s, loss=0.371, lr=1]
Steps:  39%|███▊      | 464/1200 [03:48<06:01,  2.04it/s, loss=0.628, lr=1]
Steps:  39%|███▉      | 465/1200 [03:48<06:00,  2.04it/s, loss=0.628, lr=1]
Steps:  39%|███▉      | 465/1200 [03:48<06:00,  2.04it/s, loss=0.5, lr=1]  
Steps:  39%|███▉      | 466/1200 [03:49<05:59,  2.04it/s, loss=0.5, lr=1]
Steps:  39%|███▉      | 466/1200 [03:49<05:59,  2.04it/s, loss=0.577, lr=1]
Steps:  39%|███▉      | 467/1200 [03:49<05:59,  2.04it/s, loss=0.577, lr=1]
Steps:  39%|███▉      | 467/1200 [03:49<05:59,  2.04it/s, loss=0.306, lr=1]
Steps:  39%|███▉      | 468/1200 [03:50<05:59,  2.04it/s, loss=0.306, lr=1]
Steps:  39%|███▉      | 468/1200 [03:50<05:59,  2.04it/s, loss=0.265, lr=1]
Steps:  39%|███▉      | 469/1200 [03:50<06:00,  2.03it/s, loss=0.265, lr=1]
Steps:  39%|███▉      | 469/1200 [03:50<06:00,  2.03it/s, loss=0.375, lr=1]
Steps:  39%|███▉      | 470/1200 [03:51<05:59,  2.03it/s, loss=0.375, lr=1]
Steps:  39%|███▉      | 470/1200 [03:51<05:59,  2.03it/s, loss=0.333, lr=1]
Steps:  39%|███▉      | 471/1200 [03:51<05:59,  2.03it/s, loss=0.333, lr=1]
Steps:  39%|███▉      | 471/1200 [03:51<05:59,  2.03it/s, loss=0.57, lr=1] 
Steps:  39%|███▉      | 472/1200 [03:52<05:58,  2.03it/s, loss=0.57, lr=1]
Steps:  39%|███▉      | 472/1200 [03:52<05:58,  2.03it/s, loss=0.295, lr=1]
Steps:  39%|███▉      | 473/1200 [03:52<05:57,  2.03it/s, loss=0.295, lr=1]
Steps:  39%|███▉      | 473/1200 [03:52<05:57,  2.03it/s, loss=0.779, lr=1]
Steps:  40%|███▉      | 474/1200 [03:53<05:56,  2.03it/s, loss=0.779, lr=1]
Steps:  40%|███▉      | 474/1200 [03:53<05:56,  2.03it/s, loss=0.937, lr=1]
Steps:  40%|███▉      | 475/1200 [03:53<05:56,  2.04it/s, loss=0.937, lr=1]
Steps:  40%|███▉      | 475/1200 [03:53<05:56,  2.04it/s, loss=0.377, lr=1]
Steps:  40%|███▉      | 476/1200 [03:54<05:55,  2.04it/s, loss=0.377, lr=1]
Steps:  40%|███▉      | 476/1200 [03:54<05:55,  2.04it/s, loss=0.274, lr=1]
Steps:  40%|███▉      | 477/1200 [03:54<05:55,  2.04it/s, loss=0.274, lr=1]
Steps:  40%|███▉      | 477/1200 [03:54<05:55,  2.04it/s, loss=0.601, lr=1]
Steps:  40%|███▉      | 478/1200 [03:55<05:54,  2.04it/s, loss=0.601, lr=1]
Steps:  40%|███▉      | 478/1200 [03:55<05:54,  2.04it/s, loss=0.426, lr=1]
Steps:  40%|███▉      | 479/1200 [03:55<05:54,  2.04it/s, loss=0.426, lr=1]
Steps:  40%|███▉      | 479/1200 [03:55<05:54,  2.04it/s, loss=0.353, lr=1]
Steps:  40%|████      | 480/1200 [03:56<05:53,  2.04it/s, loss=0.353, lr=1]
Steps:  40%|████      | 480/1200 [03:56<05:53,  2.04it/s, loss=0.628, lr=1]
Steps:  40%|████      | 481/1200 [03:56<05:54,  2.03it/s, loss=0.628, lr=1]
Steps:  40%|████      | 481/1200 [03:56<05:54,  2.03it/s, loss=0.449, lr=1]
Steps:  40%|████      | 482/1200 [03:57<05:53,  2.03it/s, loss=0.449, lr=1]
Steps:  40%|████      | 482/1200 [03:57<05:53,  2.03it/s, loss=0.335, lr=1]
Steps:  40%|████      | 483/1200 [03:57<05:52,  2.03it/s, loss=0.335, lr=1]
Steps:  40%|████      | 483/1200 [03:57<05:52,  2.03it/s, loss=0.425, lr=1]
Steps:  40%|████      | 484/1200 [03:58<05:52,  2.03it/s, loss=0.425, lr=1]
Steps:  40%|████      | 484/1200 [03:58<05:52,  2.03it/s, loss=0.626, lr=1]
Steps:  40%|████      | 485/1200 [03:58<05:51,  2.04it/s, loss=0.626, lr=1]
Steps:  40%|████      | 485/1200 [03:58<05:51,  2.04it/s, loss=0.327, lr=1]
Steps:  40%|████      | 486/1200 [03:59<05:50,  2.04it/s, loss=0.327, lr=1]
Steps:  40%|████      | 486/1200 [03:59<05:50,  2.04it/s, loss=1.09, lr=1] 
Steps:  41%|████      | 487/1200 [03:59<05:50,  2.04it/s, loss=1.09, lr=1]
Steps:  41%|████      | 487/1200 [03:59<05:50,  2.04it/s, loss=0.993, lr=1]
Steps:  41%|████      | 488/1200 [04:00<05:49,  2.04it/s, loss=0.993, lr=1]
Steps:  41%|████      | 488/1200 [04:00<05:49,  2.04it/s, loss=0.293, lr=1]
Steps:  41%|████      | 489/1200 [04:00<05:48,  2.04it/s, loss=0.293, lr=1]
Steps:  41%|████      | 489/1200 [04:00<05:48,  2.04it/s, loss=0.504, lr=1]
Steps:  41%|████      | 490/1200 [04:00<05:48,  2.04it/s, loss=0.504, lr=1]
Steps:  41%|████      | 490/1200 [04:00<05:48,  2.04it/s, loss=0.648, lr=1]
Steps:  41%|████      | 491/1200 [04:01<05:48,  2.04it/s, loss=0.648, lr=1]
Steps:  41%|████      | 491/1200 [04:01<05:48,  2.04it/s, loss=0.777, lr=1]
Steps:  41%|████      | 492/1200 [04:01<05:47,  2.04it/s, loss=0.777, lr=1]
Steps:  41%|████      | 492/1200 [04:01<05:47,  2.04it/s, loss=0.39, lr=1] 
Steps:  41%|████      | 493/1200 [04:02<05:48,  2.03it/s, loss=0.39, lr=1]
Steps:  41%|████      | 493/1200 [04:02<05:48,  2.03it/s, loss=0.293, lr=1]
Steps:  41%|████      | 494/1200 [04:02<05:47,  2.03it/s, loss=0.293, lr=1]
Steps:  41%|████      | 494/1200 [04:02<05:47,  2.03it/s, loss=0.367, lr=1]
Steps:  41%|████▏     | 495/1200 [04:03<05:46,  2.03it/s, loss=0.367, lr=1]
Steps:  41%|████▏     | 495/1200 [04:03<05:46,  2.03it/s, loss=0.464, lr=1]
Steps:  41%|████▏     | 496/1200 [04:03<05:46,  2.03it/s, loss=0.464, lr=1]
Steps:  41%|████▏     | 496/1200 [04:03<05:46,  2.03it/s, loss=0.747, lr=1]
Steps:  41%|████▏     | 497/1200 [04:04<05:45,  2.03it/s, loss=0.747, lr=1]
Steps:  41%|████▏     | 497/1200 [04:04<05:45,  2.03it/s, loss=0.34, lr=1] 
Steps:  42%|████▏     | 498/1200 [04:04<05:45,  2.03it/s, loss=0.34, lr=1]
Steps:  42%|████▏     | 498/1200 [04:04<05:45,  2.03it/s, loss=0.616, lr=1]
Steps:  42%|████▏     | 499/1200 [04:05<05:44,  2.03it/s, loss=0.616, lr=1]
Steps:  42%|████▏     | 499/1200 [04:05<05:44,  2.03it/s, loss=0.399, lr=1]
Steps:  42%|████▏     | 500/1200 [04:05<05:44,  2.03it/s, loss=0.399, lr=1]
Steps:  42%|████▏     | 500/1200 [04:05<05:44,  2.03it/s, loss=0.324, lr=1]
Steps:  42%|████▏     | 501/1200 [04:06<05:43,  2.03it/s, loss=0.324, lr=1]
Steps:  42%|████▏     | 501/1200 [04:06<05:43,  2.03it/s, loss=0.315, lr=1]
Steps:  42%|████▏     | 502/1200 [04:06<05:43,  2.03it/s, loss=0.315, lr=1]
Steps:  42%|████▏     | 502/1200 [04:06<05:43,  2.03it/s, loss=0.585, lr=1]
Steps:  42%|████▏     | 503/1200 [04:07<05:43,  2.03it/s, loss=0.585, lr=1]
Steps:  42%|████▏     | 503/1200 [04:07<05:43,  2.03it/s, loss=0.336, lr=1]
Steps:  42%|████▏     | 504/1200 [04:07<05:42,  2.03it/s, loss=0.336, lr=1]
Steps:  42%|████▏     | 504/1200 [04:07<05:42,  2.03it/s, loss=0.291, lr=1]
Steps:  42%|████▏     | 505/1200 [04:08<05:43,  2.02it/s, loss=0.291, lr=1]
Steps:  42%|████▏     | 505/1200 [04:08<05:43,  2.02it/s, loss=0.625, lr=1]
Steps:  42%|████▏     | 506/1200 [04:08<05:42,  2.03it/s, loss=0.625, lr=1]
Steps:  42%|████▏     | 506/1200 [04:08<05:42,  2.03it/s, loss=0.536, lr=1]
Steps:  42%|████▏     | 507/1200 [04:09<05:41,  2.03it/s, loss=0.536, lr=1]
Steps:  42%|████▏     | 507/1200 [04:09<05:41,  2.03it/s, loss=0.655, lr=1]
Steps:  42%|████▏     | 508/1200 [04:09<05:40,  2.03it/s, loss=0.655, lr=1]
Steps:  42%|████▏     | 508/1200 [04:09<05:40,  2.03it/s, loss=0.617, lr=1]
Steps:  42%|████▏     | 509/1200 [04:10<05:40,  2.03it/s, loss=0.617, lr=1]
Steps:  42%|████▏     | 509/1200 [04:10<05:40,  2.03it/s, loss=0.314, lr=1]
Steps:  42%|████▎     | 510/1200 [04:10<05:39,  2.03it/s, loss=0.314, lr=1]
Steps:  42%|████▎     | 510/1200 [04:10<05:39,  2.03it/s, loss=0.512, lr=1]
Steps:  43%|████▎     | 511/1200 [04:11<05:38,  2.03it/s, loss=0.512, lr=1]
Steps:  43%|████▎     | 511/1200 [04:11<05:38,  2.03it/s, loss=0.294, lr=1]
Steps:  43%|████▎     | 512/1200 [04:11<05:38,  2.03it/s, loss=0.294, lr=1]
Steps:  43%|████▎     | 512/1200 [04:11<05:38,  2.03it/s, loss=0.854, lr=1]
Steps:  43%|████▎     | 513/1200 [04:12<05:37,  2.04it/s, loss=0.854, lr=1]
Steps:  43%|████▎     | 513/1200 [04:12<05:37,  2.04it/s, loss=0.641, lr=1]
Steps:  43%|████▎     | 514/1200 [04:12<05:36,  2.04it/s, loss=0.641, lr=1]
Steps:  43%|████▎     | 514/1200 [04:12<05:36,  2.04it/s, loss=0.489, lr=1]
Steps:  43%|████▎     | 515/1200 [04:13<05:36,  2.04it/s, loss=0.489, lr=1]
Steps:  43%|████▎     | 515/1200 [04:13<05:36,  2.04it/s, loss=0.407, lr=1]
Steps:  43%|████▎     | 516/1200 [04:13<05:35,  2.04it/s, loss=0.407, lr=1]
Steps:  43%|████▎     | 516/1200 [04:13<05:35,  2.04it/s, loss=0.444, lr=1]
Steps:  43%|████▎     | 517/1200 [04:14<05:36,  2.03it/s, loss=0.444, lr=1]
Steps:  43%|████▎     | 517/1200 [04:14<05:36,  2.03it/s, loss=0.444, lr=1]
Steps:  43%|████▎     | 518/1200 [04:14<05:35,  2.03it/s, loss=0.444, lr=1]
Steps:  43%|████▎     | 518/1200 [04:14<05:35,  2.03it/s, loss=0.313, lr=1]
Steps:  43%|████▎     | 519/1200 [04:15<05:35,  2.03it/s, loss=0.313, lr=1]
Steps:  43%|████▎     | 519/1200 [04:15<05:35,  2.03it/s, loss=0.356, lr=1]
Steps:  43%|████▎     | 520/1200 [04:15<05:34,  2.03it/s, loss=0.356, lr=1]
Steps:  43%|████▎     | 520/1200 [04:15<05:34,  2.03it/s, loss=0.538, lr=1]
Steps:  43%|████▎     | 521/1200 [04:16<05:33,  2.03it/s, loss=0.538, lr=1]
Steps:  43%|████▎     | 521/1200 [04:16<05:33,  2.03it/s, loss=0.585, lr=1]
Steps:  44%|████▎     | 522/1200 [04:16<05:33,  2.04it/s, loss=0.585, lr=1]
Steps:  44%|████▎     | 522/1200 [04:16<05:33,  2.04it/s, loss=0.496, lr=1]
Steps:  44%|████▎     | 523/1200 [04:17<05:32,  2.04it/s, loss=0.496, lr=1]
Steps:  44%|████▎     | 523/1200 [04:17<05:32,  2.04it/s, loss=0.41, lr=1] 
Steps:  44%|████▎     | 524/1200 [04:17<05:31,  2.04it/s, loss=0.41, lr=1]
Steps:  44%|████▎     | 524/1200 [04:17<05:31,  2.04it/s, loss=0.651, lr=1]
Steps:  44%|████▍     | 525/1200 [04:18<05:31,  2.04it/s, loss=0.651, lr=1]
Steps:  44%|████▍     | 525/1200 [04:18<05:31,  2.04it/s, loss=0.779, lr=1]
Steps:  44%|████▍     | 526/1200 [04:18<05:30,  2.04it/s, loss=0.779, lr=1]
Steps:  44%|████▍     | 526/1200 [04:18<05:30,  2.04it/s, loss=0.396, lr=1]
Steps:  44%|████▍     | 527/1200 [04:19<05:30,  2.04it/s, loss=0.396, lr=1]
Steps:  44%|████▍     | 527/1200 [04:19<05:30,  2.04it/s, loss=0.337, lr=1]
Steps:  44%|████▍     | 528/1200 [04:19<05:29,  2.04it/s, loss=0.337, lr=1]
Steps:  44%|████▍     | 528/1200 [04:19<05:29,  2.04it/s, loss=0.33, lr=1] 
Steps:  44%|████▍     | 529/1200 [04:20<05:30,  2.03it/s, loss=0.33, lr=1]
Steps:  44%|████▍     | 529/1200 [04:20<05:30,  2.03it/s, loss=0.577, lr=1]
Steps:  44%|████▍     | 530/1200 [04:20<05:29,  2.03it/s, loss=0.577, lr=1]
Steps:  44%|████▍     | 530/1200 [04:20<05:29,  2.03it/s, loss=0.612, lr=1]
Steps:  44%|████▍     | 531/1200 [04:21<05:29,  2.03it/s, loss=0.612, lr=1]
Steps:  44%|████▍     | 531/1200 [04:21<05:29,  2.03it/s, loss=0.339, lr=1]
Steps:  44%|████▍     | 532/1200 [04:21<05:28,  2.03it/s, loss=0.339, lr=1]
Steps:  44%|████▍     | 532/1200 [04:21<05:28,  2.03it/s, loss=0.464, lr=1]
Steps:  44%|████▍     | 533/1200 [04:22<05:27,  2.04it/s, loss=0.464, lr=1]
Steps:  44%|████▍     | 533/1200 [04:22<05:27,  2.04it/s, loss=0.637, lr=1]
Steps:  44%|████▍     | 534/1200 [04:22<05:27,  2.04it/s, loss=0.637, lr=1]
Steps:  44%|████▍     | 534/1200 [04:22<05:27,  2.04it/s, loss=1.04, lr=1] 
Steps:  45%|████▍     | 535/1200 [04:23<05:26,  2.04it/s, loss=1.04, lr=1]
Steps:  45%|████▍     | 535/1200 [04:23<05:26,  2.04it/s, loss=0.336, lr=1]
Steps:  45%|████▍     | 536/1200 [04:23<05:25,  2.04it/s, loss=0.336, lr=1]
Steps:  45%|████▍     | 536/1200 [04:23<05:25,  2.04it/s, loss=0.33, lr=1] 
Steps:  45%|████▍     | 537/1200 [04:24<05:25,  2.04it/s, loss=0.33, lr=1]
Steps:  45%|████▍     | 537/1200 [04:24<05:25,  2.04it/s, loss=0.935, lr=1]
Steps:  45%|████▍     | 538/1200 [04:24<05:25,  2.04it/s, loss=0.935, lr=1]
Steps:  45%|████▍     | 538/1200 [04:24<05:25,  2.04it/s, loss=0.472, lr=1]
Steps:  45%|████▍     | 539/1200 [04:25<05:24,  2.04it/s, loss=0.472, lr=1]
Steps:  45%|████▍     | 539/1200 [04:25<05:24,  2.04it/s, loss=0.551, lr=1]
Steps:  45%|████▌     | 540/1200 [04:25<05:23,  2.04it/s, loss=0.551, lr=1]
Steps:  45%|████▌     | 540/1200 [04:25<05:23,  2.04it/s, loss=0.642, lr=1]
Steps:  45%|████▌     | 541/1200 [04:26<05:24,  2.03it/s, loss=0.642, lr=1]
Steps:  45%|████▌     | 541/1200 [04:26<05:24,  2.03it/s, loss=0.306, lr=1]
Steps:  45%|████▌     | 542/1200 [04:26<05:23,  2.03it/s, loss=0.306, lr=1]
Steps:  45%|████▌     | 542/1200 [04:26<05:23,  2.03it/s, loss=0.307, lr=1]
Steps:  45%|████▌     | 543/1200 [04:27<05:22,  2.03it/s, loss=0.307, lr=1]
Steps:  45%|████▌     | 543/1200 [04:27<05:22,  2.03it/s, loss=0.436, lr=1]
Steps:  45%|████▌     | 544/1200 [04:27<05:22,  2.04it/s, loss=0.436, lr=1]
Steps:  45%|████▌     | 544/1200 [04:27<05:22,  2.04it/s, loss=0.64, lr=1] 
Steps:  45%|████▌     | 545/1200 [04:28<05:21,  2.04it/s, loss=0.64, lr=1]
Steps:  45%|████▌     | 545/1200 [04:28<05:21,  2.04it/s, loss=0.306, lr=1]
Steps:  46%|████▌     | 546/1200 [04:28<05:20,  2.04it/s, loss=0.306, lr=1]
Steps:  46%|████▌     | 546/1200 [04:28<05:20,  2.04it/s, loss=0.648, lr=1]
Steps:  46%|████▌     | 547/1200 [04:29<05:21,  2.03it/s, loss=0.648, lr=1]
Steps:  46%|████▌     | 547/1200 [04:29<05:21,  2.03it/s, loss=0.321, lr=1]
Steps:  46%|████▌     | 548/1200 [04:29<05:20,  2.03it/s, loss=0.321, lr=1]
Steps:  46%|████▌     | 548/1200 [04:29<05:20,  2.03it/s, loss=0.515, lr=1]
Steps:  46%|████▌     | 549/1200 [04:29<05:19,  2.04it/s, loss=0.515, lr=1]
Steps:  46%|████▌     | 549/1200 [04:29<05:19,  2.04it/s, loss=0.809, lr=1]
Steps:  46%|████▌     | 550/1200 [04:30<05:19,  2.04it/s, loss=0.809, lr=1]
Steps:  46%|████▌     | 550/1200 [04:30<05:19,  2.04it/s, loss=1.04, lr=1] 
Steps:  46%|████▌     | 551/1200 [04:30<05:18,  2.04it/s, loss=1.04, lr=1]
Steps:  46%|████▌     | 551/1200 [04:30<05:18,  2.04it/s, loss=0.361, lr=1]
Steps:  46%|████▌     | 552/1200 [04:31<05:17,  2.04it/s, loss=0.361, lr=1]
Steps:  46%|████▌     | 552/1200 [04:31<05:17,  2.04it/s, loss=0.6, lr=1]  
Steps:  46%|████▌     | 553/1200 [04:31<05:18,  2.03it/s, loss=0.6, lr=1]
Steps:  46%|████▌     | 553/1200 [04:31<05:18,  2.03it/s, loss=0.421, lr=1]
Steps:  46%|████▌     | 554/1200 [04:32<05:17,  2.03it/s, loss=0.421, lr=1]
Steps:  46%|████▌     | 554/1200 [04:32<05:17,  2.03it/s, loss=0.6, lr=1]  
Steps:  46%|████▋     | 555/1200 [04:32<05:16,  2.03it/s, loss=0.6, lr=1]
Steps:  46%|████▋     | 555/1200 [04:32<05:16,  2.03it/s, loss=0.386, lr=1]
Steps:  46%|████▋     | 556/1200 [04:33<05:16,  2.03it/s, loss=0.386, lr=1]
Steps:  46%|████▋     | 556/1200 [04:33<05:16,  2.03it/s, loss=0.417, lr=1]
Steps:  46%|████▋     | 557/1200 [04:33<05:15,  2.04it/s, loss=0.417, lr=1]
Steps:  46%|████▋     | 557/1200 [04:33<05:15,  2.04it/s, loss=0.634, lr=1]
Steps:  46%|████▋     | 558/1200 [04:34<05:15,  2.04it/s, loss=0.634, lr=1]
Steps:  46%|████▋     | 558/1200 [04:34<05:15,  2.04it/s, loss=0.994, lr=1]
Steps:  47%|████▋     | 559/1200 [04:34<05:15,  2.03it/s, loss=0.994, lr=1]
Steps:  47%|████▋     | 559/1200 [04:34<05:15,  2.03it/s, loss=0.383, lr=1]
Steps:  47%|████▋     | 560/1200 [04:35<05:14,  2.03it/s, loss=0.383, lr=1]
Steps:  47%|████▋     | 560/1200 [04:35<05:14,  2.03it/s, loss=0.637, lr=1]
Steps:  47%|████▋     | 561/1200 [04:35<05:13,  2.04it/s, loss=0.637, lr=1]
Steps:  47%|████▋     | 561/1200 [04:35<05:13,  2.04it/s, loss=0.68, lr=1] 
Steps:  47%|████▋     | 562/1200 [04:36<05:13,  2.03it/s, loss=0.68, lr=1]
Steps:  47%|████▋     | 562/1200 [04:36<05:13,  2.03it/s, loss=0.42, lr=1]
Steps:  47%|████▋     | 563/1200 [04:36<05:13,  2.03it/s, loss=0.42, lr=1]
Steps:  47%|████▋     | 563/1200 [04:36<05:13,  2.03it/s, loss=0.354, lr=1]
Steps:  47%|████▋     | 564/1200 [04:37<05:12,  2.04it/s, loss=0.354, lr=1]
Steps:  47%|████▋     | 564/1200 [04:37<05:12,  2.04it/s, loss=0.412, lr=1]
Steps:  47%|████▋     | 565/1200 [04:37<05:13,  2.03it/s, loss=0.412, lr=1]
Steps:  47%|████▋     | 565/1200 [04:37<05:13,  2.03it/s, loss=0.605, lr=1]
Steps:  47%|████▋     | 566/1200 [04:38<05:12,  2.03it/s, loss=0.605, lr=1]
Steps:  47%|████▋     | 566/1200 [04:38<05:12,  2.03it/s, loss=0.521, lr=1]
Steps:  47%|████▋     | 567/1200 [04:38<05:11,  2.03it/s, loss=0.521, lr=1]
Steps:  47%|████▋     | 567/1200 [04:38<05:11,  2.03it/s, loss=0.954, lr=1]
Steps:  47%|████▋     | 568/1200 [04:39<05:10,  2.03it/s, loss=0.954, lr=1]
Steps:  47%|████▋     | 568/1200 [04:39<05:10,  2.03it/s, loss=0.38, lr=1] 
Steps:  47%|████▋     | 569/1200 [04:39<05:09,  2.04it/s, loss=0.38, lr=1]
Steps:  47%|████▋     | 569/1200 [04:39<05:09,  2.04it/s, loss=0.379, lr=1]
Steps:  48%|████▊     | 570/1200 [04:40<05:09,  2.03it/s, loss=0.379, lr=1]
Steps:  48%|████▊     | 570/1200 [04:40<05:09,  2.03it/s, loss=0.371, lr=1]
Steps:  48%|████▊     | 571/1200 [04:40<05:09,  2.04it/s, loss=0.371, lr=1]
Steps:  48%|████▊     | 571/1200 [04:40<05:09,  2.04it/s, loss=0.362, lr=1]
Steps:  48%|████▊     | 572/1200 [04:41<05:08,  2.04it/s, loss=0.362, lr=1]
Steps:  48%|████▊     | 572/1200 [04:41<05:08,  2.04it/s, loss=0.329, lr=1]
Steps:  48%|████▊     | 573/1200 [04:41<05:07,  2.04it/s, loss=0.329, lr=1]
Steps:  48%|████▊     | 573/1200 [04:41<05:07,  2.04it/s, loss=0.77, lr=1] 
Steps:  48%|████▊     | 574/1200 [04:42<05:07,  2.04it/s, loss=0.77, lr=1]
Steps:  48%|████▊     | 574/1200 [04:42<05:07,  2.04it/s, loss=0.574, lr=1]
Steps:  48%|████▊     | 575/1200 [04:42<05:06,  2.04it/s, loss=0.574, lr=1]
Steps:  48%|████▊     | 575/1200 [04:42<05:06,  2.04it/s, loss=0.278, lr=1]
Steps:  48%|████▊     | 576/1200 [04:43<05:05,  2.04it/s, loss=0.278, lr=1]
Steps:  48%|████▊     | 576/1200 [04:43<05:05,  2.04it/s, loss=0.537, lr=1]
Steps:  48%|████▊     | 577/1200 [04:43<05:06,  2.03it/s, loss=0.537, lr=1]
Steps:  48%|████▊     | 577/1200 [04:43<05:06,  2.03it/s, loss=0.774, lr=1]
Steps:  48%|████▊     | 578/1200 [04:44<05:05,  2.03it/s, loss=0.774, lr=1]
Steps:  48%|████▊     | 578/1200 [04:44<05:05,  2.03it/s, loss=1.04, lr=1] 
Steps:  48%|████▊     | 579/1200 [04:44<05:05,  2.03it/s, loss=1.04, lr=1]
Steps:  48%|████▊     | 579/1200 [04:44<05:05,  2.03it/s, loss=0.418, lr=1]
Steps:  48%|████▊     | 580/1200 [04:45<05:04,  2.04it/s, loss=0.418, lr=1]
Steps:  48%|████▊     | 580/1200 [04:45<05:04,  2.04it/s, loss=0.701, lr=1]
Steps:  48%|████▊     | 581/1200 [04:45<05:03,  2.04it/s, loss=0.701, lr=1]
Steps:  48%|████▊     | 581/1200 [04:45<05:03,  2.04it/s, loss=0.634, lr=1]
Steps:  48%|████▊     | 582/1200 [04:46<05:03,  2.04it/s, loss=0.634, lr=1]
Steps:  48%|████▊     | 582/1200 [04:46<05:03,  2.04it/s, loss=0.621, lr=1]
Steps:  49%|████▊     | 583/1200 [04:46<05:02,  2.04it/s, loss=0.621, lr=1]
Steps:  49%|████▊     | 583/1200 [04:46<05:02,  2.04it/s, loss=0.282, lr=1]
Steps:  49%|████▊     | 584/1200 [04:47<05:02,  2.04it/s, loss=0.282, lr=1]
Steps:  49%|████▊     | 584/1200 [04:47<05:02,  2.04it/s, loss=0.713, lr=1]
Steps:  49%|████▉     | 585/1200 [04:47<05:01,  2.04it/s, loss=0.713, lr=1]
Steps:  49%|████▉     | 585/1200 [04:47<05:01,  2.04it/s, loss=0.314, lr=1]
Steps:  49%|████▉     | 586/1200 [04:48<05:01,  2.04it/s, loss=0.314, lr=1]
Steps:  49%|████▉     | 586/1200 [04:48<05:01,  2.04it/s, loss=0.417, lr=1]
Steps:  49%|████▉     | 587/1200 [04:48<05:00,  2.04it/s, loss=0.417, lr=1]
Steps:  49%|████▉     | 587/1200 [04:48<05:00,  2.04it/s, loss=1.02, lr=1] 
Steps:  49%|████▉     | 588/1200 [04:49<05:00,  2.04it/s, loss=1.02, lr=1]
Steps:  49%|████▉     | 588/1200 [04:49<05:00,  2.04it/s, loss=0.584, lr=1]
Steps:  49%|████▉     | 589/1200 [04:49<05:01,  2.03it/s, loss=0.584, lr=1]
Steps:  49%|████▉     | 589/1200 [04:49<05:01,  2.03it/s, loss=0.368, lr=1]
Steps:  49%|████▉     | 590/1200 [04:50<05:00,  2.03it/s, loss=0.368, lr=1]
Steps:  49%|████▉     | 590/1200 [04:50<05:00,  2.03it/s, loss=0.834, lr=1]
Steps:  49%|████▉     | 591/1200 [04:50<04:59,  2.03it/s, loss=0.834, lr=1]
Steps:  49%|████▉     | 591/1200 [04:50<04:59,  2.03it/s, loss=0.274, lr=1]
Steps:  49%|████▉     | 592/1200 [04:51<04:59,  2.03it/s, loss=0.274, lr=1]
Steps:  49%|████▉     | 592/1200 [04:51<04:59,  2.03it/s, loss=0.87, lr=1] 
Steps:  49%|████▉     | 593/1200 [04:51<04:58,  2.03it/s, loss=0.87, lr=1]
Steps:  49%|████▉     | 593/1200 [04:51<04:58,  2.03it/s, loss=0.66, lr=1]
Steps:  50%|████▉     | 594/1200 [04:52<04:57,  2.03it/s, loss=0.66, lr=1]
Steps:  50%|████▉     | 594/1200 [04:52<04:57,  2.03it/s, loss=0.538, lr=1]
Steps:  50%|████▉     | 595/1200 [04:52<04:57,  2.04it/s, loss=0.538, lr=1]
Steps:  50%|████▉     | 595/1200 [04:52<04:57,  2.04it/s, loss=0.628, lr=1]
Steps:  50%|████▉     | 596/1200 [04:53<04:56,  2.04it/s, loss=0.628, lr=1]
Steps:  50%|████▉     | 596/1200 [04:53<04:56,  2.04it/s, loss=0.952, lr=1]
Steps:  50%|████▉     | 597/1200 [04:53<04:56,  2.04it/s, loss=0.952, lr=1]
Steps:  50%|████▉     | 597/1200 [04:53<04:56,  2.04it/s, loss=0.37, lr=1] 
Steps:  50%|████▉     | 598/1200 [04:54<04:55,  2.04it/s, loss=0.37, lr=1]
Steps:  50%|████▉     | 598/1200 [04:54<04:55,  2.04it/s, loss=0.603, lr=1]
Steps:  50%|████▉     | 599/1200 [04:54<04:55,  2.03it/s, loss=0.603, lr=1]
Steps:  50%|████▉     | 599/1200 [04:54<04:55,  2.03it/s, loss=0.325, lr=1]
Steps:  50%|█████     | 600/1200 [04:55<04:54,  2.04it/s, loss=0.325, lr=1]
Steps:  50%|█████     | 600/1200 [04:55<04:54,  2.04it/s, loss=0.48, lr=1] 
Steps:  50%|█████     | 601/1200 [04:55<04:55,  2.03it/s, loss=0.48, lr=1]
Steps:  50%|█████     | 601/1200 [04:55<04:55,  2.03it/s, loss=0.452, lr=1]
Steps:  50%|█████     | 602/1200 [04:56<04:54,  2.03it/s, loss=0.452, lr=1]
Steps:  50%|█████     | 602/1200 [04:56<04:54,  2.03it/s, loss=0.28, lr=1] 
Steps:  50%|█████     | 603/1200 [04:56<04:53,  2.03it/s, loss=0.28, lr=1]
Steps:  50%|█████     | 603/1200 [04:56<04:53,  2.03it/s, loss=0.474, lr=1]
Steps:  50%|█████     | 604/1200 [04:57<04:53,  2.03it/s, loss=0.474, lr=1]
Steps:  50%|█████     | 604/1200 [04:57<04:53,  2.03it/s, loss=0.313, lr=1]
Steps:  50%|█████     | 605/1200 [04:57<04:52,  2.04it/s, loss=0.313, lr=1]
Steps:  50%|█████     | 605/1200 [04:57<04:52,  2.04it/s, loss=0.512, lr=1]
Steps:  50%|█████     | 606/1200 [04:58<04:51,  2.04it/s, loss=0.512, lr=1]
Steps:  50%|█████     | 606/1200 [04:58<04:51,  2.04it/s, loss=0.588, lr=1]
Steps:  51%|█████     | 607/1200 [04:58<04:50,  2.04it/s, loss=0.588, lr=1]
Steps:  51%|█████     | 607/1200 [04:58<04:50,  2.04it/s, loss=0.326, lr=1]
Steps:  51%|█████     | 608/1200 [04:58<04:50,  2.04it/s, loss=0.326, lr=1]
Steps:  51%|█████     | 608/1200 [04:58<04:50,  2.04it/s, loss=0.971, lr=1]
Steps:  51%|█████     | 609/1200 [04:59<04:49,  2.04it/s, loss=0.971, lr=1]
Steps:  51%|█████     | 609/1200 [04:59<04:49,  2.04it/s, loss=0.619, lr=1]
Steps:  51%|█████     | 610/1200 [04:59<04:49,  2.04it/s, loss=0.619, lr=1]
Steps:  51%|█████     | 610/1200 [04:59<04:49,  2.04it/s, loss=0.531, lr=1]
Steps:  51%|█████     | 611/1200 [05:00<04:48,  2.04it/s, loss=0.531, lr=1]
Steps:  51%|█████     | 611/1200 [05:00<04:48,  2.04it/s, loss=0.778, lr=1]
Steps:  51%|█████     | 612/1200 [05:00<04:48,  2.04it/s, loss=0.778, lr=1]
Steps:  51%|█████     | 612/1200 [05:00<04:48,  2.04it/s, loss=0.523, lr=1]
Steps:  51%|█████     | 613/1200 [05:01<04:49,  2.03it/s, loss=0.523, lr=1]
Steps:  51%|█████     | 613/1200 [05:01<04:49,  2.03it/s, loss=0.639, lr=1]
Steps:  51%|█████     | 614/1200 [05:01<04:48,  2.03it/s, loss=0.639, lr=1]
Steps:  51%|█████     | 614/1200 [05:01<04:48,  2.03it/s, loss=0.683, lr=1]
Steps:  51%|█████▏    | 615/1200 [05:02<04:47,  2.03it/s, loss=0.683, lr=1]
Steps:  51%|█████▏    | 615/1200 [05:02<04:47,  2.03it/s, loss=0.599, lr=1]
Steps:  51%|█████▏    | 616/1200 [05:02<04:46,  2.04it/s, loss=0.599, lr=1]
Steps:  51%|█████▏    | 616/1200 [05:02<04:46,  2.04it/s, loss=0.499, lr=1]
Steps:  51%|█████▏    | 617/1200 [05:03<04:46,  2.04it/s, loss=0.499, lr=1]
Steps:  51%|█████▏    | 617/1200 [05:03<04:46,  2.04it/s, loss=0.604, lr=1]
Steps:  52%|█████▏    | 618/1200 [05:03<04:45,  2.04it/s, loss=0.604, lr=1]
Steps:  52%|█████▏    | 618/1200 [05:03<04:45,  2.04it/s, loss=0.628, lr=1]
Steps:  52%|█████▏    | 619/1200 [05:04<04:45,  2.04it/s, loss=0.628, lr=1]
Steps:  52%|█████▏    | 619/1200 [05:04<04:45,  2.04it/s, loss=0.345, lr=1]
Steps:  52%|█████▏    | 620/1200 [05:04<04:44,  2.04it/s, loss=0.345, lr=1]
Steps:  52%|█████▏    | 620/1200 [05:04<04:44,  2.04it/s, loss=0.417, lr=1]
Steps:  52%|█████▏    | 621/1200 [05:05<04:44,  2.04it/s, loss=0.417, lr=1]
Steps:  52%|█████▏    | 621/1200 [05:05<04:44,  2.04it/s, loss=0.764, lr=1]
Steps:  52%|█████▏    | 622/1200 [05:05<04:43,  2.04it/s, loss=0.764, lr=1]
Steps:  52%|█████▏    | 622/1200 [05:05<04:43,  2.04it/s, loss=0.316, lr=1]
Steps:  52%|█████▏    | 623/1200 [05:06<04:43,  2.04it/s, loss=0.316, lr=1]
Steps:  52%|█████▏    | 623/1200 [05:06<04:43,  2.04it/s, loss=0.423, lr=1]
Steps:  52%|█████▏    | 624/1200 [05:06<04:42,  2.04it/s, loss=0.423, lr=1]
Steps:  52%|█████▏    | 624/1200 [05:06<04:42,  2.04it/s, loss=0.356, lr=1]
Steps:  52%|█████▏    | 625/1200 [05:07<04:43,  2.03it/s, loss=0.356, lr=1]
Steps:  52%|█████▏    | 625/1200 [05:07<04:43,  2.03it/s, loss=0.618, lr=1]
Steps:  52%|█████▏    | 626/1200 [05:07<04:42,  2.03it/s, loss=0.618, lr=1]
Steps:  52%|█████▏    | 626/1200 [05:07<04:42,  2.03it/s, loss=0.618, lr=1]
Steps:  52%|█████▏    | 627/1200 [05:08<04:41,  2.03it/s, loss=0.618, lr=1]
Steps:  52%|█████▏    | 627/1200 [05:08<04:41,  2.03it/s, loss=0.265, lr=1]
Steps:  52%|█████▏    | 628/1200 [05:08<04:41,  2.03it/s, loss=0.265, lr=1]
Steps:  52%|█████▏    | 628/1200 [05:08<04:41,  2.03it/s, loss=0.561, lr=1]
Steps:  52%|█████▏    | 629/1200 [05:09<04:40,  2.04it/s, loss=0.561, lr=1]
Steps:  52%|█████▏    | 629/1200 [05:09<04:40,  2.04it/s, loss=0.818, lr=1]
Steps:  52%|█████▎    | 630/1200 [05:09<04:39,  2.04it/s, loss=0.818, lr=1]
Steps:  52%|█████▎    | 630/1200 [05:09<04:39,  2.04it/s, loss=0.508, lr=1]
Steps:  53%|█████▎    | 631/1200 [05:10<04:39,  2.04it/s, loss=0.508, lr=1]
Steps:  53%|█████▎    | 631/1200 [05:10<04:39,  2.04it/s, loss=0.362, lr=1]
Steps:  53%|█████▎    | 632/1200 [05:10<04:38,  2.04it/s, loss=0.362, lr=1]
Steps:  53%|█████▎    | 632/1200 [05:10<04:38,  2.04it/s, loss=0.646, lr=1]
Steps:  53%|█████▎    | 633/1200 [05:11<04:38,  2.04it/s, loss=0.646, lr=1]
Steps:  53%|█████▎    | 633/1200 [05:11<04:38,  2.04it/s, loss=0.596, lr=1]
Steps:  53%|█████▎    | 634/1200 [05:11<04:38,  2.03it/s, loss=0.596, lr=1]
Steps:  53%|█████▎    | 634/1200 [05:11<04:38,  2.03it/s, loss=0.676, lr=1]
Steps:  53%|█████▎    | 635/1200 [05:12<04:37,  2.03it/s, loss=0.676, lr=1]
Steps:  53%|█████▎    | 635/1200 [05:12<04:37,  2.03it/s, loss=0.308, lr=1]
Steps:  53%|█████▎    | 636/1200 [05:12<04:37,  2.04it/s, loss=0.308, lr=1]
Steps:  53%|█████▎    | 636/1200 [05:12<04:37,  2.04it/s, loss=0.74, lr=1] 
Steps:  53%|█████▎    | 637/1200 [05:13<04:37,  2.03it/s, loss=0.74, lr=1]
Steps:  53%|█████▎    | 637/1200 [05:13<04:37,  2.03it/s, loss=0.645, lr=1]
Steps:  53%|█████▎    | 638/1200 [05:13<04:37,  2.03it/s, loss=0.645, lr=1]
Steps:  53%|█████▎    | 638/1200 [05:13<04:37,  2.03it/s, loss=0.98, lr=1] 
Steps:  53%|█████▎    | 639/1200 [05:14<04:36,  2.03it/s, loss=0.98, lr=1]
Steps:  53%|█████▎    | 639/1200 [05:14<04:36,  2.03it/s, loss=0.531, lr=1]
Steps:  53%|█████▎    | 640/1200 [05:14<04:35,  2.03it/s, loss=0.531, lr=1]
Steps:  53%|█████▎    | 640/1200 [05:14<04:35,  2.03it/s, loss=0.516, lr=1]
Steps:  53%|█████▎    | 641/1200 [05:15<04:34,  2.03it/s, loss=0.516, lr=1]
Steps:  53%|█████▎    | 641/1200 [05:15<04:34,  2.03it/s, loss=0.598, lr=1]
Steps:  54%|█████▎    | 642/1200 [05:15<04:34,  2.03it/s, loss=0.598, lr=1]
Steps:  54%|█████▎    | 642/1200 [05:15<04:34,  2.03it/s, loss=0.303, lr=1]
Steps:  54%|█████▎    | 643/1200 [05:16<04:33,  2.03it/s, loss=0.303, lr=1]
Steps:  54%|█████▎    | 643/1200 [05:16<04:33,  2.03it/s, loss=0.462, lr=1]
Steps:  54%|█████▎    | 644/1200 [05:16<04:33,  2.04it/s, loss=0.462, lr=1]
Steps:  54%|█████▎    | 644/1200 [05:16<04:33,  2.04it/s, loss=0.348, lr=1]
Steps:  54%|█████▍    | 645/1200 [05:17<04:32,  2.04it/s, loss=0.348, lr=1]
Steps:  54%|█████▍    | 645/1200 [05:17<04:32,  2.04it/s, loss=0.643, lr=1]
Steps:  54%|█████▍    | 646/1200 [05:17<04:31,  2.04it/s, loss=0.643, lr=1]
Steps:  54%|█████▍    | 646/1200 [05:17<04:31,  2.04it/s, loss=0.762, lr=1]
Steps:  54%|█████▍    | 647/1200 [05:18<04:31,  2.04it/s, loss=0.762, lr=1]
Steps:  54%|█████▍    | 647/1200 [05:18<04:31,  2.04it/s, loss=0.486, lr=1]
Steps:  54%|█████▍    | 648/1200 [05:18<04:30,  2.04it/s, loss=0.486, lr=1]
Steps:  54%|█████▍    | 648/1200 [05:18<04:30,  2.04it/s, loss=0.538, lr=1]
Steps:  54%|█████▍    | 649/1200 [05:19<04:31,  2.03it/s, loss=0.538, lr=1]
Steps:  54%|█████▍    | 649/1200 [05:19<04:31,  2.03it/s, loss=0.561, lr=1]
Steps:  54%|█████▍    | 650/1200 [05:19<04:30,  2.03it/s, loss=0.561, lr=1]
Steps:  54%|█████▍    | 650/1200 [05:19<04:30,  2.03it/s, loss=0.602, lr=1]
Steps:  54%|█████▍    | 651/1200 [05:20<04:29,  2.03it/s, loss=0.602, lr=1]
Steps:  54%|█████▍    | 651/1200 [05:20<04:29,  2.03it/s, loss=0.704, lr=1]
Steps:  54%|█████▍    | 652/1200 [05:20<04:29,  2.04it/s, loss=0.704, lr=1]
Steps:  54%|█████▍    | 652/1200 [05:20<04:29,  2.04it/s, loss=0.622, lr=1]
Steps:  54%|█████▍    | 653/1200 [05:21<04:28,  2.04it/s, loss=0.622, lr=1]
Steps:  54%|█████▍    | 653/1200 [05:21<04:28,  2.04it/s, loss=0.416, lr=1]
Steps:  55%|█████▍    | 654/1200 [05:21<04:28,  2.04it/s, loss=0.416, lr=1]
Steps:  55%|█████▍    | 654/1200 [05:21<04:28,  2.04it/s, loss=0.457, lr=1]
Steps:  55%|█████▍    | 655/1200 [05:22<04:27,  2.04it/s, loss=0.457, lr=1]
Steps:  55%|█████▍    | 655/1200 [05:22<04:27,  2.04it/s, loss=0.285, lr=1]
Steps:  55%|█████▍    | 656/1200 [05:22<04:27,  2.04it/s, loss=0.285, lr=1]
Steps:  55%|█████▍    | 656/1200 [05:22<04:27,  2.04it/s, loss=0.748, lr=1]
Steps:  55%|█████▍    | 657/1200 [05:23<04:26,  2.04it/s, loss=0.748, lr=1]
Steps:  55%|█████▍    | 657/1200 [05:23<04:26,  2.04it/s, loss=0.603, lr=1]
Steps:  55%|█████▍    | 658/1200 [05:23<04:25,  2.04it/s, loss=0.603, lr=1]
Steps:  55%|█████▍    | 658/1200 [05:23<04:25,  2.04it/s, loss=0.602, lr=1]
Steps:  55%|█████▍    | 659/1200 [05:24<04:25,  2.04it/s, loss=0.602, lr=1]
Steps:  55%|█████▍    | 659/1200 [05:24<04:25,  2.04it/s, loss=0.596, lr=1]
Steps:  55%|█████▌    | 660/1200 [05:24<04:24,  2.04it/s, loss=0.596, lr=1]
Steps:  55%|█████▌    | 660/1200 [05:24<04:24,  2.04it/s, loss=0.592, lr=1]
Steps:  55%|█████▌    | 661/1200 [05:25<04:25,  2.03it/s, loss=0.592, lr=1]
Steps:  55%|█████▌    | 661/1200 [05:25<04:25,  2.03it/s, loss=0.552, lr=1]
Steps:  55%|█████▌    | 662/1200 [05:25<04:24,  2.03it/s, loss=0.552, lr=1]
Steps:  55%|█████▌    | 662/1200 [05:25<04:24,  2.03it/s, loss=0.646, lr=1]
Steps:  55%|█████▌    | 663/1200 [05:26<04:23,  2.04it/s, loss=0.646, lr=1]
Steps:  55%|█████▌    | 663/1200 [05:26<04:23,  2.04it/s, loss=0.323, lr=1]
Steps:  55%|█████▌    | 664/1200 [05:26<04:22,  2.04it/s, loss=0.323, lr=1]
Steps:  55%|█████▌    | 664/1200 [05:26<04:22,  2.04it/s, loss=0.351, lr=1]
Steps:  55%|█████▌    | 665/1200 [05:26<04:22,  2.04it/s, loss=0.351, lr=1]
Steps:  55%|█████▌    | 665/1200 [05:26<04:22,  2.04it/s, loss=0.624, lr=1]
Steps:  56%|█████▌    | 666/1200 [05:27<04:21,  2.04it/s, loss=0.624, lr=1]
Steps:  56%|█████▌    | 666/1200 [05:27<04:21,  2.04it/s, loss=0.407, lr=1]
Steps:  56%|█████▌    | 667/1200 [05:27<04:21,  2.04it/s, loss=0.407, lr=1]
Steps:  56%|█████▌    | 667/1200 [05:27<04:21,  2.04it/s, loss=0.33, lr=1] 
Steps:  56%|█████▌    | 668/1200 [05:28<04:20,  2.04it/s, loss=0.33, lr=1]
Steps:  56%|█████▌    | 668/1200 [05:28<04:20,  2.04it/s, loss=0.553, lr=1]
Steps:  56%|█████▌    | 669/1200 [05:28<04:20,  2.04it/s, loss=0.553, lr=1]
Steps:  56%|█████▌    | 669/1200 [05:28<04:20,  2.04it/s, loss=0.296, lr=1]
Steps:  56%|█████▌    | 670/1200 [05:29<04:20,  2.04it/s, loss=0.296, lr=1]
Steps:  56%|█████▌    | 670/1200 [05:29<04:20,  2.04it/s, loss=0.788, lr=1]
Steps:  56%|█████▌    | 671/1200 [05:29<04:19,  2.04it/s, loss=0.788, lr=1]
Steps:  56%|█████▌    | 671/1200 [05:29<04:19,  2.04it/s, loss=0.424, lr=1]
Steps:  56%|█████▌    | 672/1200 [05:30<04:19,  2.04it/s, loss=0.424, lr=1]
Steps:  56%|█████▌    | 672/1200 [05:30<04:19,  2.04it/s, loss=0.33, lr=1] 
Steps:  56%|█████▌    | 673/1200 [05:30<04:19,  2.03it/s, loss=0.33, lr=1]
Steps:  56%|█████▌    | 673/1200 [05:30<04:19,  2.03it/s, loss=0.482, lr=1]
Steps:  56%|█████▌    | 674/1200 [05:31<04:18,  2.03it/s, loss=0.482, lr=1]
Steps:  56%|█████▌    | 674/1200 [05:31<04:18,  2.03it/s, loss=0.776, lr=1]
Steps:  56%|█████▋    | 675/1200 [05:31<04:17,  2.04it/s, loss=0.776, lr=1]
Steps:  56%|█████▋    | 675/1200 [05:31<04:17,  2.04it/s, loss=0.464, lr=1]
Steps:  56%|█████▋    | 676/1200 [05:32<04:17,  2.04it/s, loss=0.464, lr=1]
Steps:  56%|█████▋    | 676/1200 [05:32<04:17,  2.04it/s, loss=0.276, lr=1]
Steps:  56%|█████▋    | 677/1200 [05:32<04:16,  2.04it/s, loss=0.276, lr=1]
Steps:  56%|█████▋    | 677/1200 [05:32<04:16,  2.04it/s, loss=0.325, lr=1]
Steps:  56%|█████▋    | 678/1200 [05:33<04:16,  2.04it/s, loss=0.325, lr=1]
Steps:  56%|█████▋    | 678/1200 [05:33<04:16,  2.04it/s, loss=0.511, lr=1]
Steps:  57%|█████▋    | 679/1200 [05:33<04:15,  2.04it/s, loss=0.511, lr=1]
Steps:  57%|█████▋    | 679/1200 [05:33<04:15,  2.04it/s, loss=0.477, lr=1]
Steps:  57%|█████▋    | 680/1200 [05:34<04:15,  2.04it/s, loss=0.477, lr=1]
Steps:  57%|█████▋    | 680/1200 [05:34<04:15,  2.04it/s, loss=0.314, lr=1]
Steps:  57%|█████▋    | 681/1200 [05:34<04:14,  2.04it/s, loss=0.314, lr=1]
Steps:  57%|█████▋    | 681/1200 [05:34<04:14,  2.04it/s, loss=0.491, lr=1]
Steps:  57%|█████▋    | 682/1200 [05:35<04:14,  2.04it/s, loss=0.491, lr=1]
Steps:  57%|█████▋    | 682/1200 [05:35<04:14,  2.04it/s, loss=0.733, lr=1]
Steps:  57%|█████▋    | 683/1200 [05:35<04:13,  2.04it/s, loss=0.733, lr=1]
Steps:  57%|█████▋    | 683/1200 [05:35<04:13,  2.04it/s, loss=0.482, lr=1]
Steps:  57%|█████▋    | 684/1200 [05:36<04:13,  2.04it/s, loss=0.482, lr=1]
Steps:  57%|█████▋    | 684/1200 [05:36<04:13,  2.04it/s, loss=0.597, lr=1]
Steps:  57%|█████▋    | 685/1200 [05:36<04:13,  2.03it/s, loss=0.597, lr=1]
Steps:  57%|█████▋    | 685/1200 [05:36<04:13,  2.03it/s, loss=0.307, lr=1]
Steps:  57%|█████▋    | 686/1200 [05:37<04:12,  2.03it/s, loss=0.307, lr=1]
Steps:  57%|█████▋    | 686/1200 [05:37<04:12,  2.03it/s, loss=0.31, lr=1] 
Steps:  57%|█████▋    | 687/1200 [05:37<04:12,  2.03it/s, loss=0.31, lr=1]
Steps:  57%|█████▋    | 687/1200 [05:37<04:12,  2.03it/s, loss=0.301, lr=1]
Steps:  57%|█████▋    | 688/1200 [05:38<04:11,  2.04it/s, loss=0.301, lr=1]
Steps:  57%|█████▋    | 688/1200 [05:38<04:11,  2.04it/s, loss=0.673, lr=1]
Steps:  57%|█████▋    | 689/1200 [05:38<04:10,  2.04it/s, loss=0.673, lr=1]
Steps:  57%|█████▋    | 689/1200 [05:38<04:10,  2.04it/s, loss=0.304, lr=1]
Steps:  57%|█████▊    | 690/1200 [05:39<04:10,  2.04it/s, loss=0.304, lr=1]
Steps:  57%|█████▊    | 690/1200 [05:39<04:10,  2.04it/s, loss=0.28, lr=1] 
Steps:  58%|█████▊    | 691/1200 [05:39<04:09,  2.04it/s, loss=0.28, lr=1]
Steps:  58%|█████▊    | 691/1200 [05:39<04:09,  2.04it/s, loss=0.32, lr=1]
Steps:  58%|█████▊    | 692/1200 [05:40<04:09,  2.04it/s, loss=0.32, lr=1]
Steps:  58%|█████▊    | 692/1200 [05:40<04:09,  2.04it/s, loss=0.53, lr=1]
Steps:  58%|█████▊    | 693/1200 [05:40<04:08,  2.04it/s, loss=0.53, lr=1]
Steps:  58%|█████▊    | 693/1200 [05:40<04:08,  2.04it/s, loss=0.64, lr=1]
Steps:  58%|█████▊    | 694/1200 [05:41<04:08,  2.04it/s, loss=0.64, lr=1]
Steps:  58%|█████▊    | 694/1200 [05:41<04:08,  2.04it/s, loss=0.553, lr=1]
Steps:  58%|█████▊    | 695/1200 [05:41<04:07,  2.04it/s, loss=0.553, lr=1]
Steps:  58%|█████▊    | 695/1200 [05:41<04:07,  2.04it/s, loss=0.484, lr=1]
Steps:  58%|█████▊    | 696/1200 [05:42<04:06,  2.04it/s, loss=0.484, lr=1]
Steps:  58%|█████▊    | 696/1200 [05:42<04:06,  2.04it/s, loss=0.42, lr=1] 
Steps:  58%|█████▊    | 697/1200 [05:42<04:07,  2.03it/s, loss=0.42, lr=1]
Steps:  58%|█████▊    | 697/1200 [05:42<04:07,  2.03it/s, loss=0.778, lr=1]
Steps:  58%|█████▊    | 698/1200 [05:43<04:06,  2.03it/s, loss=0.778, lr=1]
Steps:  58%|█████▊    | 698/1200 [05:43<04:06,  2.03it/s, loss=0.462, lr=1]
Steps:  58%|█████▊    | 699/1200 [05:43<04:06,  2.03it/s, loss=0.462, lr=1]
Steps:  58%|█████▊    | 699/1200 [05:43<04:06,  2.03it/s, loss=0.512, lr=1]
Steps:  58%|█████▊    | 700/1200 [05:44<04:05,  2.04it/s, loss=0.512, lr=1]
Steps:  58%|█████▊    | 700/1200 [05:44<04:05,  2.04it/s, loss=0.454, lr=1]
Steps:  58%|█████▊    | 701/1200 [05:44<04:04,  2.04it/s, loss=0.454, lr=1]
Steps:  58%|█████▊    | 701/1200 [05:44<04:04,  2.04it/s, loss=0.366, lr=1]
Steps:  58%|█████▊    | 702/1200 [05:45<04:04,  2.04it/s, loss=0.366, lr=1]
Steps:  58%|█████▊    | 702/1200 [05:45<04:04,  2.04it/s, loss=0.327, lr=1]
Steps:  59%|█████▊    | 703/1200 [05:45<04:03,  2.04it/s, loss=0.327, lr=1]
Steps:  59%|█████▊    | 703/1200 [05:45<04:03,  2.04it/s, loss=0.326, lr=1]
Steps:  59%|█████▊    | 704/1200 [05:46<04:03,  2.04it/s, loss=0.326, lr=1]
Steps:  59%|█████▊    | 704/1200 [05:46<04:03,  2.04it/s, loss=0.325, lr=1]
Steps:  59%|█████▉    | 705/1200 [05:46<04:02,  2.04it/s, loss=0.325, lr=1]
Steps:  59%|█████▉    | 705/1200 [05:46<04:02,  2.04it/s, loss=0.353, lr=1]
Steps:  59%|█████▉    | 706/1200 [05:47<04:02,  2.04it/s, loss=0.353, lr=1]
Steps:  59%|█████▉    | 706/1200 [05:47<04:02,  2.04it/s, loss=0.608, lr=1]
Steps:  59%|█████▉    | 707/1200 [05:47<04:01,  2.04it/s, loss=0.608, lr=1]
Steps:  59%|█████▉    | 707/1200 [05:47<04:01,  2.04it/s, loss=0.314, lr=1]
Steps:  59%|█████▉    | 708/1200 [05:48<04:01,  2.04it/s, loss=0.314, lr=1]
Steps:  59%|█████▉    | 708/1200 [05:48<04:01,  2.04it/s, loss=0.448, lr=1]
Steps:  59%|█████▉    | 709/1200 [05:48<04:01,  2.03it/s, loss=0.448, lr=1]
Steps:  59%|█████▉    | 709/1200 [05:48<04:01,  2.03it/s, loss=0.449, lr=1]
Steps:  59%|█████▉    | 710/1200 [05:49<04:00,  2.04it/s, loss=0.449, lr=1]
Steps:  59%|█████▉    | 710/1200 [05:49<04:00,  2.04it/s, loss=0.501, lr=1]
Steps:  59%|█████▉    | 711/1200 [05:49<03:59,  2.04it/s, loss=0.501, lr=1]
Steps:  59%|█████▉    | 711/1200 [05:49<03:59,  2.04it/s, loss=0.426, lr=1]
Steps:  59%|█████▉    | 712/1200 [05:50<03:59,  2.04it/s, loss=0.426, lr=1]
Steps:  59%|█████▉    | 712/1200 [05:50<03:59,  2.04it/s, loss=0.288, lr=1]
Steps:  59%|█████▉    | 713/1200 [05:50<03:58,  2.04it/s, loss=0.288, lr=1]
Steps:  59%|█████▉    | 713/1200 [05:50<03:58,  2.04it/s, loss=0.775, lr=1]
Steps:  60%|█████▉    | 714/1200 [05:51<03:58,  2.04it/s, loss=0.775, lr=1]
Steps:  60%|█████▉    | 714/1200 [05:51<03:58,  2.04it/s, loss=0.489, lr=1]
Steps:  60%|█████▉    | 715/1200 [05:51<03:57,  2.04it/s, loss=0.489, lr=1]
Steps:  60%|█████▉    | 715/1200 [05:51<03:57,  2.04it/s, loss=0.538, lr=1]
Steps:  60%|█████▉    | 716/1200 [05:52<03:57,  2.04it/s, loss=0.538, lr=1]
Steps:  60%|█████▉    | 716/1200 [05:52<03:57,  2.04it/s, loss=0.269, lr=1]
Steps:  60%|█████▉    | 717/1200 [05:52<03:56,  2.04it/s, loss=0.269, lr=1]
Steps:  60%|█████▉    | 717/1200 [05:52<03:56,  2.04it/s, loss=0.574, lr=1]
Steps:  60%|█████▉    | 718/1200 [05:53<03:56,  2.04it/s, loss=0.574, lr=1]
Steps:  60%|█████▉    | 718/1200 [05:53<03:56,  2.04it/s, loss=0.357, lr=1]
Steps:  60%|█████▉    | 719/1200 [05:53<03:55,  2.04it/s, loss=0.357, lr=1]
Steps:  60%|█████▉    | 719/1200 [05:53<03:55,  2.04it/s, loss=0.591, lr=1]
Steps:  60%|██████    | 720/1200 [05:53<03:54,  2.04it/s, loss=0.591, lr=1]
Steps:  60%|██████    | 720/1200 [05:53<03:54,  2.04it/s, loss=0.381, lr=1]
Steps:  60%|██████    | 721/1200 [05:54<03:55,  2.03it/s, loss=0.381, lr=1]
Steps:  60%|██████    | 721/1200 [05:54<03:55,  2.03it/s, loss=0.292, lr=1]
Steps:  60%|██████    | 722/1200 [05:54<03:54,  2.04it/s, loss=0.292, lr=1]
Steps:  60%|██████    | 722/1200 [05:54<03:54,  2.04it/s, loss=0.702, lr=1]
Steps:  60%|██████    | 723/1200 [05:55<03:54,  2.04it/s, loss=0.702, lr=1]
Steps:  60%|██████    | 723/1200 [05:55<03:54,  2.04it/s, loss=0.523, lr=1]
Steps:  60%|██████    | 724/1200 [05:55<03:53,  2.04it/s, loss=0.523, lr=1]
Steps:  60%|██████    | 724/1200 [05:55<03:53,  2.04it/s, loss=0.423, lr=1]
Steps:  60%|██████    | 725/1200 [05:56<03:52,  2.04it/s, loss=0.423, lr=1]
Steps:  60%|██████    | 725/1200 [05:56<03:52,  2.04it/s, loss=0.484, lr=1]
Steps:  60%|██████    | 726/1200 [05:56<03:52,  2.04it/s, loss=0.484, lr=1]
Steps:  60%|██████    | 726/1200 [05:56<03:52,  2.04it/s, loss=0.591, lr=1]
Steps:  61%|██████    | 727/1200 [05:57<03:52,  2.04it/s, loss=0.591, lr=1]
Steps:  61%|██████    | 727/1200 [05:57<03:52,  2.04it/s, loss=0.807, lr=1]
Steps:  61%|██████    | 728/1200 [05:57<03:51,  2.04it/s, loss=0.807, lr=1]
Steps:  61%|██████    | 728/1200 [05:57<03:51,  2.04it/s, loss=0.469, lr=1]
Steps:  61%|██████    | 729/1200 [05:58<03:50,  2.04it/s, loss=0.469, lr=1]
Steps:  61%|██████    | 729/1200 [05:58<03:50,  2.04it/s, loss=0.361, lr=1]
Steps:  61%|██████    | 730/1200 [05:58<03:50,  2.04it/s, loss=0.361, lr=1]
Steps:  61%|██████    | 730/1200 [05:58<03:50,  2.04it/s, loss=0.294, lr=1]
Steps:  61%|██████    | 731/1200 [05:59<03:49,  2.04it/s, loss=0.294, lr=1]
Steps:  61%|██████    | 731/1200 [05:59<03:49,  2.04it/s, loss=0.555, lr=1]
Steps:  61%|██████    | 732/1200 [05:59<03:49,  2.04it/s, loss=0.555, lr=1]
Steps:  61%|██████    | 732/1200 [05:59<03:49,  2.04it/s, loss=0.392, lr=1]
Steps:  61%|██████    | 733/1200 [06:00<03:49,  2.03it/s, loss=0.392, lr=1]
Steps:  61%|██████    | 733/1200 [06:00<03:49,  2.03it/s, loss=0.348, lr=1]
Steps:  61%|██████    | 734/1200 [06:00<03:48,  2.04it/s, loss=0.348, lr=1]
Steps:  61%|██████    | 734/1200 [06:00<03:48,  2.04it/s, loss=0.625, lr=1]
Steps:  61%|██████▏   | 735/1200 [06:01<03:48,  2.04it/s, loss=0.625, lr=1]
Steps:  61%|██████▏   | 735/1200 [06:01<03:48,  2.04it/s, loss=0.346, lr=1]
Steps:  61%|██████▏   | 736/1200 [06:01<03:47,  2.04it/s, loss=0.346, lr=1]
Steps:  61%|██████▏   | 736/1200 [06:01<03:47,  2.04it/s, loss=0.331, lr=1]
Steps:  61%|██████▏   | 737/1200 [06:02<03:46,  2.04it/s, loss=0.331, lr=1]
Steps:  61%|██████▏   | 737/1200 [06:02<03:46,  2.04it/s, loss=0.322, lr=1]
Steps:  62%|██████▏   | 738/1200 [06:02<03:46,  2.04it/s, loss=0.322, lr=1]
Steps:  62%|██████▏   | 738/1200 [06:02<03:46,  2.04it/s, loss=0.391, lr=1]
Steps:  62%|██████▏   | 739/1200 [06:03<03:45,  2.04it/s, loss=0.391, lr=1]
Steps:  62%|██████▏   | 739/1200 [06:03<03:45,  2.04it/s, loss=0.617, lr=1]
Steps:  62%|██████▏   | 740/1200 [06:03<03:45,  2.04it/s, loss=0.617, lr=1]
Steps:  62%|██████▏   | 740/1200 [06:03<03:45,  2.04it/s, loss=0.648, lr=1]
Steps:  62%|██████▏   | 741/1200 [06:04<03:44,  2.04it/s, loss=0.648, lr=1]
Steps:  62%|██████▏   | 741/1200 [06:04<03:44,  2.04it/s, loss=0.275, lr=1]
Steps:  62%|██████▏   | 742/1200 [06:04<03:44,  2.04it/s, loss=0.275, lr=1]
Steps:  62%|██████▏   | 742/1200 [06:04<03:44,  2.04it/s, loss=0.658, lr=1]
Steps:  62%|██████▏   | 743/1200 [06:05<03:43,  2.04it/s, loss=0.658, lr=1]
Steps:  62%|██████▏   | 743/1200 [06:05<03:43,  2.04it/s, loss=0.324, lr=1]
Steps:  62%|██████▏   | 744/1200 [06:05<03:43,  2.04it/s, loss=0.324, lr=1]
Steps:  62%|██████▏   | 744/1200 [06:05<03:43,  2.04it/s, loss=0.76, lr=1] 
Steps:  62%|██████▏   | 745/1200 [06:06<03:43,  2.03it/s, loss=0.76, lr=1]
Steps:  62%|██████▏   | 745/1200 [06:06<03:43,  2.03it/s, loss=0.298, lr=1]
Steps:  62%|██████▏   | 746/1200 [06:06<03:42,  2.04it/s, loss=0.298, lr=1]
Steps:  62%|██████▏   | 746/1200 [06:06<03:42,  2.04it/s, loss=0.564, lr=1]
Steps:  62%|██████▏   | 747/1200 [06:07<03:42,  2.04it/s, loss=0.564, lr=1]
Steps:  62%|██████▏   | 747/1200 [06:07<03:42,  2.04it/s, loss=0.281, lr=1]
Steps:  62%|██████▏   | 748/1200 [06:07<03:41,  2.04it/s, loss=0.281, lr=1]
Steps:  62%|██████▏   | 748/1200 [06:07<03:41,  2.04it/s, loss=0.634, lr=1]
Steps:  62%|██████▏   | 749/1200 [06:08<03:40,  2.04it/s, loss=0.634, lr=1]
Steps:  62%|██████▏   | 749/1200 [06:08<03:40,  2.04it/s, loss=0.879, lr=1]
Steps:  62%|██████▎   | 750/1200 [06:08<03:40,  2.04it/s, loss=0.879, lr=1]
Steps:  62%|██████▎   | 750/1200 [06:08<03:40,  2.04it/s, loss=0.598, lr=1]
Steps:  63%|██████▎   | 751/1200 [06:09<03:39,  2.04it/s, loss=0.598, lr=1]
Steps:  63%|██████▎   | 751/1200 [06:09<03:39,  2.04it/s, loss=0.379, lr=1]
Steps:  63%|██████▎   | 752/1200 [06:09<03:39,  2.04it/s, loss=0.379, lr=1]
Steps:  63%|██████▎   | 752/1200 [06:09<03:39,  2.04it/s, loss=0.493, lr=1]
Steps:  63%|██████▎   | 753/1200 [06:10<03:38,  2.04it/s, loss=0.493, lr=1]
Steps:  63%|██████▎   | 753/1200 [06:10<03:38,  2.04it/s, loss=0.646, lr=1]
Steps:  63%|██████▎   | 754/1200 [06:10<03:38,  2.04it/s, loss=0.646, lr=1]
Steps:  63%|██████▎   | 754/1200 [06:10<03:38,  2.04it/s, loss=0.625, lr=1]
Steps:  63%|██████▎   | 755/1200 [06:11<03:38,  2.04it/s, loss=0.625, lr=1]
Steps:  63%|██████▎   | 755/1200 [06:11<03:38,  2.04it/s, loss=0.376, lr=1]
Steps:  63%|██████▎   | 756/1200 [06:11<03:37,  2.04it/s, loss=0.376, lr=1]
Steps:  63%|██████▎   | 756/1200 [06:11<03:37,  2.04it/s, loss=0.839, lr=1]
Steps:  63%|██████▎   | 757/1200 [06:12<03:37,  2.03it/s, loss=0.839, lr=1]
Steps:  63%|██████▎   | 757/1200 [06:12<03:37,  2.03it/s, loss=0.635, lr=1]
Steps:  63%|██████▎   | 758/1200 [06:12<03:37,  2.03it/s, loss=0.635, lr=1]
Steps:  63%|██████▎   | 758/1200 [06:12<03:37,  2.03it/s, loss=0.39, lr=1] 
Steps:  63%|██████▎   | 759/1200 [06:13<03:36,  2.04it/s, loss=0.39, lr=1]
Steps:  63%|██████▎   | 759/1200 [06:13<03:36,  2.04it/s, loss=0.717, lr=1]
Steps:  63%|██████▎   | 760/1200 [06:13<03:36,  2.04it/s, loss=0.717, lr=1]
Steps:  63%|██████▎   | 760/1200 [06:13<03:36,  2.04it/s, loss=0.61, lr=1] 
Steps:  63%|██████▎   | 761/1200 [06:14<03:35,  2.04it/s, loss=0.61, lr=1]
Steps:  63%|██████▎   | 761/1200 [06:14<03:35,  2.04it/s, loss=0.314, lr=1]
Steps:  64%|██████▎   | 762/1200 [06:14<03:36,  2.03it/s, loss=0.314, lr=1]
Steps:  64%|██████▎   | 762/1200 [06:14<03:36,  2.03it/s, loss=0.571, lr=1]
Steps:  64%|██████▎   | 763/1200 [06:15<03:35,  2.03it/s, loss=0.571, lr=1]
Steps:  64%|██████▎   | 763/1200 [06:15<03:35,  2.03it/s, loss=0.596, lr=1]
Steps:  64%|██████▎   | 764/1200 [06:15<03:34,  2.03it/s, loss=0.596, lr=1]
Steps:  64%|██████▎   | 764/1200 [06:15<03:34,  2.03it/s, loss=0.281, lr=1]
Steps:  64%|██████▍   | 765/1200 [06:16<03:34,  2.03it/s, loss=0.281, lr=1]
Steps:  64%|██████▍   | 765/1200 [06:16<03:34,  2.03it/s, loss=0.276, lr=1]
Steps:  64%|██████▍   | 766/1200 [06:16<03:36,  2.01it/s, loss=0.276, lr=1]
Steps:  64%|██████▍   | 766/1200 [06:16<03:36,  2.01it/s, loss=0.312, lr=1]
Steps:  64%|██████▍   | 767/1200 [06:17<03:34,  2.02it/s, loss=0.312, lr=1]
Steps:  64%|██████▍   | 767/1200 [06:17<03:34,  2.02it/s, loss=0.463, lr=1]
Steps:  64%|██████▍   | 768/1200 [06:17<03:33,  2.03it/s, loss=0.463, lr=1]
Steps:  64%|██████▍   | 768/1200 [06:17<03:33,  2.03it/s, loss=0.312, lr=1]
Steps:  64%|██████▍   | 769/1200 [06:18<03:33,  2.02it/s, loss=0.312, lr=1]
Steps:  64%|██████▍   | 769/1200 [06:18<03:33,  2.02it/s, loss=0.27, lr=1] 
Steps:  64%|██████▍   | 770/1200 [06:18<03:32,  2.03it/s, loss=0.27, lr=1]
Steps:  64%|██████▍   | 770/1200 [06:18<03:32,  2.03it/s, loss=0.448, lr=1]
Steps:  64%|██████▍   | 771/1200 [06:19<03:31,  2.03it/s, loss=0.448, lr=1]
Steps:  64%|██████▍   | 771/1200 [06:19<03:31,  2.03it/s, loss=0.3, lr=1]  
Steps:  64%|██████▍   | 772/1200 [06:19<03:30,  2.03it/s, loss=0.3, lr=1]
Steps:  64%|██████▍   | 772/1200 [06:19<03:30,  2.03it/s, loss=0.641, lr=1]
Steps:  64%|██████▍   | 773/1200 [06:20<03:29,  2.04it/s, loss=0.641, lr=1]
Steps:  64%|██████▍   | 773/1200 [06:20<03:29,  2.04it/s, loss=0.616, lr=1]
Steps:  64%|██████▍   | 774/1200 [06:20<03:29,  2.04it/s, loss=0.616, lr=1]
Steps:  64%|██████▍   | 774/1200 [06:20<03:29,  2.04it/s, loss=0.506, lr=1]
Steps:  65%|██████▍   | 775/1200 [06:21<03:28,  2.04it/s, loss=0.506, lr=1]
Steps:  65%|██████▍   | 775/1200 [06:21<03:28,  2.04it/s, loss=0.406, lr=1]
Steps:  65%|██████▍   | 776/1200 [06:21<03:27,  2.04it/s, loss=0.406, lr=1]
Steps:  65%|██████▍   | 776/1200 [06:21<03:27,  2.04it/s, loss=0.591, lr=1]
Steps:  65%|██████▍   | 777/1200 [06:21<03:27,  2.04it/s, loss=0.591, lr=1]
Steps:  65%|██████▍   | 777/1200 [06:21<03:27,  2.04it/s, loss=0.372, lr=1]
Steps:  65%|██████▍   | 778/1200 [06:22<03:26,  2.04it/s, loss=0.372, lr=1]
Steps:  65%|██████▍   | 778/1200 [06:22<03:26,  2.04it/s, loss=0.36, lr=1] 
Steps:  65%|██████▍   | 779/1200 [06:22<03:26,  2.04it/s, loss=0.36, lr=1]
Steps:  65%|██████▍   | 779/1200 [06:22<03:26,  2.04it/s, loss=0.364, lr=1]
Steps:  65%|██████▌   | 780/1200 [06:23<03:25,  2.04it/s, loss=0.364, lr=1]
Steps:  65%|██████▌   | 780/1200 [06:23<03:25,  2.04it/s, loss=0.297, lr=1]
Steps:  65%|██████▌   | 781/1200 [06:23<03:26,  2.03it/s, loss=0.297, lr=1]
Steps:  65%|██████▌   | 781/1200 [06:23<03:26,  2.03it/s, loss=0.664, lr=1]
Steps:  65%|██████▌   | 782/1200 [06:24<03:25,  2.03it/s, loss=0.664, lr=1]
Steps:  65%|██████▌   | 782/1200 [06:24<03:25,  2.03it/s, loss=0.636, lr=1]
Steps:  65%|██████▌   | 783/1200 [06:24<03:24,  2.04it/s, loss=0.636, lr=1]
Steps:  65%|██████▌   | 783/1200 [06:24<03:24,  2.04it/s, loss=0.592, lr=1]
Steps:  65%|██████▌   | 784/1200 [06:25<03:24,  2.04it/s, loss=0.592, lr=1]
Steps:  65%|██████▌   | 784/1200 [06:25<03:24,  2.04it/s, loss=0.547, lr=1]
Steps:  65%|██████▌   | 785/1200 [06:25<03:23,  2.04it/s, loss=0.547, lr=1]
Steps:  65%|██████▌   | 785/1200 [06:25<03:23,  2.04it/s, loss=0.426, lr=1]
Steps:  66%|██████▌   | 786/1200 [06:26<03:23,  2.04it/s, loss=0.426, lr=1]
Steps:  66%|██████▌   | 786/1200 [06:26<03:23,  2.04it/s, loss=0.286, lr=1]
Steps:  66%|██████▌   | 787/1200 [06:26<03:22,  2.04it/s, loss=0.286, lr=1]
Steps:  66%|██████▌   | 787/1200 [06:26<03:22,  2.04it/s, loss=0.56, lr=1] 
Steps:  66%|██████▌   | 788/1200 [06:27<03:22,  2.04it/s, loss=0.56, lr=1]
Steps:  66%|██████▌   | 788/1200 [06:27<03:22,  2.04it/s, loss=0.621, lr=1]
Steps:  66%|██████▌   | 789/1200 [06:27<03:21,  2.04it/s, loss=0.621, lr=1]
Steps:  66%|██████▌   | 789/1200 [06:27<03:21,  2.04it/s, loss=0.322, lr=1]
Steps:  66%|██████▌   | 790/1200 [06:28<03:21,  2.04it/s, loss=0.322, lr=1]
Steps:  66%|██████▌   | 790/1200 [06:28<03:21,  2.04it/s, loss=0.609, lr=1]
Steps:  66%|██████▌   | 791/1200 [06:28<03:20,  2.04it/s, loss=0.609, lr=1]
Steps:  66%|██████▌   | 791/1200 [06:28<03:20,  2.04it/s, loss=0.698, lr=1]
Steps:  66%|██████▌   | 792/1200 [06:29<03:20,  2.04it/s, loss=0.698, lr=1]
Steps:  66%|██████▌   | 792/1200 [06:29<03:20,  2.04it/s, loss=0.286, lr=1]
Steps:  66%|██████▌   | 793/1200 [06:29<03:20,  2.03it/s, loss=0.286, lr=1]
Steps:  66%|██████▌   | 793/1200 [06:29<03:20,  2.03it/s, loss=0.579, lr=1]
Steps:  66%|██████▌   | 794/1200 [06:30<03:19,  2.03it/s, loss=0.579, lr=1]
Steps:  66%|██████▌   | 794/1200 [06:30<03:19,  2.03it/s, loss=0.429, lr=1]
Steps:  66%|██████▋   | 795/1200 [06:30<03:19,  2.03it/s, loss=0.429, lr=1]
Steps:  66%|██████▋   | 795/1200 [06:30<03:19,  2.03it/s, loss=0.48, lr=1] 
Steps:  66%|██████▋   | 796/1200 [06:31<03:18,  2.04it/s, loss=0.48, lr=1]
Steps:  66%|██████▋   | 796/1200 [06:31<03:18,  2.04it/s, loss=0.295, lr=1]
Steps:  66%|██████▋   | 797/1200 [06:31<03:17,  2.04it/s, loss=0.295, lr=1]
Steps:  66%|██████▋   | 797/1200 [06:31<03:17,  2.04it/s, loss=0.32, lr=1] 
Steps:  66%|██████▋   | 798/1200 [06:32<03:17,  2.04it/s, loss=0.32, lr=1]
Steps:  66%|██████▋   | 798/1200 [06:32<03:17,  2.04it/s, loss=0.348, lr=1]
Steps:  67%|██████▋   | 799/1200 [06:32<03:16,  2.04it/s, loss=0.348, lr=1]
Steps:  67%|██████▋   | 799/1200 [06:32<03:16,  2.04it/s, loss=0.343, lr=1]
Steps:  67%|██████▋   | 800/1200 [06:33<03:16,  2.04it/s, loss=0.343, lr=1]
Steps:  67%|██████▋   | 800/1200 [06:33<03:16,  2.04it/s, loss=0.4, lr=1]  
Steps:  67%|██████▋   | 801/1200 [06:33<03:15,  2.04it/s, loss=0.4, lr=1]
Steps:  67%|██████▋   | 801/1200 [06:33<03:15,  2.04it/s, loss=0.309, lr=1]
Steps:  67%|██████▋   | 802/1200 [06:34<03:15,  2.04it/s, loss=0.309, lr=1]
Steps:  67%|██████▋   | 802/1200 [06:34<03:15,  2.04it/s, loss=0.586, lr=1]
Steps:  67%|██████▋   | 803/1200 [06:34<03:14,  2.04it/s, loss=0.586, lr=1]
Steps:  67%|██████▋   | 803/1200 [06:34<03:14,  2.04it/s, loss=0.322, lr=1]
Steps:  67%|██████▋   | 804/1200 [06:35<03:14,  2.04it/s, loss=0.322, lr=1]
Steps:  67%|██████▋   | 804/1200 [06:35<03:14,  2.04it/s, loss=0.6, lr=1]  
Steps:  67%|██████▋   | 805/1200 [06:35<03:14,  2.03it/s, loss=0.6, lr=1]
Steps:  67%|██████▋   | 805/1200 [06:35<03:14,  2.03it/s, loss=0.572, lr=1]
Steps:  67%|██████▋   | 806/1200 [06:36<03:13,  2.03it/s, loss=0.572, lr=1]
Steps:  67%|██████▋   | 806/1200 [06:36<03:13,  2.03it/s, loss=0.408, lr=1]
Steps:  67%|██████▋   | 807/1200 [06:36<03:13,  2.03it/s, loss=0.408, lr=1]
Steps:  67%|██████▋   | 807/1200 [06:36<03:13,  2.03it/s, loss=0.289, lr=1]
Steps:  67%|██████▋   | 808/1200 [06:37<03:12,  2.04it/s, loss=0.289, lr=1]
Steps:  67%|██████▋   | 808/1200 [06:37<03:12,  2.04it/s, loss=0.703, lr=1]
Steps:  67%|██████▋   | 809/1200 [06:37<03:11,  2.04it/s, loss=0.703, lr=1]
Steps:  67%|██████▋   | 809/1200 [06:37<03:11,  2.04it/s, loss=0.297, lr=1]
Steps:  68%|██████▊   | 810/1200 [06:38<03:11,  2.04it/s, loss=0.297, lr=1]
Steps:  68%|██████▊   | 810/1200 [06:38<03:11,  2.04it/s, loss=0.356, lr=1]
Steps:  68%|██████▊   | 811/1200 [06:38<03:10,  2.04it/s, loss=0.356, lr=1]
Steps:  68%|██████▊   | 811/1200 [06:38<03:10,  2.04it/s, loss=0.61, lr=1] 
Steps:  68%|██████▊   | 812/1200 [06:39<03:10,  2.04it/s, loss=0.61, lr=1]
Steps:  68%|██████▊   | 812/1200 [06:39<03:10,  2.04it/s, loss=0.633, lr=1]
Steps:  68%|██████▊   | 813/1200 [06:39<03:09,  2.04it/s, loss=0.633, lr=1]
Steps:  68%|██████▊   | 813/1200 [06:39<03:09,  2.04it/s, loss=0.32, lr=1] 
Steps:  68%|██████▊   | 814/1200 [06:40<03:09,  2.04it/s, loss=0.32, lr=1]
Steps:  68%|██████▊   | 814/1200 [06:40<03:09,  2.04it/s, loss=0.372, lr=1]
Steps:  68%|██████▊   | 815/1200 [06:40<03:08,  2.04it/s, loss=0.372, lr=1]
Steps:  68%|██████▊   | 815/1200 [06:40<03:08,  2.04it/s, loss=0.621, lr=1]
Steps:  68%|██████▊   | 816/1200 [06:41<03:08,  2.04it/s, loss=0.621, lr=1]
Steps:  68%|██████▊   | 816/1200 [06:41<03:08,  2.04it/s, loss=0.62, lr=1] 
Steps:  68%|██████▊   | 817/1200 [06:41<03:08,  2.03it/s, loss=0.62, lr=1]
Steps:  68%|██████▊   | 817/1200 [06:41<03:08,  2.03it/s, loss=0.573, lr=1]
Steps:  68%|██████▊   | 818/1200 [06:42<03:07,  2.03it/s, loss=0.573, lr=1]
Steps:  68%|██████▊   | 818/1200 [06:42<03:07,  2.03it/s, loss=0.66, lr=1] 
Steps:  68%|██████▊   | 819/1200 [06:42<03:07,  2.04it/s, loss=0.66, lr=1]
Steps:  68%|██████▊   | 819/1200 [06:42<03:07,  2.04it/s, loss=0.615, lr=1]
Steps:  68%|██████▊   | 820/1200 [06:43<03:22,  1.88it/s, loss=0.615, lr=1]
Steps:  68%|██████▊   | 820/1200 [06:43<03:22,  1.88it/s, loss=0.362, lr=1]
Steps:  68%|██████▊   | 821/1200 [06:43<03:17,  1.92it/s, loss=0.362, lr=1]
Steps:  68%|██████▊   | 821/1200 [06:43<03:17,  1.92it/s, loss=0.665, lr=1]
Steps:  68%|██████▊   | 822/1200 [06:44<03:13,  1.96it/s, loss=0.665, lr=1]
Steps:  68%|██████▊   | 822/1200 [06:44<03:13,  1.96it/s, loss=0.583, lr=1]
Steps:  69%|██████▊   | 823/1200 [06:44<03:10,  1.98it/s, loss=0.583, lr=1]
Steps:  69%|██████▊   | 823/1200 [06:44<03:10,  1.98it/s, loss=0.554, lr=1]
Steps:  69%|██████▊   | 824/1200 [06:45<03:08,  2.00it/s, loss=0.554, lr=1]
Steps:  69%|██████▊   | 824/1200 [06:45<03:08,  2.00it/s, loss=0.764, lr=1]
Steps:  69%|██████▉   | 825/1200 [06:45<03:06,  2.01it/s, loss=0.764, lr=1]
Steps:  69%|██████▉   | 825/1200 [06:45<03:06,  2.01it/s, loss=0.612, lr=1]
Steps:  69%|██████▉   | 826/1200 [06:46<03:05,  2.02it/s, loss=0.612, lr=1]
Steps:  69%|██████▉   | 826/1200 [06:46<03:05,  2.02it/s, loss=0.37, lr=1] 
Steps:  69%|██████▉   | 827/1200 [06:46<03:04,  2.02it/s, loss=0.37, lr=1]
Steps:  69%|██████▉   | 827/1200 [06:46<03:04,  2.02it/s, loss=0.499, lr=1]
Steps:  69%|██████▉   | 828/1200 [06:47<03:03,  2.03it/s, loss=0.499, lr=1]
Steps:  69%|██████▉   | 828/1200 [06:47<03:03,  2.03it/s, loss=0.44, lr=1] 
Steps:  69%|██████▉   | 829/1200 [06:47<03:03,  2.02it/s, loss=0.44, lr=1]
Steps:  69%|██████▉   | 829/1200 [06:47<03:03,  2.02it/s, loss=0.665, lr=1]
Steps:  69%|██████▉   | 830/1200 [06:48<03:02,  2.03it/s, loss=0.665, lr=1]
Steps:  69%|██████▉   | 830/1200 [06:48<03:02,  2.03it/s, loss=0.372, lr=1]
Steps:  69%|██████▉   | 831/1200 [06:48<03:01,  2.03it/s, loss=0.372, lr=1]
Steps:  69%|██████▉   | 831/1200 [06:48<03:01,  2.03it/s, loss=0.528, lr=1]
Steps:  69%|██████▉   | 832/1200 [06:49<03:01,  2.03it/s, loss=0.528, lr=1]
Steps:  69%|██████▉   | 832/1200 [06:49<03:01,  2.03it/s, loss=0.319, lr=1]
Steps:  69%|██████▉   | 833/1200 [06:49<03:00,  2.03it/s, loss=0.319, lr=1]
Steps:  69%|██████▉   | 833/1200 [06:49<03:00,  2.03it/s, loss=0.348, lr=1]
Steps:  70%|██████▉   | 834/1200 [06:50<02:59,  2.04it/s, loss=0.348, lr=1]
Steps:  70%|██████▉   | 834/1200 [06:50<02:59,  2.04it/s, loss=0.301, lr=1]
Steps:  70%|██████▉   | 835/1200 [06:50<02:59,  2.04it/s, loss=0.301, lr=1]
Steps:  70%|██████▉   | 835/1200 [06:50<02:59,  2.04it/s, loss=0.322, lr=1]
Steps:  70%|██████▉   | 836/1200 [06:51<02:58,  2.04it/s, loss=0.322, lr=1]
Steps:  70%|██████▉   | 836/1200 [06:51<02:58,  2.04it/s, loss=0.608, lr=1]
Steps:  70%|██████▉   | 837/1200 [06:51<02:58,  2.04it/s, loss=0.608, lr=1]
Steps:  70%|██████▉   | 837/1200 [06:51<02:58,  2.04it/s, loss=0.26, lr=1] 
Steps:  70%|██████▉   | 838/1200 [06:52<02:57,  2.04it/s, loss=0.26, lr=1]
Steps:  70%|██████▉   | 838/1200 [06:52<02:57,  2.04it/s, loss=0.405, lr=1]
Steps:  70%|██████▉   | 839/1200 [06:52<02:56,  2.04it/s, loss=0.405, lr=1]
Steps:  70%|██████▉   | 839/1200 [06:52<02:56,  2.04it/s, loss=0.37, lr=1] 
Steps:  70%|███████   | 840/1200 [06:53<02:56,  2.04it/s, loss=0.37, lr=1]
Steps:  70%|███████   | 840/1200 [06:53<02:56,  2.04it/s, loss=0.641, lr=1]
Steps:  70%|███████   | 841/1200 [06:53<02:57,  2.03it/s, loss=0.641, lr=1]
Steps:  70%|███████   | 841/1200 [06:53<02:57,  2.03it/s, loss=0.595, lr=1]
Steps:  70%|███████   | 842/1200 [06:54<02:56,  2.03it/s, loss=0.595, lr=1]
Steps:  70%|███████   | 842/1200 [06:54<02:56,  2.03it/s, loss=0.899, lr=1]
Steps:  70%|███████   | 843/1200 [06:54<02:55,  2.03it/s, loss=0.899, lr=1]
Steps:  70%|███████   | 843/1200 [06:54<02:55,  2.03it/s, loss=0.317, lr=1]
Steps:  70%|███████   | 844/1200 [06:55<02:55,  2.03it/s, loss=0.317, lr=1]
Steps:  70%|███████   | 844/1200 [06:55<02:55,  2.03it/s, loss=0.333, lr=1]
Steps:  70%|███████   | 845/1200 [06:55<02:54,  2.04it/s, loss=0.333, lr=1]
Steps:  70%|███████   | 845/1200 [06:55<02:54,  2.04it/s, loss=0.304, lr=1]
Steps:  70%|███████   | 846/1200 [06:56<02:53,  2.04it/s, loss=0.304, lr=1]
Steps:  70%|███████   | 846/1200 [06:56<02:53,  2.04it/s, loss=0.671, lr=1]
Steps:  71%|███████   | 847/1200 [06:56<02:53,  2.04it/s, loss=0.671, lr=1]
Steps:  71%|███████   | 847/1200 [06:56<02:53,  2.04it/s, loss=0.581, lr=1]
Steps:  71%|███████   | 848/1200 [06:56<02:52,  2.04it/s, loss=0.581, lr=1]
Steps:  71%|███████   | 848/1200 [06:56<02:52,  2.04it/s, loss=0.583, lr=1]
Steps:  71%|███████   | 849/1200 [06:57<02:52,  2.03it/s, loss=0.583, lr=1]
Steps:  71%|███████   | 849/1200 [06:57<02:52,  2.03it/s, loss=0.933, lr=1]
Steps:  71%|███████   | 850/1200 [06:57<02:52,  2.03it/s, loss=0.933, lr=1]
Steps:  71%|███████   | 850/1200 [06:57<02:52,  2.03it/s, loss=0.656, lr=1]
Steps:  71%|███████   | 851/1200 [06:58<02:51,  2.04it/s, loss=0.656, lr=1]
Steps:  71%|███████   | 851/1200 [06:58<02:51,  2.04it/s, loss=0.561, lr=1]
Steps:  71%|███████   | 852/1200 [06:58<02:50,  2.04it/s, loss=0.561, lr=1]
Steps:  71%|███████   | 852/1200 [06:58<02:50,  2.04it/s, loss=0.325, lr=1]
Steps:  71%|███████   | 853/1200 [06:59<02:51,  2.03it/s, loss=0.325, lr=1]
Steps:  71%|███████   | 853/1200 [06:59<02:51,  2.03it/s, loss=0.539, lr=1]
Steps:  71%|███████   | 854/1200 [06:59<02:50,  2.03it/s, loss=0.539, lr=1]
Steps:  71%|███████   | 854/1200 [06:59<02:50,  2.03it/s, loss=0.846, lr=1]
Steps:  71%|███████▏  | 855/1200 [07:00<02:49,  2.03it/s, loss=0.846, lr=1]
Steps:  71%|███████▏  | 855/1200 [07:00<02:49,  2.03it/s, loss=0.869, lr=1]
Steps:  71%|███████▏  | 856/1200 [07:00<02:49,  2.03it/s, loss=0.869, lr=1]
Steps:  71%|███████▏  | 856/1200 [07:00<02:49,  2.03it/s, loss=0.378, lr=1]
Steps:  71%|███████▏  | 857/1200 [07:01<02:48,  2.03it/s, loss=0.378, lr=1]
Steps:  71%|███████▏  | 857/1200 [07:01<02:48,  2.03it/s, loss=0.29, lr=1] 
Steps:  72%|███████▏  | 858/1200 [07:01<02:47,  2.04it/s, loss=0.29, lr=1]
Steps:  72%|███████▏  | 858/1200 [07:01<02:47,  2.04it/s, loss=0.702, lr=1]
Steps:  72%|███████▏  | 859/1200 [07:02<02:47,  2.04it/s, loss=0.702, lr=1]
Steps:  72%|███████▏  | 859/1200 [07:02<02:47,  2.04it/s, loss=0.43, lr=1] 
Steps:  72%|███████▏  | 860/1200 [07:02<02:46,  2.04it/s, loss=0.43, lr=1]
Steps:  72%|███████▏  | 860/1200 [07:02<02:46,  2.04it/s, loss=0.859, lr=1]
Steps:  72%|███████▏  | 861/1200 [07:03<02:46,  2.04it/s, loss=0.859, lr=1]
Steps:  72%|███████▏  | 861/1200 [07:03<02:46,  2.04it/s, loss=0.325, lr=1]
Steps:  72%|███████▏  | 862/1200 [07:03<02:45,  2.04it/s, loss=0.325, lr=1]
Steps:  72%|███████▏  | 862/1200 [07:03<02:45,  2.04it/s, loss=0.363, lr=1]
Steps:  72%|███████▏  | 863/1200 [07:04<02:45,  2.04it/s, loss=0.363, lr=1]
Steps:  72%|███████▏  | 863/1200 [07:04<02:45,  2.04it/s, loss=0.627, lr=1]
Steps:  72%|███████▏  | 864/1200 [07:04<02:44,  2.04it/s, loss=0.627, lr=1]
Steps:  72%|███████▏  | 864/1200 [07:04<02:44,  2.04it/s, loss=0.564, lr=1]
Steps:  72%|███████▏  | 865/1200 [07:05<02:45,  2.03it/s, loss=0.564, lr=1]
Steps:  72%|███████▏  | 865/1200 [07:05<02:45,  2.03it/s, loss=0.266, lr=1]
Steps:  72%|███████▏  | 866/1200 [07:05<02:44,  2.03it/s, loss=0.266, lr=1]
Steps:  72%|███████▏  | 866/1200 [07:05<02:44,  2.03it/s, loss=0.385, lr=1]
Steps:  72%|███████▏  | 867/1200 [07:06<02:43,  2.03it/s, loss=0.385, lr=1]
Steps:  72%|███████▏  | 867/1200 [07:06<02:43,  2.03it/s, loss=0.61, lr=1] 
Steps:  72%|███████▏  | 868/1200 [07:06<02:43,  2.04it/s, loss=0.61, lr=1]
Steps:  72%|███████▏  | 868/1200 [07:06<02:43,  2.04it/s, loss=0.772, lr=1]
Steps:  72%|███████▏  | 869/1200 [07:07<02:42,  2.04it/s, loss=0.772, lr=1]
Steps:  72%|███████▏  | 869/1200 [07:07<02:42,  2.04it/s, loss=0.627, lr=1]
Steps:  72%|███████▎  | 870/1200 [07:07<02:42,  2.03it/s, loss=0.627, lr=1]
Steps:  72%|███████▎  | 870/1200 [07:07<02:42,  2.03it/s, loss=0.322, lr=1]
Steps:  73%|███████▎  | 871/1200 [07:08<02:41,  2.04it/s, loss=0.322, lr=1]
Steps:  73%|███████▎  | 871/1200 [07:08<02:41,  2.04it/s, loss=0.338, lr=1]
Steps:  73%|███████▎  | 872/1200 [07:08<02:41,  2.04it/s, loss=0.338, lr=1]
Steps:  73%|███████▎  | 872/1200 [07:08<02:41,  2.04it/s, loss=0.861, lr=1]
Steps:  73%|███████▎  | 873/1200 [07:09<02:40,  2.04it/s, loss=0.861, lr=1]
Steps:  73%|███████▎  | 873/1200 [07:09<02:40,  2.04it/s, loss=0.788, lr=1]
Steps:  73%|███████▎  | 874/1200 [07:09<02:40,  2.04it/s, loss=0.788, lr=1]
Steps:  73%|███████▎  | 874/1200 [07:09<02:40,  2.04it/s, loss=0.764, lr=1]
Steps:  73%|███████▎  | 875/1200 [07:10<02:39,  2.04it/s, loss=0.764, lr=1]
Steps:  73%|███████▎  | 875/1200 [07:10<02:39,  2.04it/s, loss=0.273, lr=1]
Steps:  73%|███████▎  | 876/1200 [07:10<02:39,  2.04it/s, loss=0.273, lr=1]
Steps:  73%|███████▎  | 876/1200 [07:10<02:39,  2.04it/s, loss=0.451, lr=1]
Steps:  73%|███████▎  | 877/1200 [07:11<02:39,  2.03it/s, loss=0.451, lr=1]
Steps:  73%|███████▎  | 877/1200 [07:11<02:39,  2.03it/s, loss=0.377, lr=1]
Steps:  73%|███████▎  | 878/1200 [07:11<02:38,  2.03it/s, loss=0.377, lr=1]
Steps:  73%|███████▎  | 878/1200 [07:11<02:38,  2.03it/s, loss=0.292, lr=1]
Steps:  73%|███████▎  | 879/1200 [07:12<02:37,  2.03it/s, loss=0.292, lr=1]
Steps:  73%|███████▎  | 879/1200 [07:12<02:37,  2.03it/s, loss=0.481, lr=1]
Steps:  73%|███████▎  | 880/1200 [07:12<02:37,  2.04it/s, loss=0.481, lr=1]
Steps:  73%|███████▎  | 880/1200 [07:12<02:37,  2.04it/s, loss=0.305, lr=1]
Steps:  73%|███████▎  | 881/1200 [07:13<02:36,  2.04it/s, loss=0.305, lr=1]
Steps:  73%|███████▎  | 881/1200 [07:13<02:36,  2.04it/s, loss=0.459, lr=1]
Steps:  74%|███████▎  | 882/1200 [07:13<02:36,  2.03it/s, loss=0.459, lr=1]
Steps:  74%|███████▎  | 882/1200 [07:13<02:36,  2.03it/s, loss=0.583, lr=1]
Steps:  74%|███████▎  | 883/1200 [07:14<02:35,  2.03it/s, loss=0.583, lr=1]
Steps:  74%|███████▎  | 883/1200 [07:14<02:35,  2.03it/s, loss=0.566, lr=1]
Steps:  74%|███████▎  | 884/1200 [07:14<02:35,  2.04it/s, loss=0.566, lr=1]
Steps:  74%|███████▎  | 884/1200 [07:14<02:35,  2.04it/s, loss=0.373, lr=1]
Steps:  74%|███████▍  | 885/1200 [07:15<02:34,  2.04it/s, loss=0.373, lr=1]
Steps:  74%|███████▍  | 885/1200 [07:15<02:34,  2.04it/s, loss=0.977, lr=1]
Steps:  74%|███████▍  | 886/1200 [07:15<02:34,  2.04it/s, loss=0.977, lr=1]
Steps:  74%|███████▍  | 886/1200 [07:15<02:34,  2.04it/s, loss=0.374, lr=1]
Steps:  74%|███████▍  | 887/1200 [07:16<02:33,  2.04it/s, loss=0.374, lr=1]
Steps:  74%|███████▍  | 887/1200 [07:16<02:33,  2.04it/s, loss=0.591, lr=1]
Steps:  74%|███████▍  | 888/1200 [07:16<02:33,  2.04it/s, loss=0.591, lr=1]
Steps:  74%|███████▍  | 888/1200 [07:16<02:33,  2.04it/s, loss=0.526, lr=1]
Steps:  74%|███████▍  | 889/1200 [07:17<02:33,  2.03it/s, loss=0.526, lr=1]
Steps:  74%|███████▍  | 889/1200 [07:17<02:33,  2.03it/s, loss=0.37, lr=1] 
Steps:  74%|███████▍  | 890/1200 [07:17<02:32,  2.03it/s, loss=0.37, lr=1]
Steps:  74%|███████▍  | 890/1200 [07:17<02:32,  2.03it/s, loss=0.31, lr=1]
Steps:  74%|███████▍  | 891/1200 [07:18<02:31,  2.04it/s, loss=0.31, lr=1]
Steps:  74%|███████▍  | 891/1200 [07:18<02:31,  2.04it/s, loss=0.391, lr=1]
Steps:  74%|███████▍  | 892/1200 [07:18<02:31,  2.04it/s, loss=0.391, lr=1]
Steps:  74%|███████▍  | 892/1200 [07:18<02:31,  2.04it/s, loss=0.601, lr=1]
Steps:  74%|███████▍  | 893/1200 [07:19<02:30,  2.04it/s, loss=0.601, lr=1]
Steps:  74%|███████▍  | 893/1200 [07:19<02:30,  2.04it/s, loss=0.342, lr=1]
Steps:  74%|███████▍  | 894/1200 [07:19<02:30,  2.04it/s, loss=0.342, lr=1]
Steps:  74%|███████▍  | 894/1200 [07:19<02:30,  2.04it/s, loss=0.377, lr=1]
Steps:  75%|███████▍  | 895/1200 [07:20<02:29,  2.04it/s, loss=0.377, lr=1]
Steps:  75%|███████▍  | 895/1200 [07:20<02:29,  2.04it/s, loss=0.463, lr=1]
Steps:  75%|███████▍  | 896/1200 [07:20<02:29,  2.04it/s, loss=0.463, lr=1]
Steps:  75%|███████▍  | 896/1200 [07:20<02:29,  2.04it/s, loss=0.452, lr=1]
Steps:  75%|███████▍  | 897/1200 [07:21<02:28,  2.04it/s, loss=0.452, lr=1]
Steps:  75%|███████▍  | 897/1200 [07:21<02:28,  2.04it/s, loss=0.625, lr=1]
Steps:  75%|███████▍  | 898/1200 [07:21<02:28,  2.04it/s, loss=0.625, lr=1]
Steps:  75%|███████▍  | 898/1200 [07:21<02:28,  2.04it/s, loss=0.308, lr=1]
Steps:  75%|███████▍  | 899/1200 [07:22<02:27,  2.04it/s, loss=0.308, lr=1]
Steps:  75%|███████▍  | 899/1200 [07:22<02:27,  2.04it/s, loss=0.465, lr=1]
Steps:  75%|███████▌  | 900/1200 [07:22<02:26,  2.04it/s, loss=0.465, lr=1]
Steps:  75%|███████▌  | 900/1200 [07:22<02:26,  2.04it/s, loss=0.576, lr=1]
Steps:  75%|███████▌  | 901/1200 [07:23<02:27,  2.03it/s, loss=0.576, lr=1]
Steps:  75%|███████▌  | 901/1200 [07:23<02:27,  2.03it/s, loss=0.267, lr=1]
Steps:  75%|███████▌  | 902/1200 [07:23<02:26,  2.03it/s, loss=0.267, lr=1]
Steps:  75%|███████▌  | 902/1200 [07:23<02:26,  2.03it/s, loss=0.466, lr=1]
Steps:  75%|███████▌  | 903/1200 [07:24<02:25,  2.04it/s, loss=0.466, lr=1]
Steps:  75%|███████▌  | 903/1200 [07:24<02:25,  2.04it/s, loss=0.737, lr=1]
Steps:  75%|███████▌  | 904/1200 [07:24<02:26,  2.02it/s, loss=0.737, lr=1]
Steps:  75%|███████▌  | 904/1200 [07:24<02:26,  2.02it/s, loss=0.756, lr=1]
Steps:  75%|███████▌  | 905/1200 [07:24<02:25,  2.03it/s, loss=0.756, lr=1]
Steps:  75%|███████▌  | 905/1200 [07:24<02:25,  2.03it/s, loss=0.566, lr=1]
Steps:  76%|███████▌  | 906/1200 [07:25<02:24,  2.03it/s, loss=0.566, lr=1]
Steps:  76%|███████▌  | 906/1200 [07:25<02:24,  2.03it/s, loss=0.404, lr=1]
Steps:  76%|███████▌  | 907/1200 [07:25<02:23,  2.04it/s, loss=0.404, lr=1]
Steps:  76%|███████▌  | 907/1200 [07:25<02:23,  2.04it/s, loss=0.794, lr=1]
Steps:  76%|███████▌  | 908/1200 [07:26<02:23,  2.04it/s, loss=0.794, lr=1]
Steps:  76%|███████▌  | 908/1200 [07:26<02:23,  2.04it/s, loss=0.629, lr=1]
Steps:  76%|███████▌  | 909/1200 [07:26<02:22,  2.04it/s, loss=0.629, lr=1]
Steps:  76%|███████▌  | 909/1200 [07:26<02:22,  2.04it/s, loss=0.581, lr=1]
Steps:  76%|███████▌  | 910/1200 [07:27<02:22,  2.04it/s, loss=0.581, lr=1]
Steps:  76%|███████▌  | 910/1200 [07:27<02:22,  2.04it/s, loss=0.64, lr=1] 
Steps:  76%|███████▌  | 911/1200 [07:27<02:21,  2.04it/s, loss=0.64, lr=1]
Steps:  76%|███████▌  | 911/1200 [07:27<02:21,  2.04it/s, loss=0.517, lr=1]
Steps:  76%|███████▌  | 912/1200 [07:28<02:21,  2.04it/s, loss=0.517, lr=1]
Steps:  76%|███████▌  | 912/1200 [07:28<02:21,  2.04it/s, loss=0.383, lr=1]
Steps:  76%|███████▌  | 913/1200 [07:28<02:21,  2.03it/s, loss=0.383, lr=1]
Steps:  76%|███████▌  | 913/1200 [07:28<02:21,  2.03it/s, loss=0.263, lr=1]
Steps:  76%|███████▌  | 914/1200 [07:29<02:20,  2.03it/s, loss=0.263, lr=1]
Steps:  76%|███████▌  | 914/1200 [07:29<02:20,  2.03it/s, loss=0.614, lr=1]
Steps:  76%|███████▋  | 915/1200 [07:29<02:19,  2.04it/s, loss=0.614, lr=1]
Steps:  76%|███████▋  | 915/1200 [07:29<02:19,  2.04it/s, loss=0.806, lr=1]
Steps:  76%|███████▋  | 916/1200 [07:30<02:19,  2.04it/s, loss=0.806, lr=1]
Steps:  76%|███████▋  | 916/1200 [07:30<02:19,  2.04it/s, loss=1.03, lr=1] 
Steps:  76%|███████▋  | 917/1200 [07:30<02:18,  2.04it/s, loss=1.03, lr=1]
Steps:  76%|███████▋  | 917/1200 [07:30<02:18,  2.04it/s, loss=0.313, lr=1]
Steps:  76%|███████▋  | 918/1200 [07:31<02:18,  2.04it/s, loss=0.313, lr=1]
Steps:  76%|███████▋  | 918/1200 [07:31<02:18,  2.04it/s, loss=0.56, lr=1] 
Steps:  77%|███████▋  | 919/1200 [07:31<02:17,  2.04it/s, loss=0.56, lr=1]
Steps:  77%|███████▋  | 919/1200 [07:31<02:17,  2.04it/s, loss=0.348, lr=1]
Steps:  77%|███████▋  | 920/1200 [07:32<02:17,  2.04it/s, loss=0.348, lr=1]
Steps:  77%|███████▋  | 920/1200 [07:32<02:17,  2.04it/s, loss=0.564, lr=1]
Steps:  77%|███████▋  | 921/1200 [07:32<02:16,  2.04it/s, loss=0.564, lr=1]
Steps:  77%|███████▋  | 921/1200 [07:32<02:16,  2.04it/s, loss=0.835, lr=1]
Steps:  77%|███████▋  | 922/1200 [07:33<02:16,  2.04it/s, loss=0.835, lr=1]
Steps:  77%|███████▋  | 922/1200 [07:33<02:16,  2.04it/s, loss=0.328, lr=1]
Steps:  77%|███████▋  | 923/1200 [07:33<02:15,  2.04it/s, loss=0.328, lr=1]
Steps:  77%|███████▋  | 923/1200 [07:33<02:15,  2.04it/s, loss=0.472, lr=1]
Steps:  77%|███████▋  | 924/1200 [07:34<02:15,  2.04it/s, loss=0.472, lr=1]
Steps:  77%|███████▋  | 924/1200 [07:34<02:15,  2.04it/s, loss=0.324, lr=1]
Steps:  77%|███████▋  | 925/1200 [07:34<02:15,  2.03it/s, loss=0.324, lr=1]
Steps:  77%|███████▋  | 925/1200 [07:34<02:15,  2.03it/s, loss=0.27, lr=1] 
Steps:  77%|███████▋  | 926/1200 [07:35<02:14,  2.03it/s, loss=0.27, lr=1]
Steps:  77%|███████▋  | 926/1200 [07:35<02:14,  2.03it/s, loss=0.303, lr=1]
Steps:  77%|███████▋  | 927/1200 [07:35<02:14,  2.03it/s, loss=0.303, lr=1]
Steps:  77%|███████▋  | 927/1200 [07:35<02:14,  2.03it/s, loss=0.586, lr=1]
Steps:  77%|███████▋  | 928/1200 [07:36<02:13,  2.04it/s, loss=0.586, lr=1]
Steps:  77%|███████▋  | 928/1200 [07:36<02:13,  2.04it/s, loss=0.292, lr=1]
Steps:  77%|███████▋  | 929/1200 [07:36<02:12,  2.04it/s, loss=0.292, lr=1]
Steps:  77%|███████▋  | 929/1200 [07:36<02:12,  2.04it/s, loss=0.752, lr=1]
Steps:  78%|███████▊  | 930/1200 [07:37<02:12,  2.04it/s, loss=0.752, lr=1]
Steps:  78%|███████▊  | 930/1200 [07:37<02:12,  2.04it/s, loss=0.323, lr=1]
Steps:  78%|███████▊  | 931/1200 [07:37<02:11,  2.04it/s, loss=0.323, lr=1]
Steps:  78%|███████▊  | 931/1200 [07:37<02:11,  2.04it/s, loss=0.751, lr=1]
Steps:  78%|███████▊  | 932/1200 [07:38<02:11,  2.04it/s, loss=0.751, lr=1]
Steps:  78%|███████▊  | 932/1200 [07:38<02:11,  2.04it/s, loss=0.341, lr=1]
Steps:  78%|███████▊  | 933/1200 [07:38<02:10,  2.04it/s, loss=0.341, lr=1]
Steps:  78%|███████▊  | 933/1200 [07:38<02:10,  2.04it/s, loss=0.424, lr=1]
Steps:  78%|███████▊  | 934/1200 [07:39<02:10,  2.04it/s, loss=0.424, lr=1]
Steps:  78%|███████▊  | 934/1200 [07:39<02:10,  2.04it/s, loss=0.257, lr=1]
Steps:  78%|███████▊  | 935/1200 [07:39<02:09,  2.04it/s, loss=0.257, lr=1]
Steps:  78%|███████▊  | 935/1200 [07:39<02:09,  2.04it/s, loss=0.3, lr=1]  
Steps:  78%|███████▊  | 936/1200 [07:40<02:09,  2.04it/s, loss=0.3, lr=1]
Steps:  78%|███████▊  | 936/1200 [07:40<02:09,  2.04it/s, loss=0.639, lr=1]
Steps:  78%|███████▊  | 937/1200 [07:40<02:09,  2.03it/s, loss=0.639, lr=1]
Steps:  78%|███████▊  | 937/1200 [07:40<02:09,  2.03it/s, loss=0.566, lr=1]
Steps:  78%|███████▊  | 938/1200 [07:41<02:08,  2.03it/s, loss=0.566, lr=1]
Steps:  78%|███████▊  | 938/1200 [07:41<02:08,  2.03it/s, loss=0.377, lr=1]
Steps:  78%|███████▊  | 939/1200 [07:41<02:08,  2.04it/s, loss=0.377, lr=1]
Steps:  78%|███████▊  | 939/1200 [07:41<02:08,  2.04it/s, loss=0.689, lr=1]
Steps:  78%|███████▊  | 940/1200 [07:42<02:07,  2.04it/s, loss=0.689, lr=1]
Steps:  78%|███████▊  | 940/1200 [07:42<02:07,  2.04it/s, loss=0.87, lr=1] 
Steps:  78%|███████▊  | 941/1200 [07:42<02:07,  2.04it/s, loss=0.87, lr=1]
Steps:  78%|███████▊  | 941/1200 [07:42<02:07,  2.04it/s, loss=0.862, lr=1]
Steps:  78%|███████▊  | 942/1200 [07:43<02:06,  2.04it/s, loss=0.862, lr=1]
Steps:  78%|███████▊  | 942/1200 [07:43<02:06,  2.04it/s, loss=0.915, lr=1]
Steps:  79%|███████▊  | 943/1200 [07:43<02:06,  2.04it/s, loss=0.915, lr=1]
Steps:  79%|███████▊  | 943/1200 [07:43<02:06,  2.04it/s, loss=0.485, lr=1]
Steps:  79%|███████▊  | 944/1200 [07:44<02:05,  2.04it/s, loss=0.485, lr=1]
Steps:  79%|███████▊  | 944/1200 [07:44<02:05,  2.04it/s, loss=0.586, lr=1]
Steps:  79%|███████▉  | 945/1200 [07:44<02:05,  2.03it/s, loss=0.586, lr=1]
Steps:  79%|███████▉  | 945/1200 [07:44<02:05,  2.03it/s, loss=0.413, lr=1]
Steps:  79%|███████▉  | 946/1200 [07:45<02:05,  2.03it/s, loss=0.413, lr=1]
Steps:  79%|███████▉  | 946/1200 [07:45<02:05,  2.03it/s, loss=0.266, lr=1]
Steps:  79%|███████▉  | 947/1200 [07:45<02:04,  2.03it/s, loss=0.266, lr=1]
Steps:  79%|███████▉  | 947/1200 [07:45<02:04,  2.03it/s, loss=1.02, lr=1] 
Steps:  79%|███████▉  | 948/1200 [07:46<02:03,  2.04it/s, loss=1.02, lr=1]
Steps:  79%|███████▉  | 948/1200 [07:46<02:03,  2.04it/s, loss=0.338, lr=1]
Steps:  79%|███████▉  | 949/1200 [07:46<02:03,  2.03it/s, loss=0.338, lr=1]
Steps:  79%|███████▉  | 949/1200 [07:46<02:03,  2.03it/s, loss=0.601, lr=1]
Steps:  79%|███████▉  | 950/1200 [07:47<02:03,  2.03it/s, loss=0.601, lr=1]
Steps:  79%|███████▉  | 950/1200 [07:47<02:03,  2.03it/s, loss=0.353, lr=1]
Steps:  79%|███████▉  | 951/1200 [07:47<02:02,  2.03it/s, loss=0.353, lr=1]
Steps:  79%|███████▉  | 951/1200 [07:47<02:02,  2.03it/s, loss=0.402, lr=1]
Steps:  79%|███████▉  | 952/1200 [07:48<02:01,  2.03it/s, loss=0.402, lr=1]
Steps:  79%|███████▉  | 952/1200 [07:48<02:01,  2.03it/s, loss=0.257, lr=1]
Steps:  79%|███████▉  | 953/1200 [07:48<02:01,  2.04it/s, loss=0.257, lr=1]
Steps:  79%|███████▉  | 953/1200 [07:48<02:01,  2.04it/s, loss=0.578, lr=1]
Steps:  80%|███████▉  | 954/1200 [07:49<02:00,  2.04it/s, loss=0.578, lr=1]
Steps:  80%|███████▉  | 954/1200 [07:49<02:00,  2.04it/s, loss=0.763, lr=1]
Steps:  80%|███████▉  | 955/1200 [07:49<02:00,  2.04it/s, loss=0.763, lr=1]
Steps:  80%|███████▉  | 955/1200 [07:49<02:00,  2.04it/s, loss=0.83, lr=1] 
Steps:  80%|███████▉  | 956/1200 [07:50<01:59,  2.04it/s, loss=0.83, lr=1]
Steps:  80%|███████▉  | 956/1200 [07:50<01:59,  2.04it/s, loss=0.423, lr=1]
Steps:  80%|███████▉  | 957/1200 [07:50<01:59,  2.04it/s, loss=0.423, lr=1]
Steps:  80%|███████▉  | 957/1200 [07:50<01:59,  2.04it/s, loss=0.584, lr=1]
Steps:  80%|███████▉  | 958/1200 [07:51<01:58,  2.04it/s, loss=0.584, lr=1]
Steps:  80%|███████▉  | 958/1200 [07:51<01:58,  2.04it/s, loss=0.608, lr=1]
Steps:  80%|███████▉  | 959/1200 [07:51<01:58,  2.04it/s, loss=0.608, lr=1]
Steps:  80%|███████▉  | 959/1200 [07:51<01:58,  2.04it/s, loss=0.439, lr=1]
Steps:  80%|████████  | 960/1200 [07:51<01:57,  2.04it/s, loss=0.439, lr=1]
Steps:  80%|████████  | 960/1200 [07:51<01:57,  2.04it/s, loss=0.317, lr=1]
Steps:  80%|████████  | 961/1200 [07:52<01:57,  2.03it/s, loss=0.317, lr=1]
Steps:  80%|████████  | 961/1200 [07:52<01:57,  2.03it/s, loss=0.446, lr=1]
Steps:  80%|████████  | 962/1200 [07:52<01:56,  2.04it/s, loss=0.446, lr=1]
Steps:  80%|████████  | 962/1200 [07:52<01:56,  2.04it/s, loss=0.377, lr=1]
Steps:  80%|████████  | 963/1200 [07:53<01:56,  2.04it/s, loss=0.377, lr=1]
Steps:  80%|████████  | 963/1200 [07:53<01:56,  2.04it/s, loss=0.383, lr=1]
Steps:  80%|████████  | 964/1200 [07:53<01:55,  2.04it/s, loss=0.383, lr=1]
Steps:  80%|████████  | 964/1200 [07:53<01:55,  2.04it/s, loss=0.773, lr=1]
Steps:  80%|████████  | 965/1200 [07:54<01:55,  2.03it/s, loss=0.773, lr=1]
Steps:  80%|████████  | 965/1200 [07:54<01:55,  2.03it/s, loss=0.32, lr=1] 
Steps:  80%|████████  | 966/1200 [07:54<01:55,  2.03it/s, loss=0.32, lr=1]
Steps:  80%|████████  | 966/1200 [07:54<01:55,  2.03it/s, loss=0.376, lr=1]
Steps:  81%|████████  | 967/1200 [07:55<01:54,  2.03it/s, loss=0.376, lr=1]
Steps:  81%|████████  | 967/1200 [07:55<01:54,  2.03it/s, loss=0.293, lr=1]
Steps:  81%|████████  | 968/1200 [07:55<01:53,  2.04it/s, loss=0.293, lr=1]
Steps:  81%|████████  | 968/1200 [07:55<01:53,  2.04it/s, loss=0.299, lr=1]
Steps:  81%|████████  | 969/1200 [07:56<01:53,  2.04it/s, loss=0.299, lr=1]
Steps:  81%|████████  | 969/1200 [07:56<01:53,  2.04it/s, loss=0.577, lr=1]
Steps:  81%|████████  | 970/1200 [07:56<01:52,  2.04it/s, loss=0.577, lr=1]
Steps:  81%|████████  | 970/1200 [07:56<01:52,  2.04it/s, loss=0.279, lr=1]
Steps:  81%|████████  | 971/1200 [07:57<01:52,  2.04it/s, loss=0.279, lr=1]
Steps:  81%|████████  | 971/1200 [07:57<01:52,  2.04it/s, loss=0.283, lr=1]
Steps:  81%|████████  | 972/1200 [07:57<01:51,  2.04it/s, loss=0.283, lr=1]
Steps:  81%|████████  | 972/1200 [07:57<01:51,  2.04it/s, loss=0.458, lr=1]
Steps:  81%|████████  | 973/1200 [07:58<01:51,  2.03it/s, loss=0.458, lr=1]
Steps:  81%|████████  | 973/1200 [07:58<01:51,  2.03it/s, loss=0.287, lr=1]
Steps:  81%|████████  | 974/1200 [07:58<01:51,  2.03it/s, loss=0.287, lr=1]
Steps:  81%|████████  | 974/1200 [07:58<01:51,  2.03it/s, loss=0.356, lr=1]
Steps:  81%|████████▏ | 975/1200 [07:59<01:50,  2.03it/s, loss=0.356, lr=1]
Steps:  81%|████████▏ | 975/1200 [07:59<01:50,  2.03it/s, loss=0.321, lr=1]
Steps:  81%|████████▏ | 976/1200 [07:59<01:49,  2.04it/s, loss=0.321, lr=1]
Steps:  81%|████████▏ | 976/1200 [07:59<01:49,  2.04it/s, loss=0.836, lr=1]
Steps:  81%|████████▏ | 977/1200 [08:00<01:49,  2.04it/s, loss=0.836, lr=1]
Steps:  81%|████████▏ | 977/1200 [08:00<01:49,  2.04it/s, loss=0.579, lr=1]
Steps:  82%|████████▏ | 978/1200 [08:00<01:48,  2.04it/s, loss=0.579, lr=1]
Steps:  82%|████████▏ | 978/1200 [08:00<01:48,  2.04it/s, loss=0.332, lr=1]
Steps:  82%|████████▏ | 979/1200 [08:01<01:48,  2.04it/s, loss=0.332, lr=1]
Steps:  82%|████████▏ | 979/1200 [08:01<01:48,  2.04it/s, loss=0.323, lr=1]
Steps:  82%|████████▏ | 980/1200 [08:01<01:47,  2.04it/s, loss=0.323, lr=1]
Steps:  82%|████████▏ | 980/1200 [08:01<01:47,  2.04it/s, loss=0.425, lr=1]
Steps:  82%|████████▏ | 981/1200 [08:02<01:47,  2.04it/s, loss=0.425, lr=1]
Steps:  82%|████████▏ | 981/1200 [08:02<01:47,  2.04it/s, loss=0.386, lr=1]
Steps:  82%|████████▏ | 982/1200 [08:02<01:46,  2.04it/s, loss=0.386, lr=1]
Steps:  82%|████████▏ | 982/1200 [08:02<01:46,  2.04it/s, loss=0.599, lr=1]
Steps:  82%|████████▏ | 983/1200 [08:03<01:46,  2.04it/s, loss=0.599, lr=1]
Steps:  82%|████████▏ | 983/1200 [08:03<01:46,  2.04it/s, loss=0.606, lr=1]
Steps:  82%|████████▏ | 984/1200 [08:03<01:45,  2.04it/s, loss=0.606, lr=1]
Steps:  82%|████████▏ | 984/1200 [08:03<01:45,  2.04it/s, loss=0.631, lr=1]
Steps:  82%|████████▏ | 985/1200 [08:04<01:59,  1.80it/s, loss=0.631, lr=1]
Steps:  82%|████████▏ | 985/1200 [08:04<01:59,  1.80it/s, loss=0.332, lr=1]
Steps:  82%|████████▏ | 986/1200 [08:04<01:54,  1.87it/s, loss=0.332, lr=1]
Steps:  82%|████████▏ | 986/1200 [08:04<01:54,  1.87it/s, loss=0.285, lr=1]
Steps:  82%|████████▏ | 987/1200 [08:05<01:51,  1.92it/s, loss=0.285, lr=1]
Steps:  82%|████████▏ | 987/1200 [08:05<01:51,  1.92it/s, loss=0.693, lr=1]
Steps:  82%|████████▏ | 988/1200 [08:05<01:48,  1.95it/s, loss=0.693, lr=1]
Steps:  82%|████████▏ | 988/1200 [08:05<01:48,  1.95it/s, loss=0.782, lr=1]
Steps:  82%|████████▏ | 989/1200 [08:06<01:46,  1.98it/s, loss=0.782, lr=1]
Steps:  82%|████████▏ | 989/1200 [08:06<01:46,  1.98it/s, loss=0.382, lr=1]
Steps:  82%|████████▎ | 990/1200 [08:06<01:45,  2.00it/s, loss=0.382, lr=1]
Steps:  82%|████████▎ | 990/1200 [08:06<01:45,  2.00it/s, loss=0.315, lr=1]
Steps:  83%|████████▎ | 991/1200 [08:07<01:44,  2.01it/s, loss=0.315, lr=1]
Steps:  83%|████████▎ | 991/1200 [08:07<01:44,  2.01it/s, loss=0.622, lr=1]
Steps:  83%|████████▎ | 992/1200 [08:07<01:43,  2.02it/s, loss=0.622, lr=1]
Steps:  83%|████████▎ | 992/1200 [08:07<01:43,  2.02it/s, loss=0.555, lr=1]
Steps:  83%|████████▎ | 993/1200 [08:08<01:42,  2.03it/s, loss=0.555, lr=1]
Steps:  83%|████████▎ | 993/1200 [08:08<01:42,  2.03it/s, loss=0.424, lr=1]
Steps:  83%|████████▎ | 994/1200 [08:08<01:41,  2.03it/s, loss=0.424, lr=1]
Steps:  83%|████████▎ | 994/1200 [08:08<01:41,  2.03it/s, loss=0.53, lr=1] 
Steps:  83%|████████▎ | 995/1200 [08:09<01:40,  2.03it/s, loss=0.53, lr=1]
Steps:  83%|████████▎ | 995/1200 [08:09<01:40,  2.03it/s, loss=0.308, lr=1]
Steps:  83%|████████▎ | 996/1200 [08:09<01:40,  2.03it/s, loss=0.308, lr=1]
Steps:  83%|████████▎ | 996/1200 [08:09<01:40,  2.03it/s, loss=0.596, lr=1]
Steps:  83%|████████▎ | 997/1200 [08:10<01:40,  2.03it/s, loss=0.596, lr=1]
Steps:  83%|████████▎ | 997/1200 [08:10<01:40,  2.03it/s, loss=0.709, lr=1]
Steps:  83%|████████▎ | 998/1200 [08:10<01:39,  2.03it/s, loss=0.709, lr=1]
Steps:  83%|████████▎ | 998/1200 [08:10<01:39,  2.03it/s, loss=0.631, lr=1]
Steps:  83%|████████▎ | 999/1200 [08:11<01:38,  2.03it/s, loss=0.631, lr=1]
Steps:  83%|████████▎ | 999/1200 [08:11<01:38,  2.03it/s, loss=0.565, lr=1]
Steps:  83%|████████▎ | 1000/1200 [08:11<01:38,  2.03it/s, loss=0.565, lr=1]
Steps:  83%|████████▎ | 1000/1200 [08:11<01:38,  2.03it/s, loss=0.647, lr=1]
Steps:  83%|████████▎ | 1001/1200 [08:12<01:37,  2.03it/s, loss=0.647, lr=1]
Steps:  83%|████████▎ | 1001/1200 [08:12<01:37,  2.03it/s, loss=0.349, lr=1]
Steps:  84%|████████▎ | 1002/1200 [08:12<01:37,  2.04it/s, loss=0.349, lr=1]
Steps:  84%|████████▎ | 1002/1200 [08:12<01:37,  2.04it/s, loss=0.4, lr=1]  
Steps:  84%|████████▎ | 1003/1200 [08:13<01:36,  2.04it/s, loss=0.4, lr=1]
Steps:  84%|████████▎ | 1003/1200 [08:13<01:36,  2.04it/s, loss=0.538, lr=1]
Steps:  84%|████████▎ | 1004/1200 [08:13<01:36,  2.04it/s, loss=0.538, lr=1]
Steps:  84%|████████▎ | 1004/1200 [08:13<01:36,  2.04it/s, loss=0.476, lr=1]
Steps:  84%|████████▍ | 1005/1200 [08:14<01:35,  2.04it/s, loss=0.476, lr=1]
Steps:  84%|████████▍ | 1005/1200 [08:14<01:35,  2.04it/s, loss=0.324, lr=1]
Steps:  84%|████████▍ | 1006/1200 [08:14<01:35,  2.04it/s, loss=0.324, lr=1]
Steps:  84%|████████▍ | 1006/1200 [08:14<01:35,  2.04it/s, loss=0.636, lr=1]
Steps:  84%|████████▍ | 1007/1200 [08:15<01:34,  2.04it/s, loss=0.636, lr=1]
Steps:  84%|████████▍ | 1007/1200 [08:15<01:34,  2.04it/s, loss=0.625, lr=1]
Steps:  84%|████████▍ | 1008/1200 [08:15<01:34,  2.04it/s, loss=0.625, lr=1]
Steps:  84%|████████▍ | 1008/1200 [08:15<01:34,  2.04it/s, loss=0.536, lr=1]
Steps:  84%|████████▍ | 1009/1200 [08:16<01:34,  2.03it/s, loss=0.536, lr=1]
Steps:  84%|████████▍ | 1009/1200 [08:16<01:34,  2.03it/s, loss=0.467, lr=1]
Steps:  84%|████████▍ | 1010/1200 [08:16<01:33,  2.03it/s, loss=0.467, lr=1]
Steps:  84%|████████▍ | 1010/1200 [08:16<01:33,  2.03it/s, loss=0.385, lr=1]
Steps:  84%|████████▍ | 1011/1200 [08:17<01:32,  2.04it/s, loss=0.385, lr=1]
Steps:  84%|████████▍ | 1011/1200 [08:17<01:32,  2.04it/s, loss=0.503, lr=1]
Steps:  84%|████████▍ | 1012/1200 [08:17<01:32,  2.04it/s, loss=0.503, lr=1]
Steps:  84%|████████▍ | 1012/1200 [08:17<01:32,  2.04it/s, loss=0.623, lr=1]
Steps:  84%|████████▍ | 1013/1200 [08:18<01:31,  2.03it/s, loss=0.623, lr=1]
Steps:  84%|████████▍ | 1013/1200 [08:18<01:31,  2.03it/s, loss=0.305, lr=1]
Steps:  84%|████████▍ | 1014/1200 [08:18<01:31,  2.03it/s, loss=0.305, lr=1]
Steps:  84%|████████▍ | 1014/1200 [08:18<01:31,  2.03it/s, loss=0.329, lr=1]
Steps:  85%|████████▍ | 1015/1200 [08:19<01:30,  2.04it/s, loss=0.329, lr=1]
Steps:  85%|████████▍ | 1015/1200 [08:19<01:30,  2.04it/s, loss=0.583, lr=1]
Steps:  85%|████████▍ | 1016/1200 [08:19<01:30,  2.04it/s, loss=0.583, lr=1]
Steps:  85%|████████▍ | 1016/1200 [08:19<01:30,  2.04it/s, loss=0.502, lr=1]
Steps:  85%|████████▍ | 1017/1200 [08:20<01:29,  2.04it/s, loss=0.502, lr=1]
Steps:  85%|████████▍ | 1017/1200 [08:20<01:29,  2.04it/s, loss=0.347, lr=1]
Steps:  85%|████████▍ | 1018/1200 [08:20<01:29,  2.02it/s, loss=0.347, lr=1]
Steps:  85%|████████▍ | 1018/1200 [08:20<01:29,  2.02it/s, loss=0.33, lr=1] 
Steps:  85%|████████▍ | 1019/1200 [08:21<01:29,  2.03it/s, loss=0.33, lr=1]
Steps:  85%|████████▍ | 1019/1200 [08:21<01:29,  2.03it/s, loss=0.338, lr=1]
Steps:  85%|████████▌ | 1020/1200 [08:21<01:28,  2.03it/s, loss=0.338, lr=1]
Steps:  85%|████████▌ | 1020/1200 [08:21<01:28,  2.03it/s, loss=0.311, lr=1]
Steps:  85%|████████▌ | 1021/1200 [08:22<01:28,  2.03it/s, loss=0.311, lr=1]
Steps:  85%|████████▌ | 1021/1200 [08:22<01:28,  2.03it/s, loss=0.748, lr=1]
Steps:  85%|████████▌ | 1022/1200 [08:22<01:27,  2.03it/s, loss=0.748, lr=1]
Steps:  85%|████████▌ | 1022/1200 [08:22<01:27,  2.03it/s, loss=0.605, lr=1]
Steps:  85%|████████▌ | 1023/1200 [08:23<01:27,  2.03it/s, loss=0.605, lr=1]
Steps:  85%|████████▌ | 1023/1200 [08:23<01:27,  2.03it/s, loss=0.545, lr=1]
Steps:  85%|████████▌ | 1024/1200 [08:23<01:26,  2.03it/s, loss=0.545, lr=1]
Steps:  85%|████████▌ | 1024/1200 [08:23<01:26,  2.03it/s, loss=0.876, lr=1]
Steps:  85%|████████▌ | 1025/1200 [08:24<01:25,  2.04it/s, loss=0.876, lr=1]
Steps:  85%|████████▌ | 1025/1200 [08:24<01:25,  2.04it/s, loss=0.354, lr=1]
Steps:  86%|████████▌ | 1026/1200 [08:24<01:25,  2.04it/s, loss=0.354, lr=1]
Steps:  86%|████████▌ | 1026/1200 [08:24<01:25,  2.04it/s, loss=0.291, lr=1]
Steps:  86%|████████▌ | 1027/1200 [08:25<01:24,  2.04it/s, loss=0.291, lr=1]
Steps:  86%|████████▌ | 1027/1200 [08:25<01:24,  2.04it/s, loss=0.298, lr=1]
Steps:  86%|████████▌ | 1028/1200 [08:25<01:24,  2.04it/s, loss=0.298, lr=1]
Steps:  86%|████████▌ | 1028/1200 [08:25<01:24,  2.04it/s, loss=0.394, lr=1]
Steps:  86%|████████▌ | 1029/1200 [08:26<01:23,  2.04it/s, loss=0.394, lr=1]
Steps:  86%|████████▌ | 1029/1200 [08:26<01:23,  2.04it/s, loss=0.312, lr=1]
Steps:  86%|████████▌ | 1030/1200 [08:26<01:23,  2.04it/s, loss=0.312, lr=1]
Steps:  86%|████████▌ | 1030/1200 [08:26<01:23,  2.04it/s, loss=0.585, lr=1]
Steps:  86%|████████▌ | 1031/1200 [08:27<01:22,  2.04it/s, loss=0.585, lr=1]
Steps:  86%|████████▌ | 1031/1200 [08:27<01:22,  2.04it/s, loss=1.01, lr=1] 
Steps:  86%|████████▌ | 1032/1200 [08:27<01:22,  2.04it/s, loss=1.01, lr=1]
Steps:  86%|████████▌ | 1032/1200 [08:27<01:22,  2.04it/s, loss=0.888, lr=1]
Steps:  86%|████████▌ | 1033/1200 [08:28<01:22,  2.03it/s, loss=0.888, lr=1]
Steps:  86%|████████▌ | 1033/1200 [08:28<01:22,  2.03it/s, loss=0.774, lr=1]
Steps:  86%|████████▌ | 1034/1200 [08:28<01:21,  2.03it/s, loss=0.774, lr=1]
Steps:  86%|████████▌ | 1034/1200 [08:28<01:21,  2.03it/s, loss=1.04, lr=1] 
Steps:  86%|████████▋ | 1035/1200 [08:29<01:20,  2.04it/s, loss=1.04, lr=1]
Steps:  86%|████████▋ | 1035/1200 [08:29<01:20,  2.04it/s, loss=0.293, lr=1]
Steps:  86%|████████▋ | 1036/1200 [08:29<01:20,  2.04it/s, loss=0.293, lr=1]
Steps:  86%|████████▋ | 1036/1200 [08:29<01:20,  2.04it/s, loss=0.62, lr=1] 
Steps:  86%|████████▋ | 1037/1200 [08:30<01:19,  2.04it/s, loss=0.62, lr=1]
Steps:  86%|████████▋ | 1037/1200 [08:30<01:19,  2.04it/s, loss=0.375, lr=1]
Steps:  86%|████████▋ | 1038/1200 [08:30<01:19,  2.04it/s, loss=0.375, lr=1]
Steps:  86%|████████▋ | 1038/1200 [08:30<01:19,  2.04it/s, loss=0.514, lr=1]
Steps:  87%|████████▋ | 1039/1200 [08:31<01:18,  2.04it/s, loss=0.514, lr=1]
Steps:  87%|████████▋ | 1039/1200 [08:31<01:18,  2.04it/s, loss=0.292, lr=1]
Steps:  87%|████████▋ | 1040/1200 [08:31<01:18,  2.04it/s, loss=0.292, lr=1]
Steps:  87%|████████▋ | 1040/1200 [08:31<01:18,  2.04it/s, loss=0.563, lr=1]
Steps:  87%|████████▋ | 1041/1200 [08:31<01:18,  2.04it/s, loss=0.563, lr=1]
Steps:  87%|████████▋ | 1041/1200 [08:31<01:18,  2.04it/s, loss=0.649, lr=1]
Steps:  87%|████████▋ | 1042/1200 [08:32<01:17,  2.04it/s, loss=0.649, lr=1]
Steps:  87%|████████▋ | 1042/1200 [08:32<01:17,  2.04it/s, loss=0.536, lr=1]
Steps:  87%|████████▋ | 1043/1200 [08:32<01:17,  2.04it/s, loss=0.536, lr=1]
Steps:  87%|████████▋ | 1043/1200 [08:32<01:17,  2.04it/s, loss=0.349, lr=1]
Steps:  87%|████████▋ | 1044/1200 [08:33<01:16,  2.04it/s, loss=0.349, lr=1]
Steps:  87%|████████▋ | 1044/1200 [08:33<01:16,  2.04it/s, loss=0.572, lr=1]
Steps:  87%|████████▋ | 1045/1200 [08:33<01:16,  2.03it/s, loss=0.572, lr=1]
Steps:  87%|████████▋ | 1045/1200 [08:33<01:16,  2.03it/s, loss=0.646, lr=1]
Steps:  87%|████████▋ | 1046/1200 [08:34<01:15,  2.03it/s, loss=0.646, lr=1]
Steps:  87%|████████▋ | 1046/1200 [08:34<01:15,  2.03it/s, loss=0.291, lr=1]
Steps:  87%|████████▋ | 1047/1200 [08:34<01:15,  2.03it/s, loss=0.291, lr=1]
Steps:  87%|████████▋ | 1047/1200 [08:34<01:15,  2.03it/s, loss=0.279, lr=1]
Steps:  87%|████████▋ | 1048/1200 [08:35<01:14,  2.03it/s, loss=0.279, lr=1]
Steps:  87%|████████▋ | 1048/1200 [08:35<01:14,  2.03it/s, loss=0.459, lr=1]
Steps:  87%|████████▋ | 1049/1200 [08:35<01:14,  2.03it/s, loss=0.459, lr=1]
Steps:  87%|████████▋ | 1049/1200 [08:35<01:14,  2.03it/s, loss=0.371, lr=1]
Steps:  88%|████████▊ | 1050/1200 [08:36<01:13,  2.03it/s, loss=0.371, lr=1]
Steps:  88%|████████▊ | 1050/1200 [08:36<01:13,  2.03it/s, loss=0.577, lr=1]
Steps:  88%|████████▊ | 1051/1200 [08:36<01:13,  2.03it/s, loss=0.577, lr=1]
Steps:  88%|████████▊ | 1051/1200 [08:36<01:13,  2.03it/s, loss=0.296, lr=1]
Steps:  88%|████████▊ | 1052/1200 [08:37<01:12,  2.04it/s, loss=0.296, lr=1]
Steps:  88%|████████▊ | 1052/1200 [08:37<01:12,  2.04it/s, loss=0.776, lr=1]
Steps:  88%|████████▊ | 1053/1200 [08:37<01:12,  2.04it/s, loss=0.776, lr=1]
Steps:  88%|████████▊ | 1053/1200 [08:37<01:12,  2.04it/s, loss=0.554, lr=1]
Steps:  88%|████████▊ | 1054/1200 [08:38<01:11,  2.03it/s, loss=0.554, lr=1]
Steps:  88%|████████▊ | 1054/1200 [08:38<01:11,  2.03it/s, loss=0.657, lr=1]
Steps:  88%|████████▊ | 1055/1200 [08:38<01:11,  2.03it/s, loss=0.657, lr=1]
Steps:  88%|████████▊ | 1055/1200 [08:38<01:11,  2.03it/s, loss=0.355, lr=1]
Steps:  88%|████████▊ | 1056/1200 [08:39<01:10,  2.03it/s, loss=0.355, lr=1]
Steps:  88%|████████▊ | 1056/1200 [08:39<01:10,  2.03it/s, loss=0.53, lr=1] 
Steps:  88%|████████▊ | 1057/1200 [08:39<01:10,  2.03it/s, loss=0.53, lr=1]
Steps:  88%|████████▊ | 1057/1200 [08:39<01:10,  2.03it/s, loss=0.543, lr=1]
Steps:  88%|████████▊ | 1058/1200 [08:40<01:09,  2.03it/s, loss=0.543, lr=1]
Steps:  88%|████████▊ | 1058/1200 [08:40<01:09,  2.03it/s, loss=0.468, lr=1]
Steps:  88%|████████▊ | 1059/1200 [08:40<01:09,  2.03it/s, loss=0.468, lr=1]
Steps:  88%|████████▊ | 1059/1200 [08:40<01:09,  2.03it/s, loss=0.405, lr=1]
Steps:  88%|████████▊ | 1060/1200 [08:41<01:08,  2.03it/s, loss=0.405, lr=1]
Steps:  88%|████████▊ | 1060/1200 [08:41<01:08,  2.03it/s, loss=0.379, lr=1]
Steps:  88%|████████▊ | 1061/1200 [08:41<01:08,  2.04it/s, loss=0.379, lr=1]
Steps:  88%|████████▊ | 1061/1200 [08:41<01:08,  2.04it/s, loss=0.464, lr=1]
Steps:  88%|████████▊ | 1062/1200 [08:42<01:07,  2.04it/s, loss=0.464, lr=1]
Steps:  88%|████████▊ | 1062/1200 [08:42<01:07,  2.04it/s, loss=0.444, lr=1]
Steps:  89%|████████▊ | 1063/1200 [08:42<01:07,  2.04it/s, loss=0.444, lr=1]
Steps:  89%|████████▊ | 1063/1200 [08:42<01:07,  2.04it/s, loss=0.665, lr=1]
Steps:  89%|████████▊ | 1064/1200 [08:43<01:06,  2.04it/s, loss=0.665, lr=1]
Steps:  89%|████████▊ | 1064/1200 [08:43<01:06,  2.04it/s, loss=0.349, lr=1]
Steps:  89%|████████▉ | 1065/1200 [08:43<01:06,  2.04it/s, loss=0.349, lr=1]
Steps:  89%|████████▉ | 1065/1200 [08:43<01:06,  2.04it/s, loss=0.279, lr=1]
Steps:  89%|████████▉ | 1066/1200 [08:44<01:05,  2.04it/s, loss=0.279, lr=1]
Steps:  89%|████████▉ | 1066/1200 [08:44<01:05,  2.04it/s, loss=0.572, lr=1]
Steps:  89%|████████▉ | 1067/1200 [08:44<01:05,  2.04it/s, loss=0.572, lr=1]
Steps:  89%|████████▉ | 1067/1200 [08:44<01:05,  2.04it/s, loss=0.423, lr=1]
Steps:  89%|████████▉ | 1068/1200 [08:45<01:04,  2.04it/s, loss=0.423, lr=1]
Steps:  89%|████████▉ | 1068/1200 [08:45<01:04,  2.04it/s, loss=0.486, lr=1]
Steps:  89%|████████▉ | 1069/1200 [08:45<01:04,  2.03it/s, loss=0.486, lr=1]
Steps:  89%|████████▉ | 1069/1200 [08:45<01:04,  2.03it/s, loss=0.287, lr=1]
Steps:  89%|████████▉ | 1070/1200 [08:46<01:03,  2.03it/s, loss=0.287, lr=1]
Steps:  89%|████████▉ | 1070/1200 [08:46<01:03,  2.03it/s, loss=0.27, lr=1] 
Steps:  89%|████████▉ | 1071/1200 [08:46<01:03,  2.04it/s, loss=0.27, lr=1]
Steps:  89%|████████▉ | 1071/1200 [08:46<01:03,  2.04it/s, loss=0.365, lr=1]
Steps:  89%|████████▉ | 1072/1200 [08:47<01:02,  2.04it/s, loss=0.365, lr=1]
Steps:  89%|████████▉ | 1072/1200 [08:47<01:02,  2.04it/s, loss=0.588, lr=1]
Steps:  89%|████████▉ | 1073/1200 [08:47<01:02,  2.04it/s, loss=0.588, lr=1]
Steps:  89%|████████▉ | 1073/1200 [08:47<01:02,  2.04it/s, loss=0.35, lr=1] 
Steps:  90%|████████▉ | 1074/1200 [08:48<01:01,  2.04it/s, loss=0.35, lr=1]
Steps:  90%|████████▉ | 1074/1200 [08:48<01:01,  2.04it/s, loss=0.29, lr=1]
Steps:  90%|████████▉ | 1075/1200 [08:48<01:01,  2.04it/s, loss=0.29, lr=1]
Steps:  90%|████████▉ | 1075/1200 [08:48<01:01,  2.04it/s, loss=0.351, lr=1]
Steps:  90%|████████▉ | 1076/1200 [08:49<01:00,  2.04it/s, loss=0.351, lr=1]
Steps:  90%|████████▉ | 1076/1200 [08:49<01:00,  2.04it/s, loss=0.36, lr=1] 
Steps:  90%|████████▉ | 1077/1200 [08:49<01:00,  2.04it/s, loss=0.36, lr=1]
Steps:  90%|████████▉ | 1077/1200 [08:49<01:00,  2.04it/s, loss=0.623, lr=1]
Steps:  90%|████████▉ | 1078/1200 [08:50<00:59,  2.04it/s, loss=0.623, lr=1]
Steps:  90%|████████▉ | 1078/1200 [08:50<00:59,  2.04it/s, loss=0.753, lr=1]
Steps:  90%|████████▉ | 1079/1200 [08:50<00:59,  2.04it/s, loss=0.753, lr=1]
Steps:  90%|████████▉ | 1079/1200 [08:50<00:59,  2.04it/s, loss=0.287, lr=1]
Steps:  90%|█████████ | 1080/1200 [08:51<00:58,  2.04it/s, loss=0.287, lr=1]
Steps:  90%|█████████ | 1080/1200 [08:51<00:58,  2.04it/s, loss=0.265, lr=1]
Steps:  90%|█████████ | 1081/1200 [08:51<00:58,  2.03it/s, loss=0.265, lr=1]
Steps:  90%|█████████ | 1081/1200 [08:51<00:58,  2.03it/s, loss=0.404, lr=1]
Steps:  90%|█████████ | 1082/1200 [08:52<00:58,  2.03it/s, loss=0.404, lr=1]
Steps:  90%|█████████ | 1082/1200 [08:52<00:58,  2.03it/s, loss=0.71, lr=1] 
Steps:  90%|█████████ | 1083/1200 [08:52<00:57,  2.04it/s, loss=0.71, lr=1]
Steps:  90%|█████████ | 1083/1200 [08:52<00:57,  2.04it/s, loss=0.337, lr=1]
Steps:  90%|█████████ | 1084/1200 [08:53<00:56,  2.04it/s, loss=0.337, lr=1]
Steps:  90%|█████████ | 1084/1200 [08:53<00:56,  2.04it/s, loss=0.368, lr=1]
Steps:  90%|█████████ | 1085/1200 [08:53<00:56,  2.04it/s, loss=0.368, lr=1]
Steps:  90%|█████████ | 1085/1200 [08:53<00:56,  2.04it/s, loss=0.627, lr=1]
Steps:  90%|█████████ | 1086/1200 [08:54<00:55,  2.04it/s, loss=0.627, lr=1]
Steps:  90%|█████████ | 1086/1200 [08:54<00:55,  2.04it/s, loss=0.837, lr=1]
Steps:  91%|█████████ | 1087/1200 [08:54<00:55,  2.04it/s, loss=0.837, lr=1]
Steps:  91%|█████████ | 1087/1200 [08:54<00:55,  2.04it/s, loss=0.628, lr=1]
Steps:  91%|█████████ | 1088/1200 [08:55<00:54,  2.04it/s, loss=0.628, lr=1]
Steps:  91%|█████████ | 1088/1200 [08:55<00:54,  2.04it/s, loss=0.364, lr=1]
Steps:  91%|█████████ | 1089/1200 [08:55<00:54,  2.04it/s, loss=0.364, lr=1]
Steps:  91%|█████████ | 1089/1200 [08:55<00:54,  2.04it/s, loss=0.565, lr=1]
Steps:  91%|█████████ | 1090/1200 [08:56<00:53,  2.04it/s, loss=0.565, lr=1]
Steps:  91%|█████████ | 1090/1200 [08:56<00:53,  2.04it/s, loss=0.315, lr=1]
Steps:  91%|█████████ | 1091/1200 [08:56<00:53,  2.04it/s, loss=0.315, lr=1]
Steps:  91%|█████████ | 1091/1200 [08:56<00:53,  2.04it/s, loss=0.527, lr=1]
Steps:  91%|█████████ | 1092/1200 [08:57<00:52,  2.04it/s, loss=0.527, lr=1]
Steps:  91%|█████████ | 1092/1200 [08:57<00:52,  2.04it/s, loss=0.662, lr=1]
Steps:  91%|█████████ | 1093/1200 [08:57<00:52,  2.03it/s, loss=0.662, lr=1]
Steps:  91%|█████████ | 1093/1200 [08:57<00:52,  2.03it/s, loss=0.784, lr=1]
Steps:  91%|█████████ | 1094/1200 [08:58<00:52,  2.04it/s, loss=0.784, lr=1]
Steps:  91%|█████████ | 1094/1200 [08:58<00:52,  2.04it/s, loss=0.546, lr=1]
Steps:  91%|█████████▏| 1095/1200 [08:58<00:51,  2.04it/s, loss=0.546, lr=1]
Steps:  91%|█████████▏| 1095/1200 [08:58<00:51,  2.04it/s, loss=0.423, lr=1]
Steps:  91%|█████████▏| 1096/1200 [08:58<00:50,  2.04it/s, loss=0.423, lr=1]
Steps:  91%|█████████▏| 1096/1200 [08:58<00:50,  2.04it/s, loss=0.497, lr=1]
Steps:  91%|█████████▏| 1097/1200 [08:59<00:50,  2.04it/s, loss=0.497, lr=1]
Steps:  91%|█████████▏| 1097/1200 [08:59<00:50,  2.04it/s, loss=1, lr=1]    
Steps:  92%|█████████▏| 1098/1200 [08:59<00:49,  2.04it/s, loss=1, lr=1]
Steps:  92%|█████████▏| 1098/1200 [08:59<00:49,  2.04it/s, loss=0.791, lr=1]
Steps:  92%|█████████▏| 1099/1200 [09:00<00:49,  2.04it/s, loss=0.791, lr=1]
Steps:  92%|█████████▏| 1099/1200 [09:00<00:49,  2.04it/s, loss=0.572, lr=1]
Steps:  92%|█████████▏| 1100/1200 [09:00<00:48,  2.04it/s, loss=0.572, lr=1]
Steps:  92%|█████████▏| 1100/1200 [09:00<00:48,  2.04it/s, loss=0.541, lr=1]
Steps:  92%|█████████▏| 1101/1200 [09:01<00:48,  2.04it/s, loss=0.541, lr=1]
Steps:  92%|█████████▏| 1101/1200 [09:01<00:48,  2.04it/s, loss=0.51, lr=1] 
Steps:  92%|█████████▏| 1102/1200 [09:01<00:48,  2.04it/s, loss=0.51, lr=1]
Steps:  92%|█████████▏| 1102/1200 [09:01<00:48,  2.04it/s, loss=0.279, lr=1]
Steps:  92%|█████████▏| 1103/1200 [09:02<00:47,  2.04it/s, loss=0.279, lr=1]
Steps:  92%|█████████▏| 1103/1200 [09:02<00:47,  2.04it/s, loss=0.277, lr=1]
Steps:  92%|█████████▏| 1104/1200 [09:02<00:47,  2.04it/s, loss=0.277, lr=1]
Steps:  92%|█████████▏| 1104/1200 [09:02<00:47,  2.04it/s, loss=0.87, lr=1] 
Steps:  92%|█████████▏| 1105/1200 [09:03<00:46,  2.03it/s, loss=0.87, lr=1]
Steps:  92%|█████████▏| 1105/1200 [09:03<00:46,  2.03it/s, loss=0.589, lr=1]
Steps:  92%|█████████▏| 1106/1200 [09:03<00:46,  2.04it/s, loss=0.589, lr=1]
Steps:  92%|█████████▏| 1106/1200 [09:03<00:46,  2.04it/s, loss=0.486, lr=1]
Steps:  92%|█████████▏| 1107/1200 [09:04<00:45,  2.04it/s, loss=0.486, lr=1]
Steps:  92%|█████████▏| 1107/1200 [09:04<00:45,  2.04it/s, loss=0.625, lr=1]
Steps:  92%|█████████▏| 1108/1200 [09:04<00:45,  2.04it/s, loss=0.625, lr=1]
Steps:  92%|█████████▏| 1108/1200 [09:04<00:45,  2.04it/s, loss=0.675, lr=1]
Steps:  92%|█████████▏| 1109/1200 [09:05<00:44,  2.04it/s, loss=0.675, lr=1]
Steps:  92%|█████████▏| 1109/1200 [09:05<00:44,  2.04it/s, loss=0.54, lr=1] 
Steps:  92%|█████████▎| 1110/1200 [09:05<00:44,  2.04it/s, loss=0.54, lr=1]
Steps:  92%|█████████▎| 1110/1200 [09:05<00:44,  2.04it/s, loss=0.481, lr=1]
Steps:  93%|█████████▎| 1111/1200 [09:06<00:43,  2.04it/s, loss=0.481, lr=1]
Steps:  93%|█████████▎| 1111/1200 [09:06<00:43,  2.04it/s, loss=0.432, lr=1]
Steps:  93%|█████████▎| 1112/1200 [09:06<00:43,  2.04it/s, loss=0.432, lr=1]
Steps:  93%|█████████▎| 1112/1200 [09:06<00:43,  2.04it/s, loss=0.484, lr=1]
Steps:  93%|█████████▎| 1113/1200 [09:07<00:42,  2.04it/s, loss=0.484, lr=1]
Steps:  93%|█████████▎| 1113/1200 [09:07<00:42,  2.04it/s, loss=0.273, lr=1]
Steps:  93%|█████████▎| 1114/1200 [09:07<00:42,  2.04it/s, loss=0.273, lr=1]
Steps:  93%|█████████▎| 1114/1200 [09:07<00:42,  2.04it/s, loss=0.526, lr=1]
Steps:  93%|█████████▎| 1115/1200 [09:08<00:41,  2.04it/s, loss=0.526, lr=1]
Steps:  93%|█████████▎| 1115/1200 [09:08<00:41,  2.04it/s, loss=0.543, lr=1]
Steps:  93%|█████████▎| 1116/1200 [09:08<00:41,  2.04it/s, loss=0.543, lr=1]
Steps:  93%|█████████▎| 1116/1200 [09:08<00:41,  2.04it/s, loss=0.37, lr=1] 
Steps:  93%|█████████▎| 1117/1200 [09:09<00:40,  2.03it/s, loss=0.37, lr=1]
Steps:  93%|█████████▎| 1117/1200 [09:09<00:40,  2.03it/s, loss=0.4, lr=1] 
Steps:  93%|█████████▎| 1118/1200 [09:09<00:40,  2.04it/s, loss=0.4, lr=1]
Steps:  93%|█████████▎| 1118/1200 [09:09<00:40,  2.04it/s, loss=0.641, lr=1]
Steps:  93%|█████████▎| 1119/1200 [09:10<00:39,  2.04it/s, loss=0.641, lr=1]
Steps:  93%|█████████▎| 1119/1200 [09:10<00:39,  2.04it/s, loss=0.588, lr=1]
Steps:  93%|█████████▎| 1120/1200 [09:10<00:39,  2.04it/s, loss=0.588, lr=1]
Steps:  93%|█████████▎| 1120/1200 [09:10<00:39,  2.04it/s, loss=0.306, lr=1]
Steps:  93%|█████████▎| 1121/1200 [09:11<00:38,  2.04it/s, loss=0.306, lr=1]
Steps:  93%|█████████▎| 1121/1200 [09:11<00:38,  2.04it/s, loss=0.674, lr=1]
Steps:  94%|█████████▎| 1122/1200 [09:11<00:38,  2.04it/s, loss=0.674, lr=1]
Steps:  94%|█████████▎| 1122/1200 [09:11<00:38,  2.04it/s, loss=0.431, lr=1]
Steps:  94%|█████████▎| 1123/1200 [09:12<00:37,  2.04it/s, loss=0.431, lr=1]
Steps:  94%|█████████▎| 1123/1200 [09:12<00:37,  2.04it/s, loss=0.624, lr=1]
Steps:  94%|█████████▎| 1124/1200 [09:12<00:37,  2.04it/s, loss=0.624, lr=1]
Steps:  94%|█████████▎| 1124/1200 [09:12<00:37,  2.04it/s, loss=0.636, lr=1]
Steps:  94%|█████████▍| 1125/1200 [09:13<00:36,  2.04it/s, loss=0.636, lr=1]
Steps:  94%|█████████▍| 1125/1200 [09:13<00:36,  2.04it/s, loss=0.275, lr=1]
Steps:  94%|█████████▍| 1126/1200 [09:13<00:36,  2.04it/s, loss=0.275, lr=1]
Steps:  94%|█████████▍| 1126/1200 [09:13<00:36,  2.04it/s, loss=0.574, lr=1]
Steps:  94%|█████████▍| 1127/1200 [09:14<00:35,  2.04it/s, loss=0.574, lr=1]
Steps:  94%|█████████▍| 1127/1200 [09:14<00:35,  2.04it/s, loss=0.72, lr=1] 
Steps:  94%|█████████▍| 1128/1200 [09:14<00:35,  2.04it/s, loss=0.72, lr=1]
Steps:  94%|█████████▍| 1128/1200 [09:14<00:35,  2.04it/s, loss=0.282, lr=1]
Steps:  94%|█████████▍| 1129/1200 [09:15<00:34,  2.03it/s, loss=0.282, lr=1]
Steps:  94%|█████████▍| 1129/1200 [09:15<00:34,  2.03it/s, loss=0.544, lr=1]
Steps:  94%|█████████▍| 1130/1200 [09:15<00:34,  2.03it/s, loss=0.544, lr=1]
Steps:  94%|█████████▍| 1130/1200 [09:15<00:34,  2.03it/s, loss=0.392, lr=1]
Steps:  94%|█████████▍| 1131/1200 [09:16<00:33,  2.04it/s, loss=0.392, lr=1]
Steps:  94%|█████████▍| 1131/1200 [09:16<00:33,  2.04it/s, loss=0.419, lr=1]
Steps:  94%|█████████▍| 1132/1200 [09:16<00:33,  2.04it/s, loss=0.419, lr=1]
Steps:  94%|█████████▍| 1132/1200 [09:16<00:33,  2.04it/s, loss=0.762, lr=1]
Steps:  94%|█████████▍| 1133/1200 [09:17<00:32,  2.04it/s, loss=0.762, lr=1]
Steps:  94%|█████████▍| 1133/1200 [09:17<00:32,  2.04it/s, loss=0.754, lr=1]
Steps:  94%|█████████▍| 1134/1200 [09:17<00:32,  2.04it/s, loss=0.754, lr=1]
Steps:  94%|█████████▍| 1134/1200 [09:17<00:32,  2.04it/s, loss=0.354, lr=1]
Steps:  95%|█████████▍| 1135/1200 [09:18<00:31,  2.04it/s, loss=0.354, lr=1]
Steps:  95%|█████████▍| 1135/1200 [09:18<00:31,  2.04it/s, loss=0.774, lr=1]
Steps:  95%|█████████▍| 1136/1200 [09:18<00:31,  2.04it/s, loss=0.774, lr=1]
Steps:  95%|█████████▍| 1136/1200 [09:18<00:31,  2.04it/s, loss=0.639, lr=1]
Steps:  95%|█████████▍| 1137/1200 [09:19<00:30,  2.04it/s, loss=0.639, lr=1]
Steps:  95%|█████████▍| 1137/1200 [09:19<00:30,  2.04it/s, loss=0.404, lr=1]
Steps:  95%|█████████▍| 1138/1200 [09:19<00:30,  2.04it/s, loss=0.404, lr=1]
Steps:  95%|█████████▍| 1138/1200 [09:19<00:30,  2.04it/s, loss=0.587, lr=1]
Steps:  95%|█████████▍| 1139/1200 [09:20<00:29,  2.04it/s, loss=0.587, lr=1]
Steps:  95%|█████████▍| 1139/1200 [09:20<00:29,  2.04it/s, loss=0.561, lr=1]
Steps:  95%|█████████▌| 1140/1200 [09:20<00:29,  2.04it/s, loss=0.561, lr=1]
Steps:  95%|█████████▌| 1140/1200 [09:20<00:29,  2.04it/s, loss=0.432, lr=1]
Steps:  95%|█████████▌| 1141/1200 [09:21<00:29,  2.03it/s, loss=0.432, lr=1]
Steps:  95%|█████████▌| 1141/1200 [09:21<00:29,  2.03it/s, loss=0.462, lr=1]
Steps:  95%|█████████▌| 1142/1200 [09:21<00:28,  2.04it/s, loss=0.462, lr=1]
Steps:  95%|█████████▌| 1142/1200 [09:21<00:28,  2.04it/s, loss=0.291, lr=1]
Steps:  95%|█████████▌| 1143/1200 [09:22<00:27,  2.04it/s, loss=0.291, lr=1]
Steps:  95%|█████████▌| 1143/1200 [09:22<00:27,  2.04it/s, loss=0.481, lr=1]
Steps:  95%|█████████▌| 1144/1200 [09:22<00:27,  2.04it/s, loss=0.481, lr=1]
Steps:  95%|█████████▌| 1144/1200 [09:22<00:27,  2.04it/s, loss=0.798, lr=1]
Steps:  95%|█████████▌| 1145/1200 [09:23<00:26,  2.04it/s, loss=0.798, lr=1]
Steps:  95%|█████████▌| 1145/1200 [09:23<00:26,  2.04it/s, loss=0.697, lr=1]
Steps:  96%|█████████▌| 1146/1200 [09:23<00:26,  2.04it/s, loss=0.697, lr=1]
Steps:  96%|█████████▌| 1146/1200 [09:23<00:26,  2.04it/s, loss=0.277, lr=1]
Steps:  96%|█████████▌| 1147/1200 [09:24<00:25,  2.04it/s, loss=0.277, lr=1]
Steps:  96%|█████████▌| 1147/1200 [09:24<00:25,  2.04it/s, loss=0.275, lr=1]
Steps:  96%|█████████▌| 1148/1200 [09:24<00:25,  2.04it/s, loss=0.275, lr=1]
Steps:  96%|█████████▌| 1148/1200 [09:24<00:25,  2.04it/s, loss=1.01, lr=1] 
Steps:  96%|█████████▌| 1149/1200 [09:24<00:25,  2.04it/s, loss=1.01, lr=1]
Steps:  96%|█████████▌| 1149/1200 [09:24<00:25,  2.04it/s, loss=0.632, lr=1]
Steps:  96%|█████████▌| 1150/1200 [09:25<00:24,  2.04it/s, loss=0.632, lr=1]
Steps:  96%|█████████▌| 1150/1200 [09:25<00:24,  2.04it/s, loss=0.371, lr=1]
Steps:  96%|█████████▌| 1151/1200 [09:25<00:24,  2.04it/s, loss=0.371, lr=1]
Steps:  96%|█████████▌| 1151/1200 [09:25<00:24,  2.04it/s, loss=0.629, lr=1]
Steps:  96%|█████████▌| 1152/1200 [09:26<00:23,  2.04it/s, loss=0.629, lr=1]
Steps:  96%|█████████▌| 1152/1200 [09:26<00:23,  2.04it/s, loss=0.425, lr=1]
Steps:  96%|█████████▌| 1153/1200 [09:26<00:23,  2.03it/s, loss=0.425, lr=1]
Steps:  96%|█████████▌| 1153/1200 [09:26<00:23,  2.03it/s, loss=0.368, lr=1]
Steps:  96%|█████████▌| 1154/1200 [09:27<00:22,  2.03it/s, loss=0.368, lr=1]
Steps:  96%|█████████▌| 1154/1200 [09:27<00:22,  2.03it/s, loss=0.339, lr=1]
Steps:  96%|█████████▋| 1155/1200 [09:27<00:22,  2.04it/s, loss=0.339, lr=1]
Steps:  96%|█████████▋| 1155/1200 [09:27<00:22,  2.04it/s, loss=0.599, lr=1]
Steps:  96%|█████████▋| 1156/1200 [09:28<00:21,  2.04it/s, loss=0.599, lr=1]
Steps:  96%|█████████▋| 1156/1200 [09:28<00:21,  2.04it/s, loss=0.441, lr=1]
Steps:  96%|█████████▋| 1157/1200 [09:28<00:21,  2.04it/s, loss=0.441, lr=1]
Steps:  96%|█████████▋| 1157/1200 [09:28<00:21,  2.04it/s, loss=0.476, lr=1]
Steps:  96%|█████████▋| 1158/1200 [09:29<00:20,  2.04it/s, loss=0.476, lr=1]
Steps:  96%|█████████▋| 1158/1200 [09:29<00:20,  2.04it/s, loss=0.553, lr=1]
Steps:  97%|█████████▋| 1159/1200 [09:29<00:20,  2.04it/s, loss=0.553, lr=1]
Steps:  97%|█████████▋| 1159/1200 [09:29<00:20,  2.04it/s, loss=0.462, lr=1]
Steps:  97%|█████████▋| 1160/1200 [09:30<00:19,  2.04it/s, loss=0.462, lr=1]
Steps:  97%|█████████▋| 1160/1200 [09:30<00:19,  2.04it/s, loss=0.266, lr=1]
Steps:  97%|█████████▋| 1161/1200 [09:30<00:19,  2.04it/s, loss=0.266, lr=1]
Steps:  97%|█████████▋| 1161/1200 [09:30<00:19,  2.04it/s, loss=0.295, lr=1]
Steps:  97%|█████████▋| 1162/1200 [09:31<00:18,  2.04it/s, loss=0.295, lr=1]
Steps:  97%|█████████▋| 1162/1200 [09:31<00:18,  2.04it/s, loss=0.45, lr=1] 
Steps:  97%|█████████▋| 1163/1200 [09:31<00:18,  2.04it/s, loss=0.45, lr=1]
Steps:  97%|█████████▋| 1163/1200 [09:31<00:18,  2.04it/s, loss=0.324, lr=1]
Steps:  97%|█████████▋| 1164/1200 [09:32<00:17,  2.04it/s, loss=0.324, lr=1]
Steps:  97%|█████████▋| 1164/1200 [09:32<00:17,  2.04it/s, loss=0.393, lr=1]
Steps:  97%|█████████▋| 1165/1200 [09:32<00:17,  2.03it/s, loss=0.393, lr=1]
Steps:  97%|█████████▋| 1165/1200 [09:32<00:17,  2.03it/s, loss=0.535, lr=1]
Steps:  97%|█████████▋| 1166/1200 [09:33<00:16,  2.03it/s, loss=0.535, lr=1]
Steps:  97%|█████████▋| 1166/1200 [09:33<00:16,  2.03it/s, loss=0.323, lr=1]
Steps:  97%|█████████▋| 1167/1200 [09:33<00:16,  2.04it/s, loss=0.323, lr=1]
Steps:  97%|█████████▋| 1167/1200 [09:33<00:16,  2.04it/s, loss=0.371, lr=1]
Steps:  97%|█████████▋| 1168/1200 [09:34<00:15,  2.04it/s, loss=0.371, lr=1]
Steps:  97%|█████████▋| 1168/1200 [09:34<00:15,  2.04it/s, loss=0.368, lr=1]
Steps:  97%|█████████▋| 1169/1200 [09:34<00:15,  2.04it/s, loss=0.368, lr=1]
Steps:  97%|█████████▋| 1169/1200 [09:34<00:15,  2.04it/s, loss=0.311, lr=1]
Steps:  98%|█████████▊| 1170/1200 [09:35<00:14,  2.04it/s, loss=0.311, lr=1]
Steps:  98%|█████████▊| 1170/1200 [09:35<00:14,  2.04it/s, loss=0.34, lr=1] 
Steps:  98%|█████████▊| 1171/1200 [09:35<00:14,  2.04it/s, loss=0.34, lr=1]
Steps:  98%|█████████▊| 1171/1200 [09:35<00:14,  2.04it/s, loss=0.389, lr=1]
Steps:  98%|█████████▊| 1172/1200 [09:36<00:13,  2.04it/s, loss=0.389, lr=1]
Steps:  98%|█████████▊| 1172/1200 [09:36<00:13,  2.04it/s, loss=0.711, lr=1]
Steps:  98%|█████████▊| 1173/1200 [09:36<00:13,  2.04it/s, loss=0.711, lr=1]
Steps:  98%|█████████▊| 1173/1200 [09:36<00:13,  2.04it/s, loss=0.331, lr=1]
Steps:  98%|█████████▊| 1174/1200 [09:37<00:12,  2.04it/s, loss=0.331, lr=1]
Steps:  98%|█████████▊| 1174/1200 [09:37<00:12,  2.04it/s, loss=0.571, lr=1]
Steps:  98%|█████████▊| 1175/1200 [09:37<00:12,  2.04it/s, loss=0.571, lr=1]
Steps:  98%|█████████▊| 1175/1200 [09:37<00:12,  2.04it/s, loss=0.593, lr=1]
Steps:  98%|█████████▊| 1176/1200 [09:38<00:11,  2.04it/s, loss=0.593, lr=1]
Steps:  98%|█████████▊| 1176/1200 [09:38<00:11,  2.04it/s, loss=0.487, lr=1]
Steps:  98%|█████████▊| 1177/1200 [09:38<00:11,  2.03it/s, loss=0.487, lr=1]
Steps:  98%|█████████▊| 1177/1200 [09:38<00:11,  2.03it/s, loss=0.339, lr=1]
Steps:  98%|█████████▊| 1178/1200 [09:39<00:10,  2.04it/s, loss=0.339, lr=1]
Steps:  98%|█████████▊| 1178/1200 [09:39<00:10,  2.04it/s, loss=0.356, lr=1]
Steps:  98%|█████████▊| 1179/1200 [09:39<00:10,  2.04it/s, loss=0.356, lr=1]
Steps:  98%|█████████▊| 1179/1200 [09:39<00:10,  2.04it/s, loss=0.281, lr=1]
Steps:  98%|█████████▊| 1180/1200 [09:40<00:09,  2.04it/s, loss=0.281, lr=1]
Steps:  98%|█████████▊| 1180/1200 [09:40<00:09,  2.04it/s, loss=0.324, lr=1]
Steps:  98%|█████████▊| 1181/1200 [09:40<00:09,  2.04it/s, loss=0.324, lr=1]
Steps:  98%|█████████▊| 1181/1200 [09:40<00:09,  2.04it/s, loss=0.295, lr=1]
Steps:  98%|█████████▊| 1182/1200 [09:41<00:08,  2.04it/s, loss=0.295, lr=1]
Steps:  98%|█████████▊| 1182/1200 [09:41<00:08,  2.04it/s, loss=0.532, lr=1]
Steps:  99%|█████████▊| 1183/1200 [09:41<00:08,  2.04it/s, loss=0.532, lr=1]
Steps:  99%|█████████▊| 1183/1200 [09:41<00:08,  2.04it/s, loss=0.616, lr=1]
Steps:  99%|█████████▊| 1184/1200 [09:42<00:07,  2.04it/s, loss=0.616, lr=1]
Steps:  99%|█████████▊| 1184/1200 [09:42<00:07,  2.04it/s, loss=0.538, lr=1]
Steps:  99%|█████████▉| 1185/1200 [09:42<00:07,  2.04it/s, loss=0.538, lr=1]
Steps:  99%|█████████▉| 1185/1200 [09:42<00:07,  2.04it/s, loss=0.424, lr=1]
Steps:  99%|█████████▉| 1186/1200 [09:43<00:06,  2.04it/s, loss=0.424, lr=1]
Steps:  99%|█████████▉| 1186/1200 [09:43<00:06,  2.04it/s, loss=0.591, lr=1]
Steps:  99%|█████████▉| 1187/1200 [09:43<00:06,  2.04it/s, loss=0.591, lr=1]
Steps:  99%|█████████▉| 1187/1200 [09:43<00:06,  2.04it/s, loss=0.283, lr=1]
Steps:  99%|█████████▉| 1188/1200 [09:44<00:05,  2.04it/s, loss=0.283, lr=1]
Steps:  99%|█████████▉| 1188/1200 [09:44<00:05,  2.04it/s, loss=0.63, lr=1] 
Steps:  99%|█████████▉| 1189/1200 [09:44<00:05,  2.03it/s, loss=0.63, lr=1]
Steps:  99%|█████████▉| 1189/1200 [09:44<00:05,  2.03it/s, loss=0.63, lr=1]
Steps:  99%|█████████▉| 1190/1200 [09:45<00:04,  2.04it/s, loss=0.63, lr=1]
Steps:  99%|█████████▉| 1190/1200 [09:45<00:04,  2.04it/s, loss=0.565, lr=1]
Steps:  99%|█████████▉| 1191/1200 [09:45<00:04,  2.04it/s, loss=0.565, lr=1]
Steps:  99%|█████████▉| 1191/1200 [09:45<00:04,  2.04it/s, loss=0.491, lr=1]
Steps:  99%|█████████▉| 1192/1200 [09:46<00:03,  2.04it/s, loss=0.491, lr=1]
Steps:  99%|█████████▉| 1192/1200 [09:46<00:03,  2.04it/s, loss=0.702, lr=1]
Steps:  99%|█████████▉| 1193/1200 [09:46<00:03,  2.04it/s, loss=0.702, lr=1]
Steps:  99%|█████████▉| 1193/1200 [09:46<00:03,  2.04it/s, loss=0.411, lr=1]
Steps: 100%|█████████▉| 1194/1200 [09:47<00:02,  2.04it/s, loss=0.411, lr=1]
Steps: 100%|█████████▉| 1194/1200 [09:47<00:02,  2.04it/s, loss=0.504, lr=1]
Steps: 100%|█████████▉| 1195/1200 [09:47<00:02,  2.04it/s, loss=0.504, lr=1]
Steps: 100%|█████████▉| 1195/1200 [09:47<00:02,  2.04it/s, loss=0.328, lr=1]
Steps: 100%|█████████▉| 1196/1200 [09:48<00:01,  2.04it/s, loss=0.328, lr=1]
Steps: 100%|█████████▉| 1196/1200 [09:48<00:01,  2.04it/s, loss=0.257, lr=1]
Steps: 100%|█████████▉| 1197/1200 [09:48<00:01,  2.04it/s, loss=0.257, lr=1]
Steps: 100%|█████████▉| 1197/1200 [09:48<00:01,  2.04it/s, loss=0.398, lr=1]
Steps: 100%|█████████▉| 1198/1200 [09:49<00:00,  2.04it/s, loss=0.398, lr=1]
Steps: 100%|█████████▉| 1198/1200 [09:49<00:00,  2.04it/s, loss=0.545, lr=1]
Steps: 100%|█████████▉| 1199/1200 [09:49<00:00,  2.04it/s, loss=0.545, lr=1]
Steps: 100%|█████████▉| 1199/1200 [09:49<00:00,  2.04it/s, loss=0.521, lr=1]
Steps: 100%|██████████| 1200/1200 [09:49<00:00,  2.04it/s, loss=0.521, lr=1]
Steps: 100%|██████████| 1200/1200 [09:49<00:00,  2.04it/s, loss=0.651, lr=1]Model weights saved in /tmp/train/output/flux_train_replicate/pytorch_lora_weights.safetensors
Loading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards:  50%|█████     | 1/2 [00:00<00:00,  6.56it/s]
Loading checkpoint shards: 100%|██████████| 2/2 [00:00<00:00,  7.64it/s]
Loading checkpoint shards: 100%|██████████| 2/2 [00:00<00:00,  7.45it/s]
Loaded text_encoder_2 as T5EncoderModel from `text_encoder_2` subfolder of FLUX.1-dev.
Loading pipeline components...:  14%|█▍        | 1/7 [00:00<00:01,  3.16it/s]Loaded text_encoder as CLIPTextModel from `text_encoder` subfolder of FLUX.1-dev.
Loading pipeline components...:  29%|██▊       | 2/7 [00:00<00:01,  4.66it/s]Loaded scheduler as FlowMatchEulerDiscreteScheduler from `scheduler` subfolder of FLUX.1-dev.
Loaded tokenizer as CLIPTokenizer from `tokenizer` subfolder of FLUX.1-dev.
{'axes_dims_rope'} was not found in config. Values will be initialized to default values.
Loaded transformer as FluxTransformer2DModel from `transformer` subfolder of FLUX.1-dev.
Loading pipeline components...:  71%|███████▏  | 5/7 [00:01<00:00,  4.99it/s]Loaded vae as AutoencoderKL from `vae` subfolder of FLUX.1-dev.
Loaded tokenizer_2 as T5TokenizerFast from `tokenizer_2` subfolder of FLUX.1-dev.
Loading pipeline components...: 100%|██████████| 7/7 [00:01<00:00,  6.05it/s]
Loading pipeline components...: 100%|██████████| 7/7 [00:01<00:00,  5.50it/s]
Steps: 100%|██████████| 1200/1200 [09:51<00:00,  2.03it/s, loss=0.651, lr=1]
./
./output/
./output/flux_train_replicate/
./output/flux_train_replicate/lora.safetensors

Run time and cost

This model runs on Nvidia A100 (80GB) GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

Huggingface Diffusers Dreambooth LoRA Trainer for Flux.1-Dev

About

Cog implementation of the Diffusers Dreambooth LoRA Trainer

Follow me on Twitter/X @lucataco93

How to use

Upload images as a zip file to train a LoRA. For max_train_steps, 100 steps per image is recommended. For resolution, 512 is recommended

If you want to upload your trained LoRA to Huggingface, be sure to add a HF_token that has write access and choose a model location.

There is also a wandb option to track your training run.

An example of an uploaded LoRA can be found here: lucataco/flux-queso

Run your LoRA

Copy the URL from the trained_model.tar from the prediction output, and use the lucataco/flux-dev-lora Explorer model to run your LoRA

An example of a prediction run with a LoRA can be found here queso

Licensing and commercial use

If you generate images on Replicate with FLUX.1 models and their fine-tunes, then you can use the images commercially.

If you download the weights off Replicate and generate images on your own computer, you can’t use the images commercially.