{"cells": [{"cell_type": "markdown", "id": "63619cc2", "metadata": {"papermill": {"duration": 0.003894, "end_time": "2025-04-03T19:56:56.948472", "exception": false, "start_time": "2025-04-03T19:56:56.944578", "status": "completed"}, "tags": []}, "source": ["\n", "# PyTorch Lightning CIFAR10 ~94% Baseline Tutorial\n", "\n", "* **Author:** Lightning.ai\n", "* **License:** CC BY-SA\n", "* **Generated:** 2025-04-03T19:56:50.585595\n", "\n", "Train a Resnet to 94% accuracy on Cifar10!\n", "\n", "\n", "---\n", "Open in [![Open In Colab](data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAHUAAAAUCAYAAACzrHJDAAAIuUlEQVRoQ+1ZaVRURxb+qhdolmbTUVSURpZgmLhHbQVFZIlGQBEXcMvJhKiTEzfigjQg7oNEJ9GMGidnjnNMBs2czIzajksEFRE1xklCTKJiQLRFsUGkoUWw+82pamn79etGYoKek1B/4NW99/tu3e/dquJBAGD27NkHALxKf39WY39gyrOi+i3xqGtUoePJrFmznrmgtModorbTu8YRNZk5cybXTvCtwh7o6NR2KzuZMWNGh6jtVt7nA0ymT5/eJlF9POrh7PAQl6s8bGYa3PUum//htmebVtLRqW0q01M5keTk5FZFzU0oRle3+zxwg5Hgtb+PZiL/ZVohxCI+hL5JgjmfjPxZ26+33BG3dA+ealHPM4gQAo5rU59gsI8bRvl54t3Ca62mvHyUAhtOlLd5WSQpKcluBjumnoCLs1EARkVd9E8l3p9y2i7RbQ1B6pFwu/YDgW8KbHJHMTQrwnjz2oZm9M4pavOCfo5jWrgCaaMVcMs6/pNhDr0+AMN93XlxV7R6DNpyzi7W/OE+yIrsjU6rTrbKV5cd/pNyItOmTbMp6sbBB+EqaYJY4cWE3VUciNt1TpgfcRFv71Fi54xT5kSoyLvOBEJMOMxWXkFlBeBSX4u6Zkcs+3KszYRtiapbNRqF31UgetVuc8z9vBXIv1qD+F1f83B6uDlCUyfsZGepGPpmg01OB7EITQbhS9ribKy+DmP1DUiClLz4bnIHVOqa7BY+Z1wg5g3zgUvyehiNpnJKxSLc/ts76LKm0BzX3c0RNy1yXjDcB5lWoro4iNHQxM+f1kWeWQARAWQS++trISJTp061Kep25X/MycwtjuctSC5rxo7ppi7VNUox5+PhPHtrsS2O1qJ6yx1QujQUzm9sh6hbkBlvvGcN8hYnwjUjH6kjfZEd5c/jitz5Jc5U3ENnFynKl4eB7nyEgP2UZ+Yz3/rVEbyYr27qELrtC4FIC0J7sc7xWnmccdHfRRTs0VB+cA4lt+oFcRR/wUeH8FG5w2Mbx8FQ8TXEvv1xYf4wBP3O2WyL3/UVjpXWgIqaFeUPr+wTmDvUB7njH6/bOv+HRg4SqioAg5GDe1aB3ZeMTJkyRSBqkLsWqSEm0fZVBEN94zEZnYvrdx1JL5cxe+a+AbhSJecRRHW/ikTFRTa38dtQlNZ5CRKwFvUtZU/kvBoEF9Uxni/XqIM+dwKbTw3rhcxIf7gmr2M+H6SMwx8iBzJbw5oxeG3Lv5FX9B3AGaHPS8e8z77H7v9VMpvPG5ug1enh7eGK8h0LBTwUb+GInqzInlRUK65DmTPQu4c3+uQKjwKK77zwUxBX4Tq7yR1RuiwUsqlrABCM6esHdXoy47fk4+prYKy8ZF574x4V5BnHQBuf4g9Z9ld8U36L2aktZNNplNfw7zotwWTy5MkCUft4aLEopJj5/OPHl1BQqeAVOnHgNSQOqmBzq9V9cfEm/yx5ubMGKS9cYPZ3vx2OS/c6PVHUuUO7Y1Pci3BO/1zgq18byebfGemLtNF+6JRtOvMk926ibussZqM+1mNz4TWkH7rCbM5phwGRGDAaoF8fY5OHFnlldAA8sgoEXKnDukA1NgSeNjqkJT9brbN4pC9WRweYXyLugR73c+MYvyWfu0yC6+mjzN1Isfw3FKJS98CU/zI1IHFkFPR52cHL2FJk0sB6kMTERIGo9GzcPkLNfA0cwdwi/hfEYO86ZMd9w+y1egfM2T2Eh/vesMNwljSzuZRT420SW3eqy8N6aHMmwmnFUZ7/PGVPbIoNZvNU1BURdHs0bT2+HjL8sDSM2e6vi4Lj5NW8WOLVA6RTT2azxLV+bglaFNqLieqemS/gWkw7NyoAHo+2dEsiivengjKsPFoqWOvbSh/kxPaxyW/JRzH2Fl3EzD9/xjAefJqB3usKUFn/0Gb+S/d/jy3FN2yLOmnSJJtn6oehByEiHPSeXnDxFGPRnoFoaBJjcdQlbDwcjL1zTNuQpoxD7R0OG0uUTMi0fkVwdzBdYIwcwZunxrVJVLplNm54BZp7jfDfYLoNyqQi1K6KxIdHzmN+QQ2WjFIwUT2zTGdlRXo4NFXVUO4sgX5dFC7f0aP/ZlNeUjFBuL8Xjl6uRuP6aMjSjpjzsH62FDU7JhBuGccEXIvDfJFFBc/gHw80dklfCVYnRaDfpiJcutPA4F7qJsfJeUPQI+1fqMlNhFx1FM0GDqkjFVg7NojlQ0Vt4aM5ReSqcbpaCg8nCW5lRsBvbT4T1TLfFptsfh7gItzuKTdJSEiwKSrt1vcmnEXXrsLbYnWDA1bu+z2WKy9Arq+1KRqdfKsoBo0GcdtEpS/B1bO4v0cFiUhkjskvKcMrWwtAPHuwQq8Z+4LZ1vTQANfXt4J0DwZX9gWa9qh4XDM/voC9JXfwYEMMHJcfNtusn82ihvliVUwg5KrPGVf6GH94ZJpEZBen6EC4qYTHA1dXhW0JIex8txzv//c8lhzXIi/BFxOH9jGbQhZsRalTIBZZ8KkGyZAxeRQvXkFF1TWz/Hm46jNYUnjPbt3JxIkT7f6dSj8qfJJyVvBxgaIlblOyjtysNHWN9fjjqWi7glJfW3/S0Hlj2XnA8PhKT9w6g3Qx3XiXhvuxQsuT1proxBKI/AaZqY1Xz5muvY8G8XkRRCaHsfQsRAFDH/tZPbcYuHotOG0FRIqB4HR3wNVoIPLtz8ycTguu+jpEigE218vd1YCr5m+HpHMvEI9u4LTXwNWaLjl0iPwGAmIpeHx1VeCqTJdPs1/vweweQPO3HC24NhOhnTphwoQnfv6QSY2ICbkNmdSA4h87oaLaiYfn5diIEd4att2erOwJXbPUHp953p6orQVSUVWRAXBT8c/dJ5L9xhzaJGp71GR/wFP8P5V2z10NSC9T93QM2xUg8fHxT+zU9ijeU4naHon8CjFJXFzc8/kn+dN06q9QgF98SYSo2Xen2NjYZy5sR6f+4nLSK5Iam2PH/x87a1YN/t5sBgAAAABJRU5ErkJggg==){height=\"20px\" width=\"117px\"}](https://colab.research.google.com/github/PytorchLightning/lightning-tutorials/blob/publication/.notebooks/lightning_examples/cifar10-baseline.ipynb)\n", "\n", "Give us a \u2b50 [on Github](https://www.github.com/Lightning-AI/lightning/)\n", "| Check out [the documentation](https://lightning.ai/docs/)\n", "| Join us [on Discord](https://discord.com/invite/tfXFetEZxv)"]}, {"cell_type": "markdown", "id": "4875cddd", "metadata": {"papermill": {"duration": 0.002904, "end_time": "2025-04-03T19:56:56.954598", "exception": false, "start_time": "2025-04-03T19:56:56.951694", "status": "completed"}, "tags": []}, "source": ["## Setup\n", "This notebook requires some packages besides pytorch-lightning."]}, {"cell_type": "code", "execution_count": 1, "id": "4b9d0bdb", "metadata": {"colab": {}, "colab_type": "code", "execution": {"iopub.execute_input": "2025-04-03T19:56:56.962195Z", "iopub.status.busy": "2025-04-03T19:56:56.961891Z", "iopub.status.idle": "2025-04-03T19:56:58.137883Z", "shell.execute_reply": "2025-04-03T19:56:58.136397Z"}, "id": "LfrJLKPFyhsK", "lines_to_next_cell": 0, "papermill": {"duration": 1.182105, "end_time": "2025-04-03T19:56:58.140015", "exception": false, "start_time": "2025-04-03T19:56:56.957910", "status": "completed"}, "tags": []}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["\u001b[33mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.\u001b[0m\u001b[33m\r\n", "\u001b[0m"]}, {"name": "stdout", "output_type": "stream", "text": ["\r\n", "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m24.2\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m25.0.1\u001b[0m\r\n", "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpython -m pip install --upgrade pip\u001b[0m\r\n"]}], "source": ["! pip install --quiet \"numpy <3.0\" \"torchvision\" \"seaborn\" \"matplotlib\" \"pandas\" \"torchmetrics>=1.0, <1.8\" \"pytorch-lightning >=2.0,<2.6\" \"torch>=1.8.1, <2.7\""]}, {"cell_type": "code", "execution_count": 2, "id": "5de68801", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:56:58.148810Z", "iopub.status.busy": "2025-04-03T19:56:58.148265Z", "iopub.status.idle": "2025-04-03T19:56:58.153407Z", "shell.execute_reply": "2025-04-03T19:56:58.152454Z"}, "papermill": {"duration": 0.011554, "end_time": "2025-04-03T19:56:58.155075", "exception": false, "start_time": "2025-04-03T19:56:58.143521", "status": "completed"}, "tags": []}, "outputs": [], "source": ["# Run this if you intend to use TPUs\n", "# !pip install cloud-tpu-client==0.10 https://storage.googleapis.com/tpu-pytorch/wheels/torch_xla-1.8-cp37-cp37m-linux_x86_64.whl"]}, {"cell_type": "code", "execution_count": 3, "id": "b5e58b05", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:56:58.163348Z", "iopub.status.busy": "2025-04-03T19:56:58.162729Z", "iopub.status.idle": "2025-04-03T19:57:01.681781Z", "shell.execute_reply": "2025-04-03T19:57:01.680468Z"}, "papermill": {"duration": 3.525658, "end_time": "2025-04-03T19:57:01.684132", "exception": false, "start_time": "2025-04-03T19:56:58.158474", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["Seed set to 7\n"]}], "source": ["import os\n", "\n", "import pandas as pd\n", "import pytorch_lightning as pl\n", "import seaborn as sn\n", "import torch\n", "import torch.nn as nn\n", "import torch.nn.functional as F\n", "import torchvision\n", "from IPython.display import display\n", "from pytorch_lightning.callbacks import LearningRateMonitor\n", "from pytorch_lightning.loggers import CSVLogger\n", "from torch.optim.lr_scheduler import OneCycleLR\n", "from torch.optim.swa_utils import AveragedModel\n", "from torch.utils.data import DataLoader, random_split\n", "from torchmetrics.functional import accuracy\n", "from torchvision.datasets import CIFAR10\n", "\n", "pl.seed_everything(7)\n", "\n", "PATH_DATASETS = os.environ.get(\"PATH_DATASETS\", \".\")\n", "BATCH_SIZE = 256 if torch.cuda.is_available() else 64\n", "NUM_WORKERS = int(os.cpu_count() / 2)"]}, {"cell_type": "markdown", "id": "dc96d624", "metadata": {"papermill": {"duration": 0.005093, "end_time": "2025-04-03T19:57:01.694793", "exception": false, "start_time": "2025-04-03T19:57:01.689700", "status": "completed"}, "tags": []}, "source": ["### CIFAR10 DataLoaders\n"]}, {"cell_type": "code", "execution_count": 4, "id": "a8d2bc7d", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:57:01.707408Z", "iopub.status.busy": "2025-04-03T19:57:01.706799Z", "iopub.status.idle": "2025-04-03T19:57:09.362241Z", "shell.execute_reply": "2025-04-03T19:57:09.360269Z"}, "lines_to_next_cell": 2, "papermill": {"duration": 7.664232, "end_time": "2025-04-03T19:57:09.364250", "exception": false, "start_time": "2025-04-03T19:57:01.700018", "status": "completed"}, "tags": []}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to /__w/13/s/.datasets/cifar-10-python.tar.gz\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  0%|          | 0/170498071 [00:00<?, ?it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  0%|          | 98304/170498071 [00:00<03:05, 918171.53it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  1%|          | 884736/170498071 [00:00<00:35, 4838145.91it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  3%|\u258e         | 4292608/170498071 [00:00<00:09, 17891412.62it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  5%|\u258c         | 8945664/170498071 [00:00<00:05, 29015138.57it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  8%|\u258a         | 13336576/170498071 [00:00<00:04, 34320260.89it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 11%|\u2588         | 18120704/170498071 [00:00<00:03, 38823993.54it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 14%|\u2588\u258e        | 23068672/170498071 [00:00<00:03, 42188328.83it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 16%|\u2588\u258c        | 27688960/170498071 [00:00<00:03, 43383272.74it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 19%|\u2588\u2589        | 32702464/170498071 [00:00<00:03, 45406357.48it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 22%|\u2588\u2588\u258f       | 37453824/170498071 [00:01<00:02, 46023843.59it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 25%|\u2588\u2588\u258d       | 42500096/170498071 [00:01<00:02, 47325511.63it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 28%|\u2588\u2588\u258a       | 47480832/170498071 [00:01<00:02, 47990036.79it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 31%|\u2588\u2588\u2588       | 52428800/170498071 [00:01<00:02, 48367999.69it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 34%|\u2588\u2588\u2588\u258e      | 57311232/170498071 [00:01<00:02, 48493944.72it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 37%|\u2588\u2588\u2588\u258b      | 62357504/170498071 [00:01<00:02, 49047388.60it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 39%|\u2588\u2588\u2588\u2589      | 67305472/170498071 [00:01<00:02, 49135807.94it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 42%|\u2588\u2588\u2588\u2588\u258f     | 72318976/170498071 [00:01<00:01, 49431086.56it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 45%|\u2588\u2588\u2588\u2588\u258c     | 77266944/170498071 [00:01<00:01, 49336075.93it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 48%|\u2588\u2588\u2588\u2588\u258a     | 82247680/170498071 [00:01<00:01, 49409647.62it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 51%|\u2588\u2588\u2588\u2588\u2588     | 87195648/170498071 [00:02<00:01, 49328062.13it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 54%|\u2588\u2588\u2588\u2588\u2588\u258d    | 92143616/170498071 [00:02<00:01, 49359384.35it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 57%|\u2588\u2588\u2588\u2588\u2588\u258b    | 97091584/170498071 [00:02<00:01, 49298057.34it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 60%|\u2588\u2588\u2588\u2588\u2588\u2589    | 102072320/170498071 [00:02<00:01, 49349863.98it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 63%|\u2588\u2588\u2588\u2588\u2588\u2588\u258e   | 107053056/170498071 [00:02<00:01, 49263678.36it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 66%|\u2588\u2588\u2588\u2588\u2588\u2588\u258c   | 112066560/170498071 [00:02<00:01, 49414194.09it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 69%|\u2588\u2588\u2588\u2588\u2588\u2588\u258a   | 117047296/170498071 [00:02<00:01, 49521720.22it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 72%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258f  | 122028032/170498071 [00:02<00:00, 49413995.74it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 75%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258d  | 127041536/170498071 [00:02<00:00, 49613180.83it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 77%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258b  | 132022272/170498071 [00:02<00:00, 49414184.57it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 80%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588  | 137035776/170498071 [00:03<00:00, 49558407.54it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 83%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258e | 142016512/170498071 [00:03<00:00, 49452140.66it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 86%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258c | 146997248/170498071 [00:03<00:00, 49519254.69it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 89%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2589 | 151977984/170498071 [00:03<00:00, 49328223.17it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 92%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258f| 156991488/170498071 [00:03<00:00, 49482938.94it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 95%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258d| 161972224/170498071 [00:03<00:00, 49333154.53it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 98%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258a| 166952960/170498071 [00:03<00:00, 49455379.96it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "100%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588| 170498071/170498071 [00:03<00:00, 46069296.31it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\n"]}, {"name": "stdout", "output_type": "stream", "text": ["Extracting /__w/13/s/.datasets/cifar-10-python.tar.gz to /__w/13/s/.datasets\n"]}, {"name": "stdout", "output_type": "stream", "text": ["Files already downloaded and verified\n"]}, {"name": "stdout", "output_type": "stream", "text": ["Files already downloaded and verified\n"]}], "source": ["\n", "cifar10_normalization = torchvision.transforms.Normalize(\n", "    mean=[x / 255.0 for x in [125.3, 123.0, 113.9]],\n", "    std=[x / 255.0 for x in [63.0, 62.1, 66.7]],\n", ")\n", "\n", "\n", "def split_dataset(dataset, val_split=0.2, train=True):\n", "    \"\"\"Splits the dataset into train and validation set.\"\"\"\n", "    len_dataset = len(dataset)\n", "    splits = get_splits(len_dataset, val_split)\n", "    dataset_train, dataset_val = random_split(dataset, splits, generator=torch.Generator().manual_seed(42))\n", "\n", "    if train:\n", "        return dataset_train\n", "    return dataset_val\n", "\n", "\n", "def get_splits(len_dataset, val_split):\n", "    \"\"\"Computes split lengths for train and validation set.\"\"\"\n", "    if isinstance(val_split, int):\n", "        train_len = len_dataset - val_split\n", "        splits = [train_len, val_split]\n", "    elif isinstance(val_split, float):\n", "        val_len = int(val_split * len_dataset)\n", "        train_len = len_dataset - val_len\n", "        splits = [train_len, val_len]\n", "    else:\n", "        raise ValueError(f\"Unsupported type {type(val_split)}\")\n", "\n", "    return splits\n", "\n", "\n", "train_transforms = torchvision.transforms.Compose(\n", "    [\n", "        torchvision.transforms.RandomCrop(32, padding=4),\n", "        torchvision.transforms.RandomHorizontalFlip(),\n", "        torchvision.transforms.ToTensor(),\n", "        cifar10_normalization,\n", "    ]\n", ")\n", "test_transforms = torchvision.transforms.Compose(\n", "    [\n", "        torchvision.transforms.ToTensor(),\n", "        cifar10_normalization,\n", "    ]\n", ")\n", "\n", "dataset_train = CIFAR10(PATH_DATASETS, train=True, download=True, transform=train_transforms)\n", "dataset_val = CIFAR10(PATH_DATASETS, train=True, download=True, transform=test_transforms)\n", "dataset_train = split_dataset(dataset_train)\n", "dataset_val = split_dataset(dataset_val, train=False)\n", "dataset_test = CIFAR10(PATH_DATASETS, train=False, download=True, transform=test_transforms)\n", "\n", "train_dataloader = DataLoader(dataset_train, batch_size=BATCH_SIZE, shuffle=True, num_workers=NUM_WORKERS)\n", "val_dataloader = DataLoader(dataset_val, batch_size=BATCH_SIZE, shuffle=False, num_workers=NUM_WORKERS)\n", "test_dataloader = DataLoader(dataset_test, batch_size=BATCH_SIZE, shuffle=False, num_workers=NUM_WORKERS)"]}, {"cell_type": "markdown", "id": "b658a1e0", "metadata": {"lines_to_next_cell": 2, "papermill": {"duration": 0.006512, "end_time": "2025-04-03T19:57:09.377083", "exception": false, "start_time": "2025-04-03T19:57:09.370571", "status": "completed"}, "tags": []}, "source": ["### Resnet\n", "Modify the pre-existing Resnet architecture from TorchVision. The pre-existing architecture is based on ImageNet\n", "images (224x224) as input. So we need to modify it for CIFAR10 images (32x32)."]}, {"cell_type": "code", "execution_count": 5, "id": "361ffcf2", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:57:09.390843Z", "iopub.status.busy": "2025-04-03T19:57:09.390580Z", "iopub.status.idle": "2025-04-03T19:57:09.396834Z", "shell.execute_reply": "2025-04-03T19:57:09.395879Z"}, "lines_to_next_cell": 2, "papermill": {"duration": 0.015717, "end_time": "2025-04-03T19:57:09.398414", "exception": false, "start_time": "2025-04-03T19:57:09.382697", "status": "completed"}, "tags": []}, "outputs": [], "source": ["def create_model():\n", "    model = torchvision.models.resnet18(pretrained=False, num_classes=10)\n", "    model.conv1 = nn.Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n", "    model.maxpool = nn.Identity()\n", "    return model"]}, {"cell_type": "markdown", "id": "611e79cd", "metadata": {"lines_to_next_cell": 2, "papermill": {"duration": 0.005574, "end_time": "2025-04-03T19:57:09.409695", "exception": false, "start_time": "2025-04-03T19:57:09.404121", "status": "completed"}, "tags": []}, "source": ["### Lightning Module\n", "Check out the [`configure_optimizers`](https://lightning.ai/docs/pytorch/stable/common/lightning_module.html#configure-optimizers)\n", "method to use custom Learning Rate schedulers. The OneCycleLR with SGD will get you to around 92-93% accuracy\n", "in 20-30 epochs and 93-94% accuracy in 40-50 epochs. Feel free to experiment with different\n", "LR schedules from https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate"]}, {"cell_type": "code", "execution_count": 6, "id": "157ad9bf", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:57:09.422343Z", "iopub.status.busy": "2025-04-03T19:57:09.421816Z", "iopub.status.idle": "2025-04-03T19:57:09.431424Z", "shell.execute_reply": "2025-04-03T19:57:09.430441Z"}, "papermill": {"duration": 0.017557, "end_time": "2025-04-03T19:57:09.432831", "exception": false, "start_time": "2025-04-03T19:57:09.415274", "status": "completed"}, "tags": []}, "outputs": [], "source": ["class LitResnet(pl.LightningModule):\n", "    def __init__(self, lr=0.05):\n", "        super().__init__()\n", "\n", "        self.save_hyperparameters()\n", "        self.model = create_model()\n", "\n", "    def forward(self, x):\n", "        out = self.model(x)\n", "        return F.log_softmax(out, dim=1)\n", "\n", "    def training_step(self, batch, batch_idx):\n", "        x, y = batch\n", "        logits = self(x)\n", "        loss = F.nll_loss(logits, y)\n", "        self.log(\"train_loss\", loss)\n", "        return loss\n", "\n", "    def evaluate(self, batch, stage=None):\n", "        x, y = batch\n", "        logits = self(x)\n", "        loss = F.nll_loss(logits, y)\n", "        preds = torch.argmax(logits, dim=1)\n", "        acc = accuracy(preds, y, task=\"multiclass\", num_classes=10)\n", "\n", "        if stage:\n", "            self.log(f\"{stage}_loss\", loss, prog_bar=True)\n", "            self.log(f\"{stage}_acc\", acc, prog_bar=True)\n", "\n", "    def validation_step(self, batch, batch_idx):\n", "        self.evaluate(batch, \"val\")\n", "\n", "    def test_step(self, batch, batch_idx):\n", "        self.evaluate(batch, \"test\")\n", "\n", "    def configure_optimizers(self):\n", "        optimizer = torch.optim.SGD(\n", "            self.parameters(),\n", "            lr=self.hparams.lr,\n", "            momentum=0.9,\n", "            weight_decay=5e-4,\n", "        )\n", "        steps_per_epoch = 45000 // BATCH_SIZE\n", "        scheduler_dict = {\n", "            \"scheduler\": OneCycleLR(\n", "                optimizer,\n", "                0.1,\n", "                epochs=self.trainer.max_epochs,\n", "                steps_per_epoch=steps_per_epoch,\n", "            ),\n", "            \"interval\": \"step\",\n", "        }\n", "        return {\"optimizer\": optimizer, \"lr_scheduler\": scheduler_dict}"]}, {"cell_type": "code", "execution_count": 7, "id": "2cf35543", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:57:09.445582Z", "iopub.status.busy": "2025-04-03T19:57:09.445012Z", "iopub.status.idle": "2025-04-03T19:58:22.286025Z", "shell.execute_reply": "2025-04-03T19:58:22.285323Z"}, "papermill": {"duration": 72.848784, "end_time": "2025-04-03T19:58:22.287297", "exception": false, "start_time": "2025-04-03T19:57:09.438513", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.10/dist-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.\n", "  warnings.warn(\n", "/usr/local/lib/python3.10/dist-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`.\n", "  warnings.warn(msg)\n", "GPU available: True (cuda), used: True\n"]}, {"name": "stderr", "output_type": "stream", "text": ["TPU available: False, using: 0 TPU cores\n"]}, {"name": "stderr", "output_type": "stream", "text": ["HPU available: False, using: 0 HPUs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["You are using a CUDA device ('NVIDIA GeForce RTX 3090') that has Tensor Cores. To properly utilize them, you should set `torch.set_float32_matmul_precision('medium' | 'high')` which will trade-off precision for performance. For more details, read https://pytorch.org/docs/stable/generated/torch.set_float32_matmul_precision.html#torch.set_float32_matmul_precision\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\n", "  | Name  | Type   | Params | Mode \n", "-----------------------------------------\n", "0 | model | ResNet | 11.2 M | train\n", "-----------------------------------------\n", "11.2 M    Trainable params\n", "0         Non-trainable params\n", "11.2 M    Total params\n", "44.696    Total estimated model params size (MB)\n", "68        Modules in train mode\n", "0         Modules in eval mode\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "845f4b3eb2a94313a41f6eea9e5649bc", "version_major": 2, "version_minor": 0}, "text/plain": ["Sanity Checking: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "7482b856372f459286f06fb108d0c32d", "version_major": 2, "version_minor": 0}, "text/plain": ["Training: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "eeb9efdb744748e19d58f308478e9a71", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "f1b604be84674394885e23b041792ffb", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "a3e5c3ff2fe84b9390bf1929114da6dc", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "c93c51e5608f4712aae5b7e295807d6f", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "77a7739c815d422ca469fa0dfcfdef0d", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stderr", "output_type": "stream", "text": ["`Trainer.fit` stopped: `max_epochs=5` reached.\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "fd9f591fc41b43518a97305b3a1fc1fb", "version_major": 2, "version_minor": 0}, "text/plain": ["Testing: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stdout", "output_type": "stream", "text": ["\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n", "       Test metric             DataLoader 0\n", "\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n", "        test_acc            0.8149999976158142\n", "        test_loss           0.5376426577568054\n", "\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n"]}, {"data": {"text/plain": ["[{'test_loss': 0.5376426577568054, 'test_acc': 0.8149999976158142}]"]}, "execution_count": 7, "metadata": {}, "output_type": "execute_result"}], "source": ["model = LitResnet(lr=0.05)\n", "\n", "trainer = pl.Trainer(\n", "    max_epochs=5,\n", "    accelerator=\"auto\",\n", "    devices=1,\n", "    logger=CSVLogger(save_dir=\"logs/\"),\n", "    callbacks=[LearningRateMonitor(logging_interval=\"step\")],\n", ")\n", "\n", "trainer.fit(model, train_dataloaders=train_dataloader, val_dataloaders=val_dataloader)\n", "trainer.test(model, dataloaders=test_dataloader)"]}, {"cell_type": "code", "execution_count": 8, "id": "efd1f967", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:58:22.300431Z", "iopub.status.busy": "2025-04-03T19:58:22.300088Z", "iopub.status.idle": "2025-04-03T19:58:22.677690Z", "shell.execute_reply": "2025-04-03T19:58:22.676734Z"}, "papermill": {"duration": 0.385404, "end_time": "2025-04-03T19:58:22.678961", "exception": false, "start_time": "2025-04-03T19:58:22.293557", "status": "completed"}, "tags": []}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>lr-SGD</th>\n", "      <th>test_acc</th>\n", "      <th>test_loss</th>\n", "      <th>train_loss</th>\n", "      <th>val_acc</th>\n", "      <th>val_loss</th>\n", "    </tr>\n", "    <tr>\n", "      <th>epoch</th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.012079</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>0.0</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>1.816580</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.034132</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>0.0</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>1.662646</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.062440</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["         lr-SGD  test_acc  test_loss  train_loss  val_acc  val_loss\n", "epoch                                                              \n", "NaN    0.012079       NaN        NaN         NaN      NaN       NaN\n", "0.0         NaN       NaN        NaN    1.816580      NaN       NaN\n", "NaN    0.034132       NaN        NaN         NaN      NaN       NaN\n", "0.0         NaN       NaN        NaN    1.662646      NaN       NaN\n", "NaN    0.062440       NaN        NaN         NaN      NaN       NaN"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"text/plain": ["<seaborn.axisgrid.FacetGrid at 0x7f2c80102e30>"]}, "execution_count": 8, "metadata": {}, "output_type": "execute_result"}, {"data": {"image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHpCAYAAACBVjiOAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjkuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8hTgPZAAAACXBIWXMAAA9hAAAPYQGoP6dpAACeJklEQVR4nOzdd5hU1fnA8e+9d/ps74WFpS2dZakCCkgRQVHBrlGxYLAlxpgoP0vEGE2MErum2WIDDaAGRRGlSoelSZHeFraX2TLt3t8fAyvIAltm+/t5nnlkZs495wwJO+++95zzKoZhGAghhBBCtFJqY09ACCGEEKIxSTAkhBBCiFZNgiEhhBBCtGoSDAkhhBCiVZNgSAghhBCtmgRDQgghhGjVJBgSQgghRKvWLIIhwzAoLi5GjkQSQgghRLA1i2CopKSE8PBwSkpKGnsqQgghhGhhmkUwJIQQQghRXyQYEkIIIUSrJsGQEEIIIVo1CYaEEEII0apJMCSEEEKIVk2CISGEEEK0ahIMCSGEEKJVk2BICCGEEK2aBENCCCGEaNUkGBJCCCFEqybBkBBCCCFaNQmGhBBCCNGqSTAkhBBCiFZNgiEhhBBCtGoSDAkhhBCiVZNgSAghhBCtmgRDQgghhGjVJBgSQgghRKtmauwJNDR/YSG+4mJM4eGooaEoqsSDQgghRGvWqoIhQ9fZuWIZR9avZeDQEWhhYZjj41HDI9BCnI09PSGEEEI0glYVDOUfOcwXb78BQNqAwUS4SvHlbkWx2TFFRWGKjUGLiEC1Wht5pkIIIYRoKK3qHlF0mxQ69soAYMPKpZiiojAnJaPa7fhycijftImydeuo2LETX14ehtfbyDMWQgghRH1rVcEQwIAxlwDw49aNFORmA6Da7ZhiYzHFJ4BmwnPoIOUbNlC2fj3uvXvxFxZi6HpjTlsIIYQQ9aTVBUOxySm0a9cRMFi37NtT3lNUFc3pxByfgBYbh+Hz4969m7INGyhbvwHPocP4XS4Mw2icyQshhBAi6GocDC1ZsoQJEyaQlJSEoijMnTv3nNe8//77pKen43A4SExM5LbbbiMvL6828w2KjL6DAPhxy0ZKS4qrbKNoGlp4OOaERLSISPTycip++IGy9esp37IF79Gj6BUVDTltIYQQQtSDGgdDpaWlpKen8+qrr1ar/fLly7n55pu5/fbb2bp1Kx9//DGrV69mypQpNZ5ssMTGxnPeyHFcfcd9OEPDztleMZsxRUZiTkpCdTjx5+ZRvnlzYH3R9u34cnNlfZEQQgjRTNV4N9m4ceMYN25ctduvWLGC1NRUfvWrXwHQvn17fvnLX/KXv/ylpkMHVd+hI2p1nWqzodpsGIaBUVaG5/ARvAcPoYaGYIqLR4uMQAsLQ9G04E5YCCGEEPWi3tcMDR48mIMHD/LFF19gGAbHjh3jk08+Yfz48We8xu12U1xcfMqjPvh8XrasXcHKb+fX+FpFUVCdTszx8WhxcRi6gWfPbso3ZFK2IRPPoUP4S0pkfZEQQgjRxNV7MDR06FDef/99rr32WiwWCwkJCYSHh5/1NtszzzxDeHh45SMlJaVe5pZ37ChLvpzLhu8XU1yQX+t+FE1DCwvDlJCIFnl8fdG2bYH1RZs3483KQi8vD+LMhRBCCBEs9R4M/fDDD/z617/m8ccfZ926dcyfP599+/YxderUM14zbdo0ioqKKh8HDx6sl7nFJ6eQ0jENs8VCfs7RoPRZub4oMQk1JBR/fgHlm7dQtm49Fdu24cvJwfB4gjKWEEIIIepOMepwH0dRFObMmcMVV1xxxjY33XQTFRUVfPzxx5WvLVu2jAsuuIAjR46QmJh4znGKi4sJDw+nqKiIsLBzL3g+G8+hw1Ts2I45PiHQd2E+Vpsdq81ep37PxjAMjPJy/CUloOuoIcdvr0VGyvoiIYQQopHVezmOsrIyTKZTh9GOf/k3hfU0YRFRlX/2uCuwWG1BH0NRFBSHA9XhwPD70cvK8OzZA6qKGhqKKT4eU2QkakgIiqIEfXwhhBBCnFmNgyGXy8WuXbsqn+/du5fMzEyioqJo27Yt06ZN4/Dhw7z77rsATJgwgSlTpvD6668zduxYsrKyuP/++xk4cCBJSUnB+yR14Pf7WDr/M37csoHrpj5AaHhkvY2laBpaaCiEhmL4fOguF+4dO/GYzWgREZjjYgP10RyOepuDEEIIIX5S42Bo7dq1XHjhhZXPH3jgAQBuueUW3n77bbKysjhw4EDl+5MnT6akpIRXXnmF3/72t0RERDBy5MhG31p/Mk0zUZSfi9fjYcP3ixk27ooGGVcxmdAiItAiItDdbvxFRfiyj6E6HJgiI9FijwdGFkuDzEcIIYRojeq0Zqih1OeaoRMO79vNsq8+Z+CIMbTv0qNOY9SFYRgYFRWB9UV+P2qIM1A3LSoqsL7IVO93NoUQQohWpdUFQ8XfLKR43v+Ivv2O094zDKNJrdkxdB29tBSjrBQUBTUk5Kf1RaGhTWquQgghRHPVqtIM3uxsDv/mN+D1Yk/vg6N//1PeVxQFwzA4tHcXUbHx1SrVUZ8UVT11fVFpKe6dx9cXhYdjjosL3EZzOht1nkIIIURz1qqq1pvj4oiYOBGAvH/8A7209LQ2y776jM/f/xcbvl/UwLM7O8VkCgRAiUmoYeH4i0so37qV0vXrKd+yFe+xbHS3u7GnKYQQQjQ7rSoYAoi8+Wa02Fj8+fnkv/feae+npnUDYOv6VZS5Shp6etWiWiyYoqMxJyWj2uz4cnIo37QxUDh25058eXkYPl9jT1MIIYRoFlpdMKTabETeeAMArgULKN+y5ZT327TvTHybtvh9PjasWNwYU6wR1W4PLLCOTwBVw3PwIOWZmZStW4d73z78RUUYut7Y0xRCCCGarFYXDAFYO3cm9KKLAChft+6U9xRFYcAFowHYunZlk80O/ZyiqmghIZjjE9BiYjF8ftw//hioj5aZiefQYfyu028LCiGEEK1dq1pAfbLIX/wCe0YGjgEDTnsvpWMacUkpZB85SObKpQwZPb4RZlh7iqahhYejhYdjeL34S0rw5f6AYrNhiorEFBuLFh6Oagv+adtCCCFEc9NqgyHV4agMhHS3G39hIeb4eOB4dmjYaDatWU6Hro135lAwKGYzpqhAyRG9ogJfTi7erKzAwY4xsZiio9DCw1HM5kaeqRBCCNE4Wm0wdILnwAGyn3sOxWQi6S9/qQwK2nXuSrvOXRt5dsGl2myoNhuGYQTqox06hPfggcD5RXHxmKIiUcPCUNRWefdUCCFEK9Xqv/W0iAh0lwvvgQMUzZlz2vu67mf7xnVUlLWc9TaKoqA5nZjj49Fi4zB0A/ee3ZSt30DZ+g14Dh3C73I1iUK6QgghRH2TYCgsjKjbbgNVxfB6T3v/q0/e59vPZrFx1bJGmF39UzQNLSwMc0IiWmQkenk5Fdu2BxZeb96Mv7CwsacohBBC1KtWf5sMwDl0KJb27bEkJ5/2Xpfefdm7YyvbMtfQf9goNK3l/pUpZjOmyEggsI7Kd/QYiqZhj4ho3IkJIYQQ9ajlfrPXgKIolYGQv6gI9+7dOPr2BaB9l+4MHjWeLr37tuhA6OdUqxUiIvAXFKJXVMjOMyGEEC1Wq79NdjLvsWMc/s1vyHnuObxHjwKgKCoZQ4bjCAlt5Nk1PMVuRy8vx19c3NhTEUIIIeqNBEMnMcXFYWnbFsPjIe+NN05ZQFzmKmH5gv+x4fumfyp1sCiKAqoq64aEEEK0aBIMnURRFKKnTkWxWKjYsgXXwoWV7x3ev4eNK5eyfvl3uCvKG3GWDUt1OAK1zqpYXC6EEEK0BBIM/Yw5IYGI668HIP/dd/Hl5QHQsVsvImPisDkclBQWNOYUG5TqcGCUleEvaR5lSYQQQoiakmCoCmHjx2Pp1AmjrIyiTz8FQFVVLrn+Vq6/67fEJCQ18gwbjqJpYBiybkgIIUSLJcFQFRRNI+buuwm/6iqibrqp8vWwiChUVQNoNgVcg0GxO/Dl5GD4/Y09FSGEECLoWs9e8RqytG2LpW1bgMBCap8PxWymrNTFN3M/IjfrMDf96mHMFmsjz7T+qQ4H/sICdJcLLTy8sacjhBBCBJVkhs7Bl59P9l/+Qu5rrwFgs9spKcynoryMLWtXNPLsGoZiNmP4/PhLXI09FSGEECLoJBg6B39eHuXr11O6dCll69ahqhr9zh8FQOaKJXg9nkaeYcNQrFZ8uTlSr0wIIUSLI8HQOVg7dybskksAKF2+HIC0Xn0Ii4yivKyUretWNub0GozqcOAvLkYvLWvsqQghhBBBJcFQNURcdx0xv/oVMffdB3A8OzQSgA0rFuP1tvzskGqzYbjd6CWyq0wIIUTLIsFQNahWKyHDhqEoCobfjy8nh7RefQmNiCQ8Koby0taxlkYxmfHl5zf2NIQQQoigkt1kNeA9doycGTPQS0tJev55rrz1HuzOkEDZilZAdTikcKsQQogWRzJDNaCFhOAvKMB39CiFs2bhCAkNZIsMneKClp8xURwOKdwqhBCixZFgqAZUp5PoO+8EoPjzz3Hv2kVRfh4z//Eic955HZ+vZdfvksKtQgghWiIJhmrI0b8/zvPPB10n97XXcNoduCvKKS0pZnvm2saeXr2Twq1CCCFaGgmGaiHq1ltRQ0PxHjiA64svGHDBKHr0O492nbo29tTqnepwYJSXS+FWIYQQLUbrXEBdx4MDtfBwom67jdJlywgZMYLu0dFBmljTp2ga6Dr+4mJMUVGNPR0hhBCizlpdZkh12FFUFb2OJ0c7zz+fuIcfxnRSIOSuKGfD94vw+311nWaTVlm4VdcbeypCCCFEnbW6zJAWGYkpLh7vsWOo8fG17ufEdnrD66VozhyUkBDm7fuBwrwcrDY73fsOCtaUmxzV4cBfVIheUiKFW4UQQjR7rS4zpCgK5uQkFFVBd7vr3F/pypUUzppF4fvv0zWtBwA7Nq2vc79NmWI2Y3h9UrhVCCFEi9DqgiEALSICc1wc/sKCOvflHDoUW48eGG43iVt3MOKSSVz2iylBmGXTJoVbhRBCtBSt7jYZBLJDpqQkvDk56G43qtVa+75UleipUyn+4gsir7+eRIcjiDNtuk4u3KqFOBt7OkIIIUSttcrMEJyUHQrCydHmxESib78d9XgglHPkEF/OepftG9fVue+mqrJwq0u22AshhGjeWmVmCI6vHUpKwpudE7RaW36Xi4J332V7YQ57/WXk5xwlrVcfVFULwoybHsVkxpeXhzkhobGnIoQQQtRaq80MAajh4Zjj49CDsHYIwJ+Xh2vxYhIzt2A1WyjKz+PHLRuD0ndTdHLhViGEEKK5atXB0InsEGYzenl5nfuztGtH+KRJmHSD9scCt9/WLfsWvYWex6PY7ejl5ehyGrUQQohmrFUHQxA4TdqckIBeVBiU/iImTcKckkLbw9lYFIXCvBx2/7ApKH03NYqqgqriKwhOZk0IIYRoDK0+GILAAmgslqBkhxSzmZi77sJkQOqRXAD27Nha536bKincKoQQormTYAjQwsIwxyfgD1J2yJqWRtgll9BRszFqyEgumnRDUPptiioLt7rkAEYhhBDNk2I0g1PziouLCQ8Pp6ioiLCwsHoZw19SQtmGTFSbrXKLfF2cON36xBlGJ/6aT5TxaEl8R7OwdOqENTW1sacihBBC1FiNM0NLlixhwoQJJCUloSgKc+fOPec1brebRx55hHbt2mG1WklNTeXNN9+szXzrjRYaijkxeNkh1WqtDIR2zZ/HJ689z55tm4PSd1Oj2OxSuFUIIUSzVeNgqLS0lPT0dF599dVqX3PNNdewcOFC/v3vf7Njxw4+/PBDunTpUtOh6505MRHFZkMvLQ1anyULFrDn87nk5Oewdsk3GEbLCxhUpxO9tFR2lQkhhGiWanzo4rhx4xg3bly128+fP5/FixezZ88eoqKiAEhtordTtJAQzImJePbuRXUGp8SEY8gQOv73E/b7/ISWu/F6vFjqUP6jKTq5cKtUsRdCCNHc1PsC6s8++4z+/fvz7LPPkpycTFpaGg8++CDlZ9m55Xa7KS4uPuXRUCyJiah2O/4gZYc0p5PE2+9grM/C6GtubnGB0AmKxSKFW4UQQjRL9V6OY8+ePSxbtgybzcacOXPIzc3l7rvvJi8vj7feeqvKa5555hmmT59e31Orkup0Yk5Kxr17N1qwskMDBpDSrx+KquL1eCgtKSYiOiYofTcVqtOJv7hECrcKIYRoduo9M6TrOoqi8P777zNw4EDGjx/PjBkzeOedd86YHZo2bRpFRUWVj4MHD9b3NE9hTohHddjxB3ENjKKqHN67i3eff5L5b73W4jIogcKtFVK4VQghRLNT78FQYmIiycnJhJ+0lqRbt24YhsGhQ4eqvMZqtRIWFnbKoyGpDgfmpCR0V0lQgxZ71jF8bjf55aXsXrEsaP02FScKtwohhBDNSb0HQ0OHDuXIkSO4TjqUb+fOnaiqSps2bep7+FozJyQEdkkF8TDByMFD6Gay0/VIHtb/fYHh9wet76ZAdTjwF0rhViGEEM1LjYMhl8tFZmYmmZmZAOzdu5fMzEwOHDgABG5x3XzzzZXtb7jhBqKjo7n11lv54YcfWLJkCb/73e+47bbbsNvtwfkU9UC12zEnJ6OXBC87pCgKQ6b+io4uN/6dP1Iyf35Q+m0qFLsdvUwKtwohhGheahwMrV27loyMDDIyMgB44IEHyMjI4PHHHwcgKyurMjACCAkJYcGCBRQWFtK/f39uvPFGJkyYwEsvvRSkj1B/zPHxqKEhQf1yN8XEEPmLX+CymFn91ed4jh0LWt+NTQq3CiGEaI6kHMc5uA8cwL19O6bEpKCV0nCXl/P2X5/Ar8CYfufTefyEoPTbFPhLSlAUcPTrh2I2N/Z0hBBCiHOSQq3nYI6LQw0NRQ/iWUdWu51uvQKZtc3Zh1rUzjLV4UAvK5PCrUIIIZoNCYbOQbXZMLdpg17qCmrtrX6jx6NpJo4e3Mf+9WtazK0lRdNA1/EXFTX2VIQQQohqkWCoGsxxcWhhYUFdO+QMDaN734EArPz4ffL/9a+g9d3YpHCrEEKI5kSCoWpQrVbMbVLQy0qD+gWfMWQ4qqqS77RxaMtGSlesCFrfjamycKvcKhNCCNEMSDBUTaa42EB2KIhrh0LCIhg4YiyD49sSbba1mAXHlYVbi2WLvRBCiKZPdpPVgPfwYcq3/oApPj6wNiZIDK8XvaICLTQ0aH02Nl9eHlp4GPb09KDtwhNCCCHqg2SGasAUG4sWEY4/iNkhCGRSsgtyWfntfCq2baN8y5ag9t8YThRuNcrKGnsqQgghxFnVe9X6lkSxWLC0aUP5lq0YYWFByw6VuUr49D//QNd1rLsOE2MPIflvf0Ntwid0n4tqs+EvyMdfUoLqlCr2Qgghmi7JDNWQKTYWLSoyqNkhR0goXdL7AVAQH4M/N5eCDz4IWv+NRQq3CiGEaA4kGKohxWzG0qYNRkV5UAut9r9gNNdM+TWDf3EbACVffknFtm1B678xVBZudbsbeypCCCHEGUkwVAum6Gi0yCj8hYVB6zM0PIKYhCTsvXvjGDkSgNzXX0f3eII2RkOrLNwa5DVWQgghRDBJMFQLitmMJaUNhscT1OwQwNb1q5jvKaAkPgbfkSOUr10b1P4bUqBwq4IviEGjEEIIEWwSDNWSKToaU1RkULNDAEcP7sdVUsy+9O7E/d//4RwyJKj9NzTV4cSfl4fh9Tb2VIQQQogqSTBUS4rJhLlNCng9GD5f0Prtd/6FWO0O4tO6Ys/oA4BeXh7UMRqS6nCgl5ZK4VYhhBBNlhy6WAeG30/5pk34i4oxxcQErV+fz4vJFDiNunzzZvJef52Q0aOJmDQpaGM0JO/RLKydOmFNTW3sqQghhBCnkcxQHSiahjk5GXzeoN4GOhEIlRQVUnj4EL7sbAo//hjP4cNBG6MhqTY7vtxcKdwqhBCiSZJgqI5M0dFoMbFBXzu0LXMN77/yLJklOdgzMkDXcW/fHtQxGorqdKK7XFK4VQghRJMkwVAdKZqGJTkJdH9Qs0PxyW3RdZ2927fCVRNJ/POfCR01Kmj9N6RA4VavFG4VQgjRJEkwFARadDRaTExQs0NRsfF07N4LgMzN67G2bw+Ar6CgWZ7qrFisgVtlTX+JmhBCiFZGgqEgUFQVS3IyGHpQs0P9zw8cvrh722byso9Stn49h3/9a3Jff73ZBRWBwq3FUrhVCCFEkyPBUJBoUVFosbH4CgqC1md0fCIduvYEYN3ShZgTEjC8XioyMyldvDho4zQE1WbDcFfgL5FbZUIIIZoWCYaCRFFVLElJKBhBLaHR/4JRhIZH0qZ9J8xJSURecw0A+W+/HdTAqyEoJjP+ZniLTwghRMsmwVAQaZGRmOLi8RcGL0iJSUjixnt/T/e+gwAIu+wyLB06oLtc5P/730EbpyGoDgc+KdwqhBCiiZFgKIgUVcWclIiCEtQvfFUN/M+Uk3WYkuIiYu6+GzSNspUrKVu/Pmjj1Dcp3CqEEKIpMjX2BFqaQHYoDu+xY6jx8UHrd92y71j13XzSevVl9BXXEnHVVaBp2Hv3DtoY9e3kwq2m2NjGno4QQggBSGYo6BRFwZychKIGNzuU0qEzAD9u2YCruJCIq68mYtIkFJOpWe0sk8KtQgghmhoJhuqBFhGBOS4Of0F+0PqMS2pD/2GjueKWqYSERVS+7s3O5thTT1GemRm0seqTFG4VQgjR1EgwVA8C2aFkFJMZvaIiaP0OHD6GxJTUU14r+fJLKjZuJPfvf0cvLw/aWPVF0TQMw8BfVNTYUxFCCCEACYbqjRoejjk+Dj2IO8sAdN3P9o3rWLN4AQAR11yDKS4Of04OriVLgjpWfQkUbs2Twq1CCCGaBFlAXU8URcGclIQ3Oxu9vBzVbg9KvzlZR/j2s1moqkqX9H6ERUQRfddd+AsKcF5wQVDGqG+q04m/qBDd5UILC2vs6QghhGjlJDNUj7TwcMwJCehFhUHrMz45hTYdOqOqGtlHDgFg79WLkGHDUBQFw+tt8ouTpXCrEEKIpkQyQ/XMnJiI99ixoGaHhl18BRarFUdI6Cmvu3fvJvfVV3H070/kDTcEZaz6cqJwqzk5CUVRGns6QgghWjHJDNUzLSwMc3wC/iBmhyKiYyoDId9JWSBfbi7eAwcomjsX9969QRuvPkjhViGEEE2FBEMNwJyUiGKxogfxi9/v97N8wf9454U/4SouBMA5aBCO884DXSfvtdcw/P6gjRdsUrhVCCFEUyHBUAPQQkMxJwY3O6RpGjlZh3FXlLPh+58q2EfdfjtqSAievXsp+uyzoI1XH6RwqxBCiKZAgqEGYk5MRLHZ0EtLg9Zn/wtGAfDD+tWUlgTqfZkiI4maPBmAwlmz8B4+HLTxgk0KtwohhGgKJBhqIFpICObERPzFwTtsMDm1I4kpqfj9PjZ8v6jydefw4dj69MHRrx+q0xm08YJNCrcKIYRoCiQYakDmhERUux1/kLJDiqLQf1ggO7R1/arK7JCiKMT97nfEPfggWkREUMaqDycXbhVCCCEaiwRDDUgLcWJOSkIPYnaoTfvOxLdpi8VqozAvp/J11WoFQHe7KfjwQ3w5OWfqolFJ4VYhhBCNTc4ZamDm+Hi8R7Lwu1xoISF17k9RFMZccT32kBDMZstp7+f94x+ULl6MZ/du4h55pMmd6aM6HPhzc/C7XJgiIxt7OkIIIVohyQw1MNV5PDtUUoxhGEHpMywyqjIQqig/dft+xKRJYDZTnplJ2fffB2W8YJLCrUIIIRqbBEONwJwQj+pwoLtcQevT6/GwYM6H/OelP1Ne+lO/5uRkIq+7jrAJE7D37x+08YJJCrcKIYRoTBIMNQLV4cDcpg16SUnQskMms5nCvFy8HjeZK5ee8l745ZcTdcstleuImhrV6UR3lQQ1OBRCCCGqS4KhRmKOi0MNDUEP0gnMiqIwYNgoEtq0I6VD5yrb+IuKyHnhBUpXrQrKmMESKNzqk8KtQgghGkWNg6ElS5YwYcIEkpICBTbnzp1b7WuXL1+OyWSiT58+NR22xVHtdszJyeiu4GWH2nXuxsTJd9Gmfacq3y/5+mtKly0j/5//xN/EsjCKxYIvNzdofxdCCCFEddU4GCotLSU9PZ1XX321RtcVFhZy8803M2rUqJoO2WIFskOhQTt0UFEUFEXBMHT2bN9y2mLqsMsvx5SUhL+wkIJ33w3KmMEihVuFEEI0lhoHQ+PGjeOpp55i4sSJNbpu6tSp3HDDDQwePPicbd1uN8XFxac8WiLVZgusHSp1BXXx8DdzZjL/4/+wadWyU8ezWIi5+25QFFzffkv5pk1BG7OupHCrEEKIxtIga4beeust9uzZwx/+8IdqtX/mmWcIDw+vfKSkpNTzDBuPOS4OLSwsaGuHADp06wnAlnUr8ft8p7xn69qV0IsvBiDvjTfQy8uDNm5dSeFWIYQQjaHeg6Eff/yRhx9+mPfeew+TqXpnPE6bNo2ioqLKx8GDB+t5lo1HtVoxt0kJanaoQ9ceDBg2mqtvvw+tir/zyBtuQIuNRbFY8DehUhhSuFUIIURjqNcTqP1+PzfccAPTp08nLS2t2tdZrVasTXQbeH0wxcWiHQ5HLy4OSi0xRVEZMHzMGd9X7XYSHn0UU1wcitlc5/GCRbHb8R8rRi8uRo2NbezpCCGEaCXqNTNUUlLC2rVruffeezGZTJhMJp588kk2btyIyWTi22+/rc/hmw3VYsHSpg16WVlQ1w65K8pZs3gBG1ctPe09c3JyYEu7YVC2Zk2TqA0mhVuFEEI0hnrNDIWFhbF58+ZTXnvttdf49ttv+eSTT2jfvn19Dt+smGJj0SLC8RcVBa1G14HdO1mz5BusNjvd+gzAYrWd1ibvH//AtWAB4VdeSeT11wdl3LqoLNyamtqkslZCCCFarhpnhlwuF5mZmWRmZgKwd+9eMjMzOXDgABBY73PzzTcHOldVevbsecojLi4Om81Gz549cTqdwfskzZxyPDtkVJRj+P1B6bNjt15ERMfirihn85qq65LZ09MBKJo7F8++fUEZty5UhwO9tLTJnYMkhBCi5apxMLR27VoyMjLIyMgA4IEHHiAjI4PHH38cgKysrMrASNRMIDsUgT9IRwmoqkr/CwLnOmWuXIqnioXJzvPOw3Heedi6dUOx24Mybl1I4VYhhBANTTGawZG/xcXFhIeHU1RURFhYWGNPp155s7Io37IFU1w8iqbVuT9d1/no9ecpzM/lvJHj6Dt0xOltystRbDYURanzeMHgLyxEsdlw9M0IrCMSQggh6pF80zQxppgYtMiooGVGVFWl7/kjAdiWuQbDOH2Btmq3B06u9vsp+uwzvEeOBGXs2pLCrUIIIRpSvS6gFjWnmM1Y2iRTvnkLht8flOxQWq8+uCvK6JreH0U5c/xb8O67FM+bR9maNSRMn95oWZmTC7dqLTwTKIQQovFJZqgJCmSHIoN2IKKqaqQPugCr7exrgkIvuQTFZsO9bRslCxYEZezaksKtQgghGooEQ02QYjJhSUnB8HgwflZOoy6KC/NZNO+/Z9xZZo6LI/KGGwAo+M9/8OXkBG3smpLCrUIIIRqKBENNlCk6ClNMdFDLZRzau4sf1q9m3bJv8Z3hkMXQiy/G2rUrRkUFef/4R6NlZqRwqxBCiIYiwVATpZhMmJOTwecNWnaoS+++hIZHYneG4CqueoG2oqpE33UXmExUbN+O7+jRoIxdG4rJjD8/v9HGF0II0TrI1vomzPD7Kd+8GX9BIaYg1eoqKSogJCz8rAupAUpXrMDauTOmmJigjFsbemkphs+Lo39/1FZUq04IIUTDksxQE6ZoGpbkZND9QasdFhoeiaKoGIZBacmZD3d0Dh5cGQgF60TsmlLsdvSycvQgHUIphBBCVEWCoSZOi45Gi4kJ6tqhksICZr/1Gp+8+Qr+s9yC08vLyX/vPY48+GCjFHKVwq1CCCEaggRDTZyiqoHskKEHLSBxhITiKi6ktLiIbZlrztxQVSldtAjvwYO4Fi0Kytg1VVm4tRGCMSGEEK2DBEPNgBYVhRYbi6+gIDj9mUz0O38kab0ySE7tdMZ2qtVK+MSJAJQsWNAoO8ukcKsQQoj6JidQNwOKqmJJSsKfk4Pu8aBaLHXus2f/wfTsP/ic7ULGjMHQdUJHj26U2mUnF241RUY2+PhCCCFaPskMNRNaZCSmuDj8hcHJDp3g9XjYvOZ7/GdYJK1aLIRPmIDaiBXtVZsdX24ehn56XTUhhBCiriQz1Ewoqoo5KQlfdg662x2UreaGYTD7rdfIy85CM5nonjHwjG29R49SOGsW1k6dCBs/vs5j14TicKAXF6G7XFKrTAghRNBJZqgZ+Sk7VBiU/hRFoUt6XwDWL/vujNkhgIrNmyldsoTC2bPR3e6gjF9dqsVSWbhVCCGECDYJhpoRRVEwJyehqErQApIefc/D7nBSXJjPj1s2nLFdyIUXYoqLQy8spOSrr4Iydk1I4VYhhBD1RYKhZkaLiMAcxLVDZouFPoOHA7Bu2bfoetXZIcVkIvyqqwAomjsXvbw8KONXlxRuFUIIUV8kGGpmFEXBlJSEomlByw717H8eNoeTovw8ftyy8YztQoYPx5SQgF5cTPH8+UEZu7oUq1UKtwohhKgXEgw1Q1pEBOb4ePSgZYes9L9gFBmDh5PSMe2M7RRNI+KaawAoX7u2QW9ZKYoihVuFEELUC9lN1gwpioI5KQnvsWz0igpUm63OffYeOLRa7ZxDh6KYTDgGDWrwc4dUhwNfQUHQdtMJIYQQIJmhZksLD8ecELzs0AllrpLja4eqPtNH0TScQ4agaBrQsEVcpXCrEEKI+iDBUDNmTkoCiyVoi5l13c/H/3qJVd99xe5tm8/a1r17N0effJLCTz4JytjVUVm4taiowcYUQgjR8kkw1IxpYWGY4xPwFxUGpT9V1ejRdxAAP27JPGtbX3Y2FZs2UTxvXoMualYdTvy5uVK4VQghRNBIMNTMmZMSUSxW9CBtOe81cCijr7iOi6/+xVnbOQYNwtyuHUZZGaXffx+UsatDCrcKIYQINllA3cxpoaGYExPw7NuH6nDUuT+rzU5ar4zK54ZhVLlQWlFVom+7DcPnw9a7d53Hra7Kwq3FxVK4VQghRFBIZqgFMCcmoths6KWlQevz6KH9fPbeP1n13VdnLNNh69EDe3p6w+8qs9nx5eRK4VYhhBBBIcFQC6CFhGBOTMRfHLyFxYf27ubQ3l2sX/4du3/YdMZ2hmFQunIlR6ZNC1rNtHNRHA50Vwm63CoTQggRBBIMtRDmhERUux1/kLJD/c4fwYUTrqJtp6507pkOQGFeDiVVbOUvmjsXz48/UvTpp0EZ+1xOFG7V5TRqIYQQQSDBUAuhhTgxJyWhByk7pCgq3foM4NLrb0VRVAzD4LvPP+HD159n7ZJv8Pm8x9spRF53HQAlX32FryC45x6dcX4WC94cKdwqhBCi7iQYakHM8fGodke97LRyV5SjqCo+n5fVixfw0esz2LvjBwzDwJaejrVLFwyPh6LZs4M+dlVUh0MKtwohhAgKCYZaENV5PDtUUhz0jInN7uDym+5kzMTrcYaGUVyYz5ez3mHeh2/i83qIOJEdWrAAX15eUMeuimKzSeFWIYSowogRI7j//vsbexrNigRDLYw5IT5wFk89ZIcURaFzzz7ccPeDZAwZgaoGtrmbzBZsPXti7d4d/H7KMzODPnZVc5HCrUIIERyLFy9m5MiRREVF4XA46Ny5M7fccgsej6eyjWEY/POf/2Tw4MGEhYUREhJCjx49+PWvf82uXbsq2z3xxBOBn9GKgslkIiYmhmHDhvHCCy/gdrsb4+OdkwRDLYzqcGBOTkYvKam39TRmi5XBo8Zx3dQHGDZuIoqioOs6a9rFUX7PLwkZObJexv055aTCrUIIIc7t5ODmhB9++IGLL76Y/v37s2TJEjZv3szLL7+MxWKpPFrFMAxuuOEGfvWrXzF+/Hi+/vprfvjhB/79739js9l46qmnTumzR48eZGVlceDAAb777juuvvpqnnnmGYYMGUJJE8zoy6GLLZA5Ph7vkSPoLhdaaGi9jRMRHVP55+2Zazh05CCHjhykwmqmz8DzK4u51hfVbsefXYxeXIwaG1uvYwkhhGEYlHsbrjj1CXazVuvz3FJTU7n99tv58ccfmTt3LpMmTeLtt98+pc3XX39NQkICzz77bOVrHTt25OKLL658PnPmTD766CM+/fRTLrvsssrX27Zty3nnnXfaL98mk4mEhAQAkpKS6NWrF2PGjCE9PZ2//OUvpwVPjU2CoRZItdsxJyfj3rkTNSSkQQ5F7JLej/KyUn5Yv4o2uUUcuuceov5vGqa4OKw2e72MqagqhhIo3GqSYEgIUc/KvX66P/5Vg4/7w5NjcVhq/3X93HPP8fjjj/OHP/yhyvcTEhLIyspiyZIlDBs2rMo2H374IV26dDklEDpZdb5nunbtyrhx45g9e3aTC4bkNlkLZY6PRw0JabCzeEwmM/0vGMWN9/we/8ZN+HNzWf7Ru7z/6l/5YcNqDKN+TotW7Y5A4Vafr176F0KI5m7kyJH89re/pWPHjnTs2PG096+++mquv/56hg8fTmJiIhMnTuSVV16huLi4ss3OnTvp0qXLKdfdf//9hISEEBISQps2bao1l65du7Jv3746fZ76IJmhFkq12QLZoe3bUUNDG6xkhmYyEXnttRzemMmx4gIqrGYyv19Ml9590bTgx96q04k/Lxd/SYnUKhNC1Cu7WeOHJ8c2yrh10b9//8o/T506lffee6/yucvlQtM03nrrLZ566im+/fZbVq1axdNPP81f/vIXVq9eTWJiYpX9PvLII9x7773Mnj2bp59+ulpzOVO9y8YmwVALZo6Px3fkCHpxMVp4eIONa+3cmZg7pnBtRgbb9uwgKi4BTQv8X23T6uV06pGOwxkSlLEUTcPQdSncKoSod4qi1Ol2VWNxOp2Vf37yySd58MEHq2yXnJzMTTfdxE033cQf//hH0tLSeOONN5g+fTqdO3dmx44dp7SPjY0lNjaWuLi4as9l27ZttG/fvnYfpB7JbbIWTLVaMbdJQS91NXhR07CxY7HExZF+3gWkdOgMwL6d21j21Wd88Opf2bR6OboenIWIUrhVCCGqJy4ujk6dOlU+ziQyMpLExERKj5d4uv7669mxYwef1qHs0vbt25k/fz5XXnllrfuoL80vxBU1YoqLRTscHsgORUQ06Nj+khKKP/8cf1ERMXfdhd0ZQkxCErlHj7Dsq8/4YcNqLrj4cpLbdajTOIrDgV5cHNg9FxYWpNkLIUTr8Pe//53MzEwmTpxIx44dqaio4N1332Xr1q28/PLLAFx33XXMnj2b6667jmnTpjF27Fji4+PZv38/M2fORPvZ7mGfz8fRo0fRdZ28vDwWLVrEU089RZ8+ffjd737XGB/zrCQz1MKpFguWNm3Qy8oaPHPiz8ujaPZsXN9+i+fAAeKTU7jq9vsYPn4iVruD/OyjfPru31mz5Js6jRMo3OqVwq1CCFELAwcOxOVyMXXqVHr06MHw4cNZuXIlc+fOZfjw4UDgFuHMmTN54YUX+OKLLxg1ahRdunThtttuIyUlhWXLlp3S59atW0lMTKRt27aMGDGCWbNmMW3aNJYuXUpISHCWSQSTYjSDSpfFxcWEh4dTVFREmPzmX2OGx0NZZia629Pg62qyn3uOspUrcZx3HnEn3aeuKCtl1aKv2bZhNRNvvZv4pBQMQ0f362immicsfXl5aOHh2NN7N8nFeUIIIZouyQy1Asrx7JBRUY7hb9gDwyKuvRYUhbKVK3Hv3Vv5us3hZPj4ifzivoeIT0oBYMemDXz09xns37W9xuOoDgf+EincKoQQouZqHAwtWbKECRMmkJSUhKIozJ0796ztZ8+ezZgxY4iNjSUsLIzBgwfz1VcNf2hVa2eKiUGLiMB/0rkRDcGSkoJz6FAACmfOPO39kLAIILDdctPqZRTl5/HVJ+9RXlqz2mqKzYZRUYG/HmqyCSGEaNlqHAyVlpaSnp7Oq6++Wq32S5YsYcyYMXzxxResW7eOCy+8kAkTJrBhw4YaT1bUXmNmh8KvvhpUFffOnWcMxhRF4Yqbf0mfwcMYMGwM9uNb7w/t3YXXe3otnaquV0xm/Hl5QZ27EEKIlq9Oa4YURWHOnDlcccUVNbquR48eXHvttTz++OPVai9rhoLD8Hop27gJvawMU1RUg45dtno1tl69UO3VL81RXJDPh68/jz0khOHjJtKuc9eztveXloLPi6N/f1Srta5TFkII0Uo0+JohXdcpKSkh6ixfxm63m+Li4lMeou4UsxlLm2QMt7vBs0OOgQMrA6Hqjl3qKsYREoqrqBCPu+Kc7VW7HaO8XHaVCSGEqJEGD4aee+45XC4X11xzzRnbPPPMM4SHh1c+UlJSGnCGLZspJgYtMhJ/YWGDj+3LyyP31VfJ/vOfq9U+MSWV6+56gBGXXkmnHukAZB3cx/KvP8ddUX5a+8rCrY3w2YQQQjRfDRoMffDBB0yfPp1Zs2ad9fjuadOmUVRUVPk4ePBgA86yZVNMJiwpbTA8ngbPDhk+H64lSyjfsIGKbduqdY3ZbKF7xkAURcEwdJZ++SkbVy3jg9eeY/vGdacVgJXCrUIIIWqqwYKhjz76iDvuuINZs2YxevTos7a1Wq2EhYWd8hDBY4qOxhQd1eDZIXN8PCEjRwJQsnBhja9XFJXzRl1MRFQM5aUuvv1sFrPffp2crMOVbVSHA72sDL/cKhNCCFFNDRIMffjhh9x66618+OGHXHLJJQ0xpDgLxWTCnNwGvJ4Gz6BETJpE9D33EHPXXbW6vm3HLlw79TcMHjUOk9nCsUMH+PhfL1OQmw0EPtuJwq1CCCFEddT4qF+Xy8WuXbsqn+/du5fMzEyioqJo27Yt06ZN4/Dhw7z77rtA4NbYLbfcwosvvsigQYM4evQoAHa7nfAGrKQuTmWKiUaLjsZfWIgpJqbhxo2NJfTCC+vUh6aZyBgygs49M1ix8Av8Ph+RMYHbrsUF+djMFnw5uVhSUlBUOVdUCCHE2dV4a/2iRYu4sIovs1tuuYW3336byZMns2/fPhYtWgTAiBEjWLx48RnbV4dsra8f3uxsKjZvRouKRjGbG3Rs948/UjBzJuETJmBPT69TX36/H03T8Hm9fPTGDMwWC0OHXEiHSyZI4VYhRKszYsQI+vTpwwsvvBCU/iZPnkxhYeE5D1luzmqcGRoxYgRni59+HuCcCIpE02OKjkaLjsFfUIApNrZBx3YtW0ZFZiZGWRm23nWrJ3aiWnJezlHcFeUUF+azb/dOUktKJBgSQghxTnIPoRVTNA1Lm2QwdAyvt0HHDr/iChSLBffOnZRnZgalz/ikFG64+0HSz7uAvoPOx5uTi6sgn7X/m4Pf17CfTwjRgnlKz/7wn7QW0+c5e1vvSceEGMbp79fQ5MmTWbx4MS+++GLgZH5FYd++fWzZsoVx48YREhJCfHw8N910E7m5uZXXffLJJ/Tq1Qu73U50dDSjR4+mtLSUJ554gnfeeYdPP/20sr/qJDkeeugh0tLScDgcdOjQgcceewzvz75nPv/8cwYMGIDNZiMmJoaJEydWvud2u3nooYdISUnBarXSqVMn/v3vf9f476O6al4eXLQoWlQUWkwMvtw8zGc57iDYTJGRhI4dS/Hnn1P40UfY+/QJSrV5uzOEoWMuRS8vx19SzLL//Jsfli9m08KvuOqRJwmLabjPKIRooZ5OOvv7V78NPY5/sX/7JHz/8pnbJmXAnYsCfy7Lg792PPX9J4pqNLUXX3yRnTt30rNnT5588kkAzGYzAwcO5I477uBvf/sb5eXlPPTQQ1xzzTV8++23ZGVlcf311/Pss88yceJESkpKWLp0KYZh8OCDD7Jt2zaKi4t56623AM56aPIJoaGhvP322yQlJbF582amTJlCaGgov//97wGYN28eEydO5JFHHuHdd9/F4/HwxRdfVF5/8803s2LFCl566SXS09PZu3fvKcFbsEkw1MopqoolORl/Xh6G19uga4fCr7iCkq+/xrN7N+Xr1uHo3z9ofSs2G0ZhAUmpHdi7OROTxUJIVDQQKAobjMBLCCGamvDwcCwWCw6Hg4SEBACeeuopMjIyePrppyvbvfnmm6SkpLBz505cLhc+n49JkybRrl07AHr16lXZ1m6343a7K/urjkcffbTyz6mpqTz44IN89NFHlcHQn/70J6677jqmT59e2S79+PrRnTt3MmvWLBYsWFB5FE+HDh1q+ldRIxIMCbTIyEB2KCcHc1x8w40bHk7ouHEUz51L2dq1wQ2GFAU0E106daPLC3+nrKgIVdUwDIPZf36CxE5dGHD5lZgtUsNMCFFD/3fk7O9rJ/1cGfk4jJh25rbKSatVHNHn7rsWNm7cyHfffUdISMhp7+3evZuLLrqIUaNG0atXL8aOHctFF13EVVddRWRkZK3HnDlzJi+99BK7d++uDLZO3gCVmZnJlClTqrw2MzMTTdMYPnx4rcevKQmGxE/ZoZxcdI8H1WJpsLHDL7sMe8+e2Oq4o6wqqtOJr7AQR8eO2JKSAdi/aQP7MtexL3MdWxcv5MJbptCx/yDJFAkhqs/irH5bkwWo5s9URalZ39XkcrmYMGECf/nLX057LzExEU3TWLBgAd9//z1ff/01L7/8Mo888girVq2iffv2NR5vxYoV3HjjjUyfPp2xY8cSHh7ORx99xPPPP1/Zxn6Wot1ne6++yAJqAQSyQ6a4OPwFBQ07blhY5XohQ9cxdP3cF1WTardjlJWdUri1Xe8MLr3/IUKiYyjOOcanzz3F7Gf+QP6RQ0EbVwghGpPFYsF/Urmlvn37snXrVlJTU+nUqdMpD6czEHwpisLQoUOZPn06GzZswGKxMGfOnCr7O5fvv/+edu3a8cgjj9C/f386d+7M/v37T2nTu3dvFp6hEkGvXr3Qdb3KY3nqiwRDAgj8QzAnJ6GoCrrb3eDjl61fz5Hf/Y6ylSuD1qeiqhhwSuFWRVHoMvgCbpvxBoMmXoNmMrFv43q+e+efQRtXCCEaU2pqKqtWrWLfvn3k5uZyzz33kJ+fz/XXX8+aNWvYvXs3X331Fbfeeit+v59Vq1bx9NNPs3btWg4cOMDs2bPJycmhW7dulf1t2rSJHTt2kJube9qusJ/r3LkzBw4c4KOPPmL37t289NJLlYHVCX/4wx/48MMP+cMf/sC2bdvYvHlzZeYqNTWVW265hdtuu425c+eyd+9eFi1axKxZs+rnLwwJhsRJtIgIzHFx+AsbNjsE4Nm1C+/+/RTOmhXUArKqw4k/N++0siNmm43zr7uZW55/jY79BzH8F7cBoPv97Fqz8qxnaQkhRFP24IMPomka3bt3JzY2Fo/Hw/Lly/H7/Vx00UX06tWL+++/n4iICFRVJSwsjCVLljB+/HjS0tJ49NFHef755xk3bhwAU6ZMoUuXLvTv35/Y2FiWL19+1vEvu+wyfvOb33DvvffSp08fvv/+ex577LFT2owYMYKPP/6Yzz77jD59+jBy5EhWr15d+f7rr7/OVVddxd13303Xrl2ZMmUKpaU1P2qgump8AnVjkBOoG46voIDyjRtRQ8NQrQ23uFgvLeXQ3Xejl5aSMH06th49gtKv4fPhz8/DnpGBqRqLATfM/5xv3/o7yV17cPHdvyEivvq7J4QQQjRPsoBanEKLiMAcH4/3yBHUBgwEVKeT6LvuwhQfj7UWC/bO5OTCrdUJhgzDwGSxkntwH5ZGWMQnhBCi4UlmSJzGX1hIWeZG1JAQVJutsadTZ76CAlS7HUffjGoVbi3OzSH/0AFS+/QDYOV/P8IREUHPC8egqlp9T1cIIZq0p59++pQzi052wQUX8OWXXzbwjOpOgiFRpYrt2/EeOoQpIbFBxzW8Xkq+/ZbS5ctJePxxFFPdk5e6x4NeXIyjX1+00NAaXZt3+CDv/u5edL+fLoMv4NL7H6rzfIQQojnLz88nPz+/yvfsdjvJyckNPKO6k9tkokrmxES8x46hl5ejNuDtIsPvp3DmTPTiYlyLFxM6alSd+1QtFvxeL3pxcY2DoYj4RIbdeBvff/w+3YeNrHy9otSFzXn6AWZCCNHSRUVFVaskR3Miu8lElbTwcMwJifgLC4J69s+5qDYb4ceL9RX9979BKyCrWCx4c2pe10Yzmeh3yeVMeeVNOvQdAMDezHX8857bWP/Fp+hB3PkmhBCicUgwJM7I0q4tpqgofDnZDTpu6EUXoUVE4MvOxvXdd0HpU3U48JcUo5eV1ep620nH2G9d9A2e8jK+e+ef/OehX3Fw66agzFEIIUTjkGBInJFqs2Ht3BnV4cB3hvvD9TKu1Ur4pEkAFAYpO6TYbBgVFfhPOo26tsb/6kHGTLkXW2gYuQf3M+vJ/+N/L/wFd1n9nYEhhBCi/kgwJM5KCwvD1qkT6Dp+l6vBxg0ZPRotKgp/URHuH3+sc38nCrf68/Lq3JeqavQefTG3vfB30i+6BEVR2bFiKduXL6lz30IIIRqe7CYT1eI+eBD39h1oUVENdhhjxQ8/YIqPxxQdHZT+/KWl4Pfh6NcvqJ/hwJZNGIZOu159gtanEEKIhiOZIVEtluRkLG3b4s/LPa20RX2xde9eGQgFo0RHVYVbg6Ftz96VgZC3ogJ/A/39CCFEU7Rv3z4URSEzM7Oxp1JtEgyJalFUFWv7VEyJifhycxqsdpfudlPw4Yccvv/+OheQrapwazDtzVzH2w/ezfovPq2X/oUQojpGjBjB/fffH7T+Jk+ezBVXXBG0/poiCYZEtSkWC7aOHdHCw/Hn1nybeq3G1DRKly7Fl5VFyfz5de7vTIVbg6G0sIDinGy+/+QDinMbdgeeEEKI2pNgSNSI6nBg7dQJxWzCX1RU7+MpJhPhV10FQMnChXU+80h1ONDLSoOyq+znegwbSduevel78QTsIbK2TYiWqsxbRpm3rDJDXu4rp8xbhl8P3M53+92Uecvw6oGdsF6/lzJvGR6/BwCf7qPMW0aFrwIA3dAr+/z5GDU1efJkFi9ezIsvvoiiKCiKwr59+9iyZQvjxo0jJCSE+Ph4brrpJnJP+qX2k08+oVevXtjtdqKjoxk9ejSlpaU88cQTvPPOO3z66aeV/S1atKjG81q8eDEDBw7EarWSmJjIww8/jO+kX0rPND7AokWLGDhwIE6nk4iICIYOHcr+/ftrPIezkWBI1JgpMhJrp04Y7opan9tTEyHDhxN5yy0k/fnP1aotdjaKyYTh9+MvLg7S7E7qW1W56pGnuOCGyZhbQE03IUTVBn0wiEEfDKLAXQDA9f+7nkEfDGJ99noApi2dxqAPBvHJzk8A+OfmfzLog0E8u+ZZABYeWMigDwZx1zd3AbCncA+DPhjExf+9+LQxaurFF19k8ODBTJkyhaysLLKysggNDWXkyJFkZGSwdu1a5s+fz7Fjx7jmmmsAyMrK4vrrr+e2225j27ZtLFq0iEmTJmEYBg8++CDXXHMNF198cWV/Q4YMqdGcDh8+zPjx4xkwYAAbN27k9ddf59///jdPPfXUOcf3+XxcccUVDB8+nE2bNrFixQruvPPOwA7hIJJyHKJWTPHxWMrKce/ehWI2o5jN9TaWommET5gQvP5sdnw5uVhSUuocXJ3W9/H+SgsLWDV3FhdcfwtmqwRGQoiGER4ejsViweFwkJCQAMBTTz1FRkbGKcVV33zzTVJSUti5cyculwufz8ekSZNo164dAL169apsa7fbcbvdlf3V1GuvvUZKSgqvvPIKiqLQtWtXjhw5wkMPPcTjjz9OVlbWGcfPz8+nqKiISy+9lI4dOwLQrVu3Ws3jbCQYErWiKAqWdm0x3BV4Dh3CFBePotVvRXdvdjZF//0vpvh4Io4fylgbqtOJXlyMXlpa41pl1WEYBp889Si5B/djsTk4/7qbgj6GEKLxrLphFQB2U6Bu44eXfohhGFi1wJEdz1zwDE8NfQqzFvglcUqvKUzuMRmTGvjKHdV2FKtuWIWqBH556hDRobLPn48RDBs3buS7774jJOT0eoq7d+/moosuYtSoUfTq1YuxY8dy0UUXcdVVVxEZGRmU8bdt28bgwYNPyeYMHToUl8vFoUOHSE9PP+P4UVFRTJ48mbFjxzJmzBhGjx7NNddcQ2JicIuIy20yUWuKpmHp0AFTTAz+Bthh5t65E9fChRTNnRs4M6iWVIsF43gl+/qgKApDrrkRgIM/bEbXpX6ZEC2Jw+zAYXZUfrnbTXYcZgeaGviF0KpZcZgdmNVAMGTWzDjMDiyaBQCTasJhdmAzBbLGqqJW9vnzMYLB5XIxYcIEMjMzT3n8+OOPDBs2DE3TWLBgAV9++SXdu3fn5ZdfpkuXLuzduzco45/LucZ/6623WLFiBUOGDGHmzJmkpaWxcuXKoM5BgiFRJ6rVGijZ4XTir+eSHc7BgzGnpGCUlVH8v//VqS/FasUbhNOoz6TTgMFc8fvHuPaJZ1DV+s2YCSHEySwWC/6Tzmbr27cvW7duJTU1lU6dOp3ycDqdQOCXuKFDhzJ9+nQ2bNiAxWJhzpw5VfZXU926dWPFihWn/MK8fPlyQkNDadOmzTnHB8jIyGDatGl8//339OzZkw8++KDW86mKBEOizrSQEKydO4NCvezSOkHRNCKOL/gr/t//6jSW6nDgLyqqtwXgiqLQsd8gVFXD0HWKso/WyzhCCPFzqamprFq1in379pGbm8s999xDfn4+119/PWvWrGH37t189dVX3Hrrrfj9flatWsXTTz/N2rVrOXDgALNnzyYnJ6dybU5qaiqbNm1ix44d5Obm4q1hvci7776bgwcPct9997F9+3Y+/fRT/vCHP/DAAw+gqupZx9+7dy/Tpk1jxYoV7N+/n6+//poff/wx6OuGJBgSQWGKjsbaoSNGqQu9oqLexnEMGoQ5NRWjvJzizz+vdT/BLNx6Nq78PGZOf5gPH/udFHIVQjSIBx98EE3T6N69O7GxsXg8HpYvX47f7+eiiy6iV69e3H///URERKCqKmFhYSxZsoTx48eTlpbGo48+yvPPP8+4ceMAmDJlCl26dKF///7ExsayfPnyGs0nOTmZL774gtWrV5Oens7UqVO5/fbbefTRRwHOOr7D4WD79u1ceeWVpKWlceedd3LPPffwy1/+Mqh/Z1KbTASNYRi4d+/Gs2dPYEG1qX7W55etXk32s89iTk0l6dlna70jzJudjSUhHlv37kGe4U98Xi/v/u5eCrIOk3HxBEbeGtx/wEIIIepOMkMiaBRFwdquHeakZHw52XU+IPFM7AMGEPvAA3U+d0h1OvEVFqJ7PEGc3alMZjOjbgucJZL51TyO7dlVb2MJIYSoHQmGRFApZjPWjh3QIqPw5ebUzxiKgnPIkMrMU22LuFYWbq2nXWUntOvdhy5DhmEYOt/861XZXSaEaNaefvppQkJCqnycuLXW3MhtMlEv/EVFlG/ZgqEbmIJ0VsXPefbvp+C99zAnJxM1eXKt+vAezcKSmoqtU6fgTu5nXAX5vPWbqXjKyxh9x92kjxlfr+MJIUR9yc/PJ/8Mu4ftdjvJyckNPKO6k0MXRb3QwsOxdupMxQ9b0UtLUY9v3wwmf0EB5Rs2ULF1K2GXXYYpKqrGfVQWbk1Nrbc1TgAhkVEMvfYmdq9bRUqP9HobRwgh6ltUVBRRtfh525TJbTJRb8zxcVg6dMBfXIzudge9f1t6OtYuXTA8HkqXLq1VH/VZuPXnMsZewlWP/JGopOb3W5MQQrRkkhkS9cqSkoJRUYFn/wGU+OCW7FAUhchbbkF3ubBnZNSuj5MKt9bX7bzKsY4v9tb9fjbM/5z4Dp1o061nvY4phBDi3CQzJOqVoqpY27fHFB+HPyc76CU7bGlpOPr2rVMF4xOFW+tr99vPrZo7i0Xv/otv/vUafp+vQcYUQghxZhIMiXqnWCxYO3ZCDQvDn5sb9P4Nw6Bs7VqOTJuGNzu7xterTie6y4Veh3pnNZExdgL2sHBKCwvIP3ywQcYUQghxZhIMiQahhTixduoEmoa/qCiofSuKQvEXX+D58UeK/vvfGl9f34Vbf84WEsJlv/0/bv3bG8S2a98gYwohhDgzCYZEgzFFRWHr1BHDXYFeXh7Uvk/ULHN99x3eozWvA1bfhVt/rk3XHjjCwgEoPCZ1y4QQojFJMCQalCkxEUtqKv7CAowaFvs7G1vXrtj79AFdr112qJ4Lt57J4vfe5M1f38nudasbdFwhhKiO1NRUXnjhhaD0tWjRIhRFobCwMCj9BZMEQ6JBKYqCpW1bLElJ+HJzgrpoOeLaawFwLV6MNyurZvNqoMKtVTEMnW/f+jt+X/CCQyFE6zVixAjuv//+oPS1Zs0a7rzzzqD01ZRJMCQanGIyYenYEVNUFL6cmi94PhNr587Y+/UDXad8/fqazUlRQDPhP8OpqvVlyFU30LZnOmOm3INmMjfo2EKI1skwDHzV3MkaGxuLw+Go5xk1PgmGRKNQbTasaWmoDge+IAYgkTffTOKzzxJ2ySU1n5PTia+goF4Lt/6c2Wbj6sf+RGp63wYbUwhRN3pZWZWPE3USDV0/5fUTDK+36mtPWkOpezw/vV6Ln0WTJ09m8eLFvPjiiyiKgqIovP322yiKwpdffkm/fv2wWq0sW7aM3bt3c/nllxMfH09ISAgDBgzgm2++OaW/n98mUxSFf/3rX0ycOBGHw0Hnzp357LPPajzPE/773//So0cPrFYrqampPP/886e8/9prr9G5c2dsNhvx8fFcddVVle998skn9OrVC7vdTnR0NKNHj6a0lruCaxwMLVmyhAkTJpCUlISiKMydO/ec1yxatIi+fftitVrp1KkTb7/9di2mKloaLTQ0UBNM1/G7XEHp05KcjLVDB6DmBVwbqnDrmexZv4b5r70Q9LOYhBDBtaNvvyofZWvXAeA9cOCn1wcOqryuYNasKq/be/XVlW2yn3uu8vXs556r8dxefPFFBg8ezJQpU8jKyiIrK4uUlBQAHn74Yf785z+zbds2evfujcvlYvz48SxcuJANGzZw8cUXM2HCBA4cOHDWMaZPn84111zDpk2bGD9+PDfeeOMZa5Wdzbp167jmmmu47rrr2Lx5M0888QSPPfZYZYywdu1afvWrX/Hkk0+yY8cO5s+fz7BhwwDIysri+uuv57bbbmPbtm0sWrSISZMm1frnZ42DodLSUtLT03n11Ver1X7v3r1ccsklXHjhhWRmZnL//fdzxx138NVXX9V4sqLlMcXGYunYAcNVEtSSHSULFnDo3nvxnOMf9ckUVcUAfI2wuK+0sIDPZzzD1sXfsH354gYfXwjRMoSHh2OxWHA4HCQkJJCQkIB2/OT/J598kjFjxtCxY0eioqJIT0/nl7/8JT179qRz58788Y9/pGPHjufM9EyePJnrr7+eTp068fTTT+NyuVi9uuabQGbMmMGoUaN47LHHSEtLY/Lkydx777389a9/BeDAgQM4nU4uvfRS2rVrR0ZGBr/61a+AQDDk8/mYNGkSqamp9OrVi7vvvpuQkJAazwNqUY5j3LhxjBs3rtrt33jjDdq3b1+Z+urWrRvLli3jb3/7G2PHjq3yGrfbjfukL8biRvpNXTQMS3IyRnk5nn37UOLig1IwtXzTJvw5ORTOmkXcgw9W+7qGKtz6c86ISAZNupblM//Donf/RfuM/tictftHLYSoX13Wr6vydcVqBcDctm2VbSKvuYaIiROruPCnE/TjHnyQuBOLn4P8M6h///6nPHe5XDzxxBPMmzevMrgoLy8/Z2aod+/elX92Op2EhYWRXYsDb7dt28bll19+ymtDhw7lhRdewO/3M2bMGNq1a0eHDh24+OKLufjiiytvz6WnpzNq1Ch69erF2LFjueiii7jqqquIrGVZpXpfM7RixQpGjx59ymtjx45lxYoVZ7zmmWeeITw8vPJxIsUnWqbKkh2JiYEdZkG4TRRxzTWgKJStW4evoKDa1zVk4daf6z9hEpFJbSgrKmT5zPcafHwhRPWoDkeVjxO1FxVVPeX1ExSzuepr7faf+rZYfnrdYgnqvJ1O5ynPH3zwQebMmcPTTz/N0qVLyczMpFevXnjOsVbJbD51s4eiKOj1UM4oNDSU9evX8+GHH5KYmMjjjz9Oeno6hYWFaJrGggUL+PLLL+nevTsvv/wyXbp0Ye/evbUaq96DoaNHjxIfH3/Ka/Hx8RQXF1N+hoP3pk2bRlFRUeXj4EEpWdDSKWYzto4d0cLD8eXk1Lk/S0oK0VOn0uall2pUgPXkwq0NzWQ2M/r2uwDY+PUXHNuzq8HnIIRo/iwWC/5qrJlcvnw5kydPZuLEifTq1YuEhAT27dtX/xM8rlu3bixfvvy0OaWlpVXe2jOZTIwePZpnn32WTZs2sW/fPr799lsgEIQNHTqU6dOns2HDBiwWC3PmzKnVXJpk1Xqr1Yr1eLpRtB6qw4G1Uycqtm7FX1SEFh5ep/5CR42q1XUnCrdaUlIqK803lLY90+k6dDjbv1/Cwa2biO/QqUHHF0I0f6mpqaxatYp9+/YREhJyxqxN586dmT17NhMmTEBRFB577LF6yfCcyW9/+1sGDBjAH//4R6699lpWrFjBK6+8wmuvvQbA//73P/bs2cOwYcOIjIzkiy++QNd1unTpwqpVq1i4cCEXXXQRcXFxrFq1ipycHLp161arudT7T/qEhASOHTt2ymvHjh0jLCwM+0mpQSEATJGRWDt1CpTsCMJp0HppKYWzZpFTgxNUG7pw68+NuPkObnjqOfpPmNQo4wshmrcHH3wQTdPo3r07sbGxZ1wDNGPGDCIjIxkyZAgTJkxg7Nix9O3bcMd89O3bl1mzZvHRRx/Rs2dPHn/8cZ588kkmT54MQEREBLNnz2bkyJF069aNN954gw8//JAePXoQFhbGkiVLGD9+PGlpaTz66KM8//zzNVrTfDLFqMMCDUVRmDNnDldcccUZ2zz00EN88cUXbN68ufK1G264gfz8fObPn1+tcYqLiwkPD6eoqIiwsLDaTlc0E4Zh4Nm3D/euXWjRMXW6b+7NyuLwr38Nuk7C009jS0ur3nVHjmDv0R1zcnKtxw6GilIXhq5jD5X/3wshRH2pcWbI5XKRmZlJZmYmENg6n5mZWRl5Tps2jZtvvrmy/dSpU9mzZw+///3v2b59O6+99hqzZs3iN7/5TXA+gWhxKkt2tGmDPy+3xucFncycmEjIiBEAFM6cWf05NHDh1qrs3bCWt34zlUXv/LNR5yGEEC1djYOhtWvXkpGRQUZGBgAPPPAAGRkZPP7440Bg7//JKbn27dszb948FixYQHp6Os8//zz/+te/zritXggARdMCJTtiYvDnZNdph1n4lVeCplGxcSMV27ZV65rGKtx6MltoKGXFRfyw9DsObd/aaPMQQojqmDp1KiEhIVU+pk6d2tjTO6s63SZrKHKbrPXyu1xUbNmC7vZgio6udT+5f/87rgULsPXsScITT5yzvWEY+I5mYe/dG/PPdkM2pEXv/gt7aBj9J0yU2mVCiCYtOzv7jOcChoWFERcX18Azqj4JhkST58vLo3zrVhSzBS00tHZ95ORw6L77UK1WkmbMqFZg5c3OxpKYgK2WuxOEEEI0D1KoVTR5puhobB07YpS60CsqatdHbCxxv/sdbV57rdoZpsYo3HomRdlH+XzGMxTn1PyUVyGEEGcnwZBoFkxJSZhTU/Hn52F4vbXqw9GvH+rxE1irsyhbtdsxShuvcOvJvvnXa+xctZxv3/5HY09FCCFaHAmGRLOgKArWdu0wJyUHSnbU8mAwf2EhuW+8wdHp08+5KFtRVQylcQq3/tzwm25H1TQ85WV4a5kdE0IIUbUmeQK1EFVRzGasHTugV1Tgy83BHFfzhc2GYVC6ZAmGx0N5ZiaO47siz6SxCrf+XExKO258+m/EtmuPclJRRyGEEHUnmSHRrKh2O7bOnVCt1hoVYD3BFBlJ6PFjHVzffHPu8RqxcOvPxaV2CBRE9Ps5vKN6RwQIIYQ4NwmGRLOjhYdj7dQZfF78tSiZEX7FFUT/8pfE3n//Ods2ZuHWqrjLSnn//x5g1vRp5B2SAsZCiOBLTU3lhRqUMGoJJBgSzZI5Pg5Lhw7oxcXobneNrtXCwwkdMwbFXL1ze04Ubq3tOqVgsjqchERHo/t9LPz3a3U6jFIIIUSABEOi2bKkpGBpm4I/L69WJTvce/Zw7M9/pnTVqrO2a+zCrT83cvKdmCxWDv6wme3LFjX2dIQQotmTYEg0W4qqYm3fHlN8XK1KdpStWkX52rUUzpx51qyParFgeD1NYos9QHhcAudNuhaARf/5NxWlrkaekRCti9ftr9bD7w/8XPH79MBzb+C57ter3UdN/eMf/yApKQn9Zz/TLr/8cm677TZ2797N5ZdfTnx8PCEhIQwYMIBvqrF+8kxmzJhBr169cDqdpKSkcPfdd+Nynfozafny5YwYMQKHw0FkZCRjx46l4PiaT13XefbZZ+nUqRNWq5W2bdvypz/9qdbzqS3ZTSaaNcViwdapE+VuN/7cXEyxsdW+NmzCBIq//BLvgQOUrVyJc8iQs4wTKNza2FXsT+g/YSI/LPmW/COHWPHxB1w4+c7GnpIQrcY/fr24Wu2GXZdGrxFtWPflPtbM20fP4ckMv74LezJz+eqfW6rVxz1vjKzR3K6++mruu+8+vvvuO0aNGgVAfn4+8+fP54svvsDlcjF+/Hj+9Kc/YbVaeffdd5kwYQI7duygbdu2NRoLQFVVXnrpJdq3b8+ePXu4++67+f3vf89rr70GQGZmJqNGjeK2227jxRdfxGQy8d133+E/ns2fNm0a//znP/nb3/7G+eefT1ZWFtu3b6/xPOpKgiHR7KlOJ9bOnSnfsgV/URFaeHi1rtNCQgi/9FIKZ82icNYsHIMGoWha1WOcVLhVdTiCOf1a0UxmRt1+N5lf/Y9+l05s7OkIIZqIyMhIxo0bxwcffFAZDH3yySfExMRw4YUXoqoq6enple3/+Mc/MmfOHD777DPuvffeGo93/0kbUVJTU3nqqaeYOnVqZTD07LPP0r9//8rnAD169ACgpKSEF198kVdeeYVbbrkFgI4dO3L++efXeB51JcGQaBFMkZHYOnWiYts29HILqt1erevCLrmE4nnz8B46ROn33xNywQVVtlNsNozCAvwlJU0iGAJo27M3bXv2buxpCNHq3Pni8Gq1U02BM8H6jUsl46J2qGrgeYc+MdXuozZuvPFGpkyZwmuvvYbVauX999/nuuuuQ1VVXC4XTzzxBPPmzSMrKwufz0d5eTkHDhyo1VjffPMNzzzzDNu3b6e4uBifz0dFRQVlZWU4HA4yMzO5+uqrq7x227ZtuN3uyqCtMcmaIdFimBISsKSm4i8sqHbJDtXpJOyyywAoX7v2jO0URQHNhL8WZxvVN5/Hw/cff8CmhfMbeypCtApmq1ath6YFvmI1kxp4bg48VzW12n3UxoQJEzAMg3nz5nHw4EGWLl3KjTfeCMCDDz7InDlzePrpp1m6dCmZmZn06tULTy1qMO7bt49LL72U3r1789///pd169bx6quvAlT2Zz/LL6Zne6+hSWZItBiKomBp2xajvBzPkSOY4uLPeNvrZGHjx2Np1w57v35nbac6nfjy89E9HlSLJVjTrrNtyxex4pMPsDqcdOw3CGdEZGNPSQjRiGw2G5MmTeL9999n165ddOnShb59+wKBxcyTJ09m4sTA7XWXy8W+fftqNc66devQdZ3nn38eVQ0EerNmzTqlTe/evVm4cCHTp08/7frOnTtjt9tZuHAhd9xxR63mECySGRItimIyYenUCVN0NL7cnGpdo9rtOPr3R1EUDMM44zb9plS49WQ9ho8ivkMnTFYrRdlHG3s6Qogm4MYbb2TevHm8+eablVkhCAQgs2fPJjMzk40bN3LDDTectvOsujp16oTX6+Xll19mz549/Oc//+GNN944pc20adNYs2YNd999N5s2bWL79u28/vrr5ObmYrPZeOihh/j973/Pu+++y+7du1m5ciX//ve/6/TZa0OCIdHiqFYr1s6dUR0OfPn51b6ufNMmsh56CNeiRVW+35QKt55MVTUuvf9hbp3xBklp3Rp7OkKIJmDkyJFERUWxY8cObrjhhsrXZ8yYQWRkJEOGDGHChAmMHTu2MmtUU+np6cyYMYO//OUv9OzZk/fff59nnnnmlDZpaWl8/fXXbNy4kYEDBzJ48GA+/fRTTMdrPT722GP89re/5fHHH6dbt25ce+21ZGdn1/6D15JiNIMjbIuLiwkPD6eoqIiwsLDGno5oJnw5OZRv/QHFZkMLCTln+6LPP6fgnXfQYmNp89JLVZ5Q7S8uRlFVHP37NWrh1rPJ+nEHce07oJmqd8K2EEK0dpIZEi2WKTYWS8cOGK6SapXsCL3oIrSICPw5OZRv3lxlm6ZUuLUqS95/iw8e/S1r/ze3sacihBDNhgRDokWzJCdjbtcOf14uhs931raq1Ur01Kkk/vnPOM6QNm5qhVt/LialHQCrZs+kwiUnUwshau/9998nJCSkyseJs4JaCrlNJlo8w+ulfPt2fEePYkpIDGyTrwNfQUFg0XXfDBS1af0+YRgGC//9Gt2HjZT1Q0KIOikpKeHYsWNVvmc2m2nXrl0Dz6j+SDAkWgW9rIzyrVvxl7gwx8Wdta3h9+NatAjXt98S//jjqFbrqX253eglJTj69UULDa3PadeZYRh1Dv6EEKKla1q/1gpRT1SHA1vnzqgWC/5z7QbTdQo//hj3jh2ULFhwel9Wa5Mq3FoVwzDYtnwxHz72IN6KisaejhBCNGkSDIlWQ4uIwNq5E4bHg15WdsZ2itlMxJVXAlA0Zw56FcHEicKtTZXP62HZh++Q9eMOVs7+qLGnI4QQTZoEQ6JVMcXFYenQHn9RIfpZjp8PufBCTHFx6EVFlHz11Wnvn1y4tSkyW6xcOPmXAKz93xzyDtWu7pAQQrQGEgyJVkVRFCwpKVjatAnsMDvDadOKyUT4VVcBUPTpp+jl5ae+b7NhuN1Ndos9QKf+g+jYfxC63883/36NZrA8UAghGoUEQ6LVUTQNS8eOmGJj8edknzFICBk+HFNCAnpZGRXbt5/ah6KAqjXJwq0nu/CWOzFZrBz6YQvbln7X2NMRQogmSYIh0SqpFgvWTp1QQ0Lxn6Fkh6JpxNx7L8kvvYQjI+P0Pk4q3NpUhcfFc96V16FqGiX5TXeNkxCi6UhNTeWFF16oVltFUZg7d269zqchNM16AkI0AC0kBGvnTse33JdUuU3e1rVr5Z8Nvx9F0yqfq3Y7/uxj6MXFqDExDTLn2uh/6RV06j+I6DZtG3sqQgjRJElmSLRqpuhobB07YpS6qtw1BoFDGws//pjD992Hv7S08nVFVTGgyZ5GfYJmMlcGQqWFBeQfOdTIMxJCiKZFgiHR6pmSkjCnpuIvyMfwek9voGmUfv89vuxsiv/3v1PeUh1OfNk55yz10RTs35TJW7+ZyhcvP4euV71wXAhxbt6KiiofJ/5dGbpe+Zrf5z3tOt9Jt9a9HneVfZ18XU384x//ICkpCV3XT3n98ssv57bbbmP37t1cfvnlxMfHExISwoABA/jmm29qNVZVNm/ezMiRI7Hb7URHR3PnnXfiOqk00KJFixg4cCBOp5OIiAiGDh3K/v37Adi4cSMXXnghoaGhhIWF0a9fP9auXRu0uZ2N3CYTrZ6iKFhTUzEq3HizjmCKTzilzIaiqkRcey05zz2H67vviLjyysqK9arDgT8/D39JCabIyMb6CNUS0zZwdP6xPbvYsXwJ3S64sJFnJETz9NItV1X5+jWPP01Kj94UHsvizfsDR1sMu/FWBlwWOLfs73fdgruslLRBQ5nwwDQA5j77Rw5szjytr0ETr+H8626u8dyuvvpq7rvvPr777jtGjRoFQH5+PvPnz+eLL77A5XIxfvx4/vSnP2G1Wnn33XeZMGECO3bsoG3but1KLy0tZezYsQwePJg1a9aQnZ3NHXfcwb333svbb7+Nz+fjiiuuYMqUKXz44Yd4PB5Wr15deUr+jTfeSEZGBq+//jqappGZmYnZbK7TnKpLgiEhCGylt3bsgF5RgS8nB3N8/CnvOwYOJOrWW3EOH14ZCJ24ztD1ZhEMOSMiGXHzHXg9broMHdbY0xFC1IPIyEjGjRvHBx98UBkMffLJJ8TExHDhhReiqirp6emV7f/4xz8yZ84cPvvsM+699946jf3BBx9QUVHBu+++i9PpBOCVV15hwoQJ/OUvf8FsNlNUVMSll15Kx44dAejW7acaigcOHOB3v/sdXY+v1ezcuXOd5lMTEgwJcZxqt2M7vqDaV1BwSnCjqCphl1xS5XWK1YYvOwdLmzZNrnDrz/W8cEzln6VumRC186t3Pqnydc0SyGJExCdWtlFNP226+OXr7wCc8nPiit8/Bvrpx3ucfF1N3XjjjUyZMoXXXnsNq9XK+++/z3XXXYeqqrhcLp544gnmzZtHVlYWPp+P8vJyDhyo+8Gs27ZtIz09vTIQAhg6dCi6rrNjxw6GDRvG5MmTGTt2LGPGjGH06NFcc801JCYmAvDAAw9wxx138J///IfRo0dz9dVXVwZN9a1p/+QWooFp4eFYO3UCv++UxdIn+PLyyPvnPyn48MPK11SHA93lQi8pwdD1ZnG4Yd6hA3z85P9xYMumxp6KEM2O2War8qGqgQBGUdXK1zST+bTrTBbLT69ZrFX2dfJ1NTVhwgQMw2DevHkcPHiQpUuXcuONNwLw4IMPMmfOHJ5++mmWLl1KZmYmvXr1wtNAR4S89dZbrFixgiFDhjBz5kzS0tJYuXIlAE888QRbt27lkksu4dtvv6V79+7MmTOnQeYlmSEhfsYcF4deUYF7x04Uk+mUqvWeffso+eorFIuFsHHj0CIiUK1W/Hl5lP/wQyDToiigaaCoKJoa2I6vnvRfkynwX1UN/FdRQFUD1ykqinrycyXQ7nibU9r+7HlNslKZX3/BwR82U1pYwM1/fblOP3iFEE2LzWZj0qRJvP/+++zatYsuXbrQt29fAJYvX87kyZOZOHEiAC6Xi3379gVl3G7duvH2229TWlpamR1avnw5qqrSpUuXynYZGRlkZGQwbdo0Bg8ezAcffMB5550HQFpaGmlpafzmN7/h+uuv56233qqca32SYEiIKljatMEoL8ezbz9KQkLl+UL2vn2xdO6M58cfKZo7l6jJkwEwxcaiezwYug6GAT4PGAa6YQSeGwacyBqd9FAUBQMDjEB8g6Icb3P8OQqoSmWghMJPAdNJ7ykn3tNMgfc07fQgTDOhaIEAbOAFo9ixfDERUTGUHjiAPST0p8DqRJBVGWipgblU9d6J50KIJuXGG2/k0ksvZevWrfziF7+ofL1z587Mnj2bCRMmoCgKjz322Gk7z+oy5h/+8AduueUWnnjiCXJycrjvvvu46aabiI+PZ+/evfzjH//gsssuIykpiR07dvDjjz9y8803U15ezu9+9zuuuuoq2rdvz6FDh1izZg1XHi+aXd8kGBKiCoqqYm3fHr2iAn9ONlp8AoqioCgKkddey7GnnqLk668Ju+wyTFFRKGYzWj3sejCOB1FAlcHUidcC7QzwuU96rle2M05qH/iAMOny63A4nCh79lIOJwVgnBZ8/RR0nRQIQSAIUwOlSX7KgmnHgy4Njr92IiADBUVV0CIjUe32oP99CSECRo4cSVRUFDt27OCGG26ofH3GjBncdtttDBkyhJiYGB566CGKg3RWmsPh4KuvvuLXv/41AwYMwOFwcOWVVzJjxozK97dv384777xDXl4eiYmJ3HPPPfzyl7/E5/ORl5fHzTffzLFjx4iJiWHSpElMnz49KHM7F8VoBgsciouLCQ8Pp6ioiLCwsMaejmhF9NJSyrduRS8twxQbCwQClKOPPYZ7+3ZCx40j+vbbG3mWdeP3+dizfQude/apfM04KZA6LZj6+Wsnnv/smsrXAHQdRQFDUcDvxxQXh61bt1NuQQohRGORzJAQZ6E6nVg7d6Z8yxb8RUVo4eEoikLEtddybPp0yjMzMXy+U7bbNyd+v5+P//Uy+TlHMZnNtO/SA+C09UfBvBFm+P34so/hNpmxpXVGOWkxqRBCNAbZTSbEOZgiI7F16oThrkAvLwfA3qsXsQ8+SPKMGc02EALQNI3UtMA5H0u/+gxvA+woUTQNU2wc3iOHce/e3SxO725ofq9OzsES/P7grOUQojbef/99QkJCqnz06NGjsacXVHKbTIhqMAwDz959uHfvwhQTi/Kz9UE/L+LanHi9Hj56fQYlRQVkDBnB4FHjGmRc3ePBn5uLpX0q1o4dm/wZTfXBMAzKijzkHnaRd8hF7iEXeYddFB4tQ9cNrntsINHJIY09TdFKlZSUcOzYsSrfM5vNtGvXroFnVH+a76+0QjQgRVGwtE3BKC/DcyQLU1wciqbhOXyYgvfeQwsLI+auuxp7mrViNlu44OLL+GLmO2xcuYQuvTKIikuo93FViwWiowM79kwmLKmpLX5nWv6RUo7tKya+fRhRiU6WzvyRzYuqLpxrdZgoLXJLMCQaTWhoKKGhoY09jQZRq1/FXn31VVJTU7HZbAwaNIjVq1eftf0LL7xAly5dsNvtpKSk8Jvf/IaKM1QIF6KpUkwmLJ06YYqOwpebA4BeUkL5mjW4vv2W8k3N9wDD1LTupKZ1R9d1Vn73VYONq1qtaOHhePbswXP4cIONW58Mw8BV4Gb/ljzWf7Wfr/+9ldxDJQCs/t9evn13G/s25wIQHmdHUSAywUGn/nEMurwDl9zdm5ufHsLtz19A2+7RjflRhGg1apwZmjlzJg888ABvvPEGgwYN4oUXXmDs2LHs2LGDuLi409p/8MEHPPzww7z55psMGTKEnTt3MnnyZBRFqdxuJ0RzoVqtWDt3Rt+yBV9eHrauXbFnZFC+YUPl2hfD70cvKUGLiGjcydbQBWMvw+50ct6FFzfouKrDgeH34/nxR1STCXNC/WelgsXn9ZN/pJS8wz/d4so7VEpF6akVx5PTIohpE0pix3AqXB6c4YFddN2GJNLj/CRMluZ5i1WIlqLGa4YGDRrEgAEDeOWVVwDQdZ2UlBTuu+8+Hn744dPa33vvvWzbto2FCxdWvvbb3/6WVatWsWzZsmqNKWuGRFPjy82lfMtWFKsVFIXiefOIuOoqFE2jbM0asp9/HsfAgYRedBG2Hj2a5e2fhq5d5i8qwvD7sXfvhikmpsHGrS6f18+h7QUU5ZSTPjIFv1/nn/cvwe89fZGzoipExDuISXYS3SaE1F4xcrtLiCasRpkhj8fDunXrmDZtWuVrqqoyevRoVqxYUeU1Q4YM4b333mP16tUMHDiQPXv28MUXX3DTTTedcRy3243b7a58HqwDoYQIFlNMDJaOHfDs2IEaGUXktddWvlfxww/g81H2/feUff895uRkQi+6COfw4WghTf8L0eN2s2bJAnS/nwsuvrzBxtXCw/Hl5VGxcyc2TTulUG5D8nn85GeVBjI9h1x43H5G3dwNv1dn3quBW6FdBiVgc5oJj7VTVuQhuk0IMckhgf+2CSEy0YHJLNkeIZqLGgVDubm5+P1+4uPjT3k9Pj6e7du3V3nNDTfcQG5uLueffz6GYeDz+Zg6dSr/93//d8ZxnnnmmQY7dVKI2rIkJ2NUVODZsxclPr5yi33ULbfgHDaMkq+/pnTpUryHD5P/1lt49u0j5p57GnnW55Z79DAbVy4FFNJ69SU+OaXBxjZFR+PLycG9cydK9+5o9bh488TanpN3ceUddlF4rIyT8+WqqjDi+i5YHWZSukdhc5rxefzgNDPpd/2w2LRmmfkTQvyk3neTLVq0iKeffprXXnuNQYMGsWvXLn7961/zxz/+kccee6zKa6ZNm8YDDzxQ+by4uJiUlIb7gSxEdSiqijU1Fb2iAt/Ro5jiEyq3h1vbt8f6y18SddNNuJYupeSrrwgZPRoA3e0m+5lncJ5/Ps7zz0e12RrzY5wmqV0H0nr15eihffj9DX8GkBYTgy/7GBU7dmLv3g3V4QhKv4XZZRzZWUhIpJW2PaLZtjyL796r+pc4W4iZmDYhlRmfE6sJLvtVn1PaWe2yIVeIlqBG/5JjYmLQNO20cweOHTtGwhkWPT722GPcdNNN3HHHHQD06tWL0tJS7rzzTh555BHUKs4WsVqtWOWYftEMKGYzto4dKXe78WcfQ4uOOeUMItXhIGzsWEIvuqjytdLvv6diyxYqtmyhcNYs2rz+epM7o+iCiy9D00yY6qHe2rkoioIpNi4QEO38EVu3rtUu22EYBiX5FeQdz/TkHiqlfXoMXQYlsCczhxWzd9Oxbxxte0QTleREVRUiEx1EJ4eccqvLEWaRbI8QrUiNgiGLxUK/fv1YuHAhV1xxBRBYQL1w4ULuvffeKq8pKys7LeDRjv/gbwbnPQpxTqrDga1rNzz79uHNykJ1OFDDwk75Mj35z45+/dBvuomSBQuw9epVGQgVz5uHGh6Oc9Cg0w51bGhW209FVA/s3kF0XCLO0IbbvKCoamVA5DaZqizb4XX7K29t5R1yVR5c6Knwn9LOYtPoMiiBhPZhpHSLJD418Dni2oVy54vD0cyt77BHIcSpapzjfeCBB7jlllvo378/AwcO5IUXXqC0tJRbb70VgJtvvpnk5GSeeeYZACZMmMCMGTPIyMiovE322GOPMWHChMqgSIjmTgtxYuvWFVN0FO59+/AdzUKLjgkcLPjztmFhhF9+OWETJmAc3yigl5VR8OGHGBUV5IeFETJyJKFjxmD+2fq8hrZ60desXbqQzj37MGbi9Q069sllOxRNJasiitwjZfQcnow9xMLcGevJ3l9y2nWqphCZ4CS6jZOY5FASO4UDkNQ5kst+HXlSOxXkR5AQgloEQ9deey05OTk8/vjjHD16lD59+jB//vzKRdUHDhw4JRP06KOPoigKjz76KIcPHyY2NpYJEybwpz/9KXifQogmQNE0zImJaGFheA4cwHv4MLrVhhYRUeUtF0VVUezHMzCGQfjll1OyYAH+/HyK586leO5cbH36EHPXXZiiG+fwvdQu3Vm37Ft2bd3EwOEXER5Vv/PwenQK8n3k5/rIz/NRkOtj9MUxeA4dYvm3ORQV+EhoH05K9yiik0NwFbhPub0VnRxCZIIDzSTZHiFE9UltMiHqgaHr+HJy8Ozdh7+kGC0qulrrXgy/n/J16yj++msqMjNRw8NJeeMNFLMZ79GjKBYLpqioBvgEP9m0ejlJbdsTk5AUtD4Nw6Ck2E9B3vHA53jwU1LkP63tpVdFEhOhs2ZJIR5LKOmXdiE+NRy/T5egRwgRFBIMCVGP9PJyPAcO4j1yGFQNLTKy2gVJvUeP4s3KwpGRAUD2889TtmoVjgEDCJ80CWvHjvU59Sr5/T40rXY7qPz+QAAUEWkiL8fLpzPzq2xnd6hExZgCj2gTyW2t2OwqelkZuqsEa1oXLG2S6/IxhBDiFLIvVIh6pNrtWNM6Y4qKPL6W6ChaZCSq3X7Oa80JCZWlKU6U+EDXKVu1ipARI6Bjx8DrZWX1eh4PgGHo/LB+NWuXLmTiLXcRFlmz7FR+rpcF8wpRFIUrb4wmIsqEyawQHqERFW0i8njgExljxm6vOlg8UbbDvetHFLOp0ddTCSFaDgmGhKhnga3isahhYXgOHsR76BC6y4UWFVXtLfWKppHwxBN49u/HtXQp9r59ASjfuJHsv/4V5+DBhI4dizUtrZ62hCvs+mETpSXFLP3qU8ZfO/mc4xiGwdEjXhKTLYSGm9D9oCgGxUV+IqNM/GJKLKpas7lqoaH4dZ2KHTsDC6ybYNkOIUTzI7fJhGhgvrw83Hv34c/PQwuPQHU6a91X3ltvUTJvXuVzc2oqoWPGEDJsWLWyTzVRkJvNzL+/gK77ufjqm+nQtUeV7QzD4PABD+tWusjL8XHJlZHEJ1rIy/ESHmnCZKp7sObLy0Mxm7B3797sCuIKIZoeCYaEaASGx4Pn0GE8Bw9g+P2YomNqdfCiYRh4du0KlP5YvhzD4wEg5MIL66X0x8pv57N++XeEhIVz/V2/xWw5dVH40SOBIOjYkUDVdrNZYfDwUDp1DW5gBuDLyUF12LH16NEsar4JIZouCYaEaES+ggI8+/fjy85BDQur05e63+WidPFiSr7+muipU7F164bu8ZDz17/iHDoUx+DB1T7J+Uy8Xg8fvTGDksICMgYPZ/Do8QDk5XhZt9LFof2BYEzToFsvB737ObGdYQ1QXRmGge/YUbSIyKCW7RBCtD4SDAnRyAyvF09WFp79+zE8nkCWyFT75Xwn/kkrioJr8WJyX34ZCNT8avPqq3Uu/bFv5za++u97DBg2ho7dz2f9Khd7d7mPjwlp3e30GeDEGVL/Jxoauo4v+ximmNgale0QQoiTSTAkRBPhLy7GvX8/vqNHUZ0haEH4/7q/sJCShQsp+eYb7L17E3PXXQAUz5+PFhGBo3//WgVeZa4SCvItfP15YWWF9w5pNvoOdBIW0bD7Mgy/H192NubExCrLdgghxLlIMCREE2L4/XizjuLZvw+jvPy0wq916deoqEB1OtHLyzl4552B/iMjCRk1itDRo6u1M6u8TGfvrgq693bg8xnMens3TmcJF4zpSVRM49VTM3w+fNnHsLRti7VTpzpl1oQQrY/8xBCiCVE0DUubZLSIcDz79p+x8Gtt+lWO71ozdJ2wceMoWbgQf0EBRZ98QtHs2dj79iX6zjvPeMK112sw+/1c3G6DiEgNTT1GSc7buIssOJxdgMYLhhSTCS0mFs/Bg2AyYe3QodqHWwohhPy0EKIJ0kJCsHXvhr1nD1AVfEez0I8Xda1z304nkTfcQMobbxD7wAPYevYEXce9c2fl4Y3e7Gz8RUX4vAab1pfiKvFjNit07GIjJi6wPT4mIYmwiEjKy0rZnrk2KHOrC9ViQYuMwrN3H54DB2gGSW8hRBMht8mEaOL00tJA4dcjR8BiPWPh17rwHD6M78gRHAMGAHDsby/y436N/R0vxa3YSetu5/yRYfh8BppG5fhZB/ZSXFhAWq+MejrsseakbIcQoqYkGBKiGQgUfs3Fs28v/uJitMgoVJst6OPousHu7WWs/fow5aZwAJwWL/2HR9OhsxW9vBztDIdE6roOgNoEbk/5S0ow3BXYunWTsh1CiHOSNUNCNAOKqmKOj0MLCw0Ufj18CL20tEaFX8/GMAwO7HWzbqWLwnw/mMKxWXXS2Eafmy/AZDVTtmEDOc89h/P88wkdMwZrp06V12cfOcTiL2bTpXc/eg8cWuf51JUWGorf76di504UkwlTdHRjT0kI0YRJMCREM1KXwq9ncvigm3UrXORm+wCwWBV693XSvbcDkzmxsl35+vUYbjeuhQtxLVyIpWNHQi+6COf555OddYicrMMU5efSsVsvnKGNn8HVIiLw5eVRsWOHlO0QQpyV3CYTopnS3e7Kwq8Y1Kjw6wkV5Toz38nB7wOTWaFHuoOeGQ6s1tOzTYZh4N6+nZKvvqJ05UrwBYIn54gRRN99N7Pfeo2I6BiGjrkUu7PplMfwZmejOR1StkMIcUYSDAnRzPny8/Hs3Ysvr3qFX/NzvaxfXcrAoSGEhZtYv8qFx2OQ3s+B3VG9YMpfVITru+8oWbCAmLvvxtajB96yMvJffhnn0KE4Bw0KyvlIwSBlO4QQ5yLBkBAtQGXh10MHMXy+sxZ+/frzAg7t99Cxi43hY8LrNq6ug6IESn8sW0buCy/gUxUOtkvmgj/+GVM9LPKuDUPX8R07iik2Tsp2CCFO0/jbPoQQdaZYLFg7tMfeqxemqGh8x47hLykBoNTlZ/l3xWzJLAWg76AQUjtaSe9/9gxStcZV1cot9bZu3Qi76ipWp7VlW5iVzDXLAShZsICytWsx/P46j1eXeZri4vHlZOP+cReG19tocxFCND2SGRKihTlR+LV4xz62bPayY7eC3w9Wq8K1k2Mxmev3PKCdm9bzzacz0Uwmrr31Hop+/zBGWRlaTAyho0cTMmoUpsjIep3DmRheL76cbCzt2gXKdtSxaK0QomWQYEiIFsZT4SPzm4NkLtiP1x04+ycuTqX/+eEkJNV/EVPDMPjsvX9yeN9u2qZ2YrBuoXTRIvTjmSpMJiKuvprwK65olGBE93jw5+Viad9eynYIIQAJhoRoMXweP1uWHGbd/P1UuAK3gWJSQuh/fjhxWg5UVASt8Ou5FORmM/PvL6Drfi6++iZSO6RRtnIlJfPn4965E9XpJOlvfztjHbT6pldU4C8owJrWGUvbtk3m9GwhROOQc4aEaOYMw+CHZUdYM28fpYWB+mUR8Q4GXdaBjhmxKKqC35WMZ99+fEezUGx21PDweg0AImPiyBgynHXLvmX98kW079KDkGHDcF5wAaVLlwYOQjweCFXs3Im1Y8cGzRKpNhuEheHZvRvVZMKcLGU7hGjNJBgSopkydAPdb6CZVfZvyaO00E1IpJUBl7an63kJqNpPt39OFH71RUcdP6wxCy0qul53VfU9/0IURSH9vAsqAy9FUQgZNqyyjXvPHo4+9hjWtDRi7rkHc0JCvc3n51SnE0PXqfjxRzCZpGyHEK2Y3CYTohk6tD2fZR//SMe+cQy4pD15R1wc2lZAz2HJaOazr4HRy8rw7N9fr4Vfq+L3+9C0U3//Kl25ktxXXsGoqMCckkLS8883+Boef2EhhqFj795dynYI0UrJykEhmhF3WWAtULnLS97hUn5YdgTdrxOdFEL6qJRzBkIAqsOBtWtXbD17oVrM+I4eRa+oqLc5V5SX8d3/PuHz9/7Fz3/3cp53HkkzZmDr2ZOo22+vDIT8Lle9zefntIgI0A0qdu7EX1jYYOMKIZoOyQwJ0Qwc21fMqk93U1rk4dpHB6IAmQsP0m1IIjZn7RdE6xUVePYfwHv4MGha0Aq/nqykqIAPX38en9fLyMuupmt6/9PaGIZRmZ0qW7+enBdeIOrWWwkZMaLBFjd7c7LRnE5s3btL2Q4hWhlZMyREE5Z/pJRVn+9hz4YcAFRNIedACfGpYWSMaVvn/lWbLVD4NToK9779QSn8+nOh4ZEMGDaGHZvWEx4VU2WbkwMe18KFGGVl5L36KmUrVxI9dWqDnEtkionFd+woFdt3SNkOIVoZyQwJ0QQV55az+n972bnqKIYBKNBlUAIDL21PWEzwApWT6R5PoPDrwYO1Lvx6Jv7jp09r1ejP8Psp/vxzCj76CHw+1JAQoqdMwTl0aFDmctaxT5TtiIvD1lXKdgjRWkgwJEQTUlrkZt0X+9i67Ai6P/BPs0NGLAMntCc6qWFu3fjy8/Hs24cvN7dahV9rwjAMdm3dSM7RI/QdMhyb48x9ew4cIPfll/Hs3QuKQtKMGVhSUoI2lzPO0e/Hl30Mc2ISti5pTabgrBCi/kgwJEQTsXnRIb7/7y583sCp0SndIhl0eUfiUxv+//OGx4Pn8GE8B89d+LUmtqxbyZIv5gDQtmMal95w+9nn4fNR+N//Yng8RN10EwD+oiK08LoVmD0XKdshROsia4aEaESeCh8l+RVEJ4XgjLDi8+rEtw/jvCs60qZL49TvguOFX9u3xxQZGVhLlH0MNSQULTS0Tv326DuIkNBwVi/6mowhIwAwDJ2t61aR1qsvlp/dllJMJiKvvbbyub+khMO//S323r2Juv12tCBmrU4Z12xGi4nFs/8AaJqU7RCihZPMkBCN5NjeYua9thGrw8z1jw9EURUO7ywkOa1hzv2pLsPnw5OVhXf/fvSKikCWqI63jk7ePfbj1o0smP0BNoeTvkNG0LP/YExn6N+1bBm5L70Euo4pIYHkv/2tXm9j6RUV6IUFWDpL2Q4hWjL5VUeIBqT7dQ7+kA9AZKIDwwBdNyjJr0BRFNp0iWxyX7iKyYQ1JQV7796Y4uPx5ebiLyqqW58nfUazxUJ4VDQVZaV8/8083nvlL2xe8z1+n++060LOP5+EP/4RU2IioWPHVgZC9fU7nWqzoYYGynb4jhyplzGEEI1PMkNCNABDN9i9IYdVn+2h8FgZVz7Uj4T24eQddhGR4EDTmsfvJYbfj+/oUdz79mGUlwet8Kuu+9mxaT1rlyykpKgAgB79zmP4+IlVt3e7UcxmFFXFm5VF9l//SvTtt2Pr0aPOc6mKv6QEw+3G1q0b5vi4ehlDCNF4ZM2QEPXIMAwObM1n5ae7yT0YOFXZ5jRTWuCG9hCd3LwO91M0DXNyMmp4BN79+/BmBafwq6pqdOszgLReGWzbsIb13y+i14AhAPi8Xvbu2ErH7r1Rj6/bOXnLe+HMmXgPHODoH/5A6CWXEHnDDUHfEq+FhuL3+6nYuQPFpEnZDiFaGMkMCVFPjuwqZOXc3WTtCtxSMts0+oxuS59RKVjszf/3EEPX8WVn4967F93lCmrhV13XKwOfjSuXsnzB/4iMieOiK28kOu7UYq56WRn5776L65tvADAlJRFz773Y0tKCMpeT+fLyUCxm7N271/uONiFEw2n+P5GFaGJyDpSw8tM9HNiaB4BmUuk1Ipm+F7fDHmJp5NkFj6KqmBMS0MLCAoVfs7LQTeZASY86rntST9q5pZnNWG12ykpdhIZHAOD1ejCZzCiKgupwEDN1Ko6BA8l74w18R45w9NFHSXjySWxdu9ZpHj9nio7Gm32Mih07pGyHEC2IZIaECKI9mTl8+cZmABRVofvQRPqPTyUk0tbIM6tfhmHgy87Bs28v/uJitMgoVFvwPrPHXUFe9lESU1IB+O7zT8jLzmLgiItI6ZBWGXz5XS7y33wTf34+8Y8/jqKqGH5/UM8JMgwDf/YxtIgIbN27B7V0iRCicUhmSIg6MAyD/ZvzKMwuo8/otqR0j8IZYSWpcwQDJ7QnIq511LdSFAVzfBxaeNjxkh6H0EtLg1b41WK1VQZC7opydm/bjMddwcpv55PS4afbYVpICLG/+lVggfXxQOjo9OnYe/UifOJEFFPdf+QpioIWGxeoY7ZzJ7Zu3VAtLSfjJ0RrJJkhIc7BXeal4FgZhUfLKv9bnFfO1dMGoKoK/35wKRUuLxN/m0FS50g8FT4sttb7e4ZhGPjz8nDv248/Pz/ohV8BykpdbPh+ESntO9O2UxcMw2DZ15/TqXvvyqAJoHTlSnKeew4AS4cOJEyfHrS5SNkOIVqO1vsTW4gqFOeVs2dDzinBT3mxp8q2rvwKwmLspPaOwe/VMR8PgFpzIASBzIkpJgY1LAzvoUN4Dhw8vsA6eIVfHc4Qho65tPL5/h+3s3n1cjavXk7bTl0ZOGIMcYltcAwaRMz995P/r39hbtMmqEGZommYYmLxHj6MYjZJ2Q4hmjHJDIlWxVPuo+BYGRabRmSCk90bsln9+V4S2odx4U3dOLQ9n09fyDztOme4hYgEJ5HxDiISHETGO0jsFIHZKl9+5+IrKMCzdy++3FzU8Ih6KaFRUlTA2iUL2b5xHYYRqO3WvksPBo64iOi4BHz5+SgWC1pICHpFBXlvvEHEtddiTkys89i6240/Lw9rp45YUlOlbIcQzVDr/hVWtEi6buDKr/jZra1SCo6VUVYUyPL0GtGGYdcF1prkHynFZA58gUUmOunYN47IBAcR8Y7Af+McLWIrfGMxRUaiOZ14jhzBc+AAXpcLU1RUUG8rhYZHcuGEq+g7dARrlnzDzs2Z7N2xFV3XueS6yZiioirbFs6cSemyZZStXk3kL35B6MUX1ymAUa1WiIzEs2cPaJqU7RCiGapVZujVV1/lr3/9K0ePHiU9PZ2XX36ZgQMHnrF9YWEhjzzyCLNnzyY/P5927drxwgsvMH78+GqNJ5khcSbZ+4spOFpG+94xWOwm5v9jC/s25+I/Xvm9Ko4wC2kD4xl6VWfKSzxk7y8hMsFBWIzsCqpv/sJC3Pv348/LwzBACwurl91Y+TnHWLN4AX2HXkhsYjJ+v5+V335Jr/5DcPj85L76KhVbtgBg69mT6LvvxhxXt5Ol9dJS9LJSbGlpmJOTg/ExhBANpMbB0MyZM7n55pt54403GDRoEC+88AIff/wxO3bsIK6KHyYej4ehQ4cSFxfH//3f/5GcnMz+/fuJiIggPT29WmNKMNR6GbpBSUHFKYuXC7PLuOSe3pjMGu/+3/eU5Fcw8cG+JHWK4Kt/bmHXumxUk0JEXOB2VmWGJ95JRIIDq2R5GpXh9+MvKsJ39Cje3FwMtxs1JBTV6ay3W0xb169i8bzZqKrKRVfeSPu07pR89RUF772H4Xaj2GzEPfww9p496zSOlO0Qonmq8bfCjBkzmDJlCrfeeisAb7zxBvPmzePNN9/k4YcfPq39m2++SX5+Pt9//z3m42nx1NTUs47hdrtxu92Vz4uLi2s6TdEMlbs8HPwhn4KjZRQeK6PgaBlF2WX4qsjyFGX/f3t3Hh11ff97/DlLJvtKkknIwp6wSMAECBERESy1lkqXH4u0RLHtPT/RKtTWqreA2nPwXq891IML9dhyvS0iYgErFotYwlJQiE0NCCGsCZB9X0gmme/cP4KjKaIJJJkJ83qcM4fMl/l+5z3fA8k7n/fn83lfZEBCCPHDwwmt+Xw/m8zvDGXynKGEDgjEbFapwhuZLBasUVFYo6Lwa2ykvbKStpIS2stKMdn8sYSF9fjKrJj4BJKGjqD0XBEDk4d0bBg57RYiUkbQ/Md1tFdUYBsy5JrfxxIaSnt7O62FxzH5WTuV50TEe3VrZMjhcBAUFMSmTZuYM2eO+3h2dja1tbVs3br1snO+9a1vERUVRVBQEFu3biUmJoa7776bRx99FMsVVl6sXLmSJ5988rLjGhnq31yGi8baVlwuF2EDAjlfUMOhv50hPDaIW+9OpfR0HW/9r9zLzjNbTIR/NspzafLy4LHRBIRoKfP1wnA4cFZV0VZSgrO2ttdKaI31dYSEdbTR2LN9K0f/dZAbJmRx4+hxBCYkAlD9pz9hS04meOrUq577o7YdIv1Lt0aGKisrcTqd2O32TsftdjvHjh370nNOnTrFBx98wMKFC3n33Xc5ceIE999/P21tbaxYseJLz3nsscdYtmyZ+3l9fT1JSUndCVU8qK3VSW3ZZ6M7TR1/Xnre7jAYeVM8MxaNwuk0OHeshqZLk5o7VmiFXyptBbsnMYdFB2DuJ13d5eqYbTbM8fFYY2M7SmhlZbRVVOKsrcEcHII5JKRHSmifJUIul0FVeSnt7W2cPXGMyTPuAKDl6FHqt2wBoPnAAQYsWXJVq986t+0YgyWk51fQiUjP6fXJE4ZhEBsby+9//3ssFgsZGRmcP3+eZ5999orJkL+/P/493HVael5jTSs1ZU3EJofiH+TH3jcLOflxOY01rVc8x2w24XQ4AYhNDuO2RaOIiu/4QeEf5Mf3Hsnok9jFO3UqoSX1XgnNZDJz149+ytkTx7BYLO5eaP/IP0jozFuIy/knbeXl17SztDUmFmdZKa0Fx9S2Q8TLdSsZio6OxmKxUFZW1ul4WVkZcXFxX3pOfHw8fn5+nUpio0aNorS0FIfDgU3b2Hu1doeT2vLmTvN4pi1IwT/Ij7efz6OmpIlvPziOQWMG4LjY7k6EAkL83GWtCHtHaSsyLpjQ6AAsl0Z5AkL8GHXTte/zItcnS0gIlpAQ/AYOxFldTduFCzhrqnG5XFjCwq85uTCZTAweMcr9vKToNKcLjgBw/MZU0samE4sLq8tF/TvvEDJ9ercas5pMJiyxdrXtEOkHupUM2Ww2MjIy2Llzp3vOkGEY7Ny5kwceeOBLz5kyZQrr16/HMAz3b1/Hjx8nPj5eiZCXMpwG+bvO88k/iqmvaoH/mFWWdlsicUPCGTAwGJfhwmjvmOA8bkYSo6YMJNIepPk80mPMNhvmuLiOElptba+V0OyJg5g5Zz4Hd79PXXUlHx36J4eP5TMmJoHoLduof/ttBvz3fxOUnt7la5rMZqyxdtrLy3BYrfinqG2HiDe6qqX12dnZrF27lkmTJrF69Wo2btzIsWPHsNvtLFq0iISEBFatWgVAcXExY8aMITs7mwcffJDCwkIWL17Mz372M5544okuvaeW1vedstP17Fp/jMriRvcx/yBrx/ydSzswj5hoJzQqAJfLpc3lxCOcjY20V1XRduECRlMTJj9bj5XQDMNJwScfc2jPThpqa4iPjWfCkVM4L1wAIGTGDKKyszEHdb0Jr6utjfaKcmyDBqlth4gX6vacoXnz5lFRUcHy5cspLS1l/PjxbN++3T2puqioyD0CBJCUlMR7773H0qVLSUtLIyEhgYceeohHH3205z6FXDOXy8WejYXk7zoHro4EaPKcYQy7MYaAEL8vTXqUCImnuEto8fEdJbSSkh4roZnNFkaNn0jK2Bs5mneIaHs8sffEUb1+Pbs+zSX+4w9J+ve/iV26lIDU1C5d0+Tnh2VANI6iIkx+fmrbIeJl1JvMx7lcLpxtBlabhX2bCsl7v5jUyXHc9L3hBIWpjCn9g8swOpXQXK2tmIODe6yEBlB4OI8dm18HYER5LdN+8QS25ORuXcO4eBGjrhbbiBFq2yHiRZQM+bDasmZ2rS8gNMqfGdmjcbS0U1HUQEJKpKdDE7lqzsYm2qsqaS8pwdnQ0GOr0NocDg4f+ieffLSPb0++jQGTs2hpbuL0ju0MThlN4KhRX38RwNnUhKu5iYDUVPwGDrymmESkZygZ8mGlp+p469lcrFYzP3w6i+AIbWcg1w/D4fhCCa2mx1ahGYYTs7ljzs++v27i33kHCW9u4ZaUNBIW/qhLK8ac9fW4HA617RDxEipa+5iiI1X85f/k0trcRtzQcKbNT2H+8kwlQnLdMdts+MXFEThuHIE33ogtIQGj5WJHclRXh8u4cjPfr7yu+fPJz7agYKyYcFgsOHP2YDQ20tbm+NprWMLCwGKhtfA47dXVVxWHiPQcjQz5iKbaVva+WciJ3HIA0mcNIuu7wzwclUjf6o0SWnNTIxX/3Ed0aDjBkyezbcMfcdTUMvmb3yF+yFf/H2uvrMTkb1PbDhEPUzJ0nTMMF/m7zvHh26doa3FiMkHabUlMmj0EW4C6t4tvcjkctNfUXNrIsRaXy8ASGtat5fJfpqGuhj+v+d8Yl0adEhOSmXzHXcTGJ17xnLbyMiyhoQSMGq22HSIeomToOlZ2pp6c9QVUFDUAYB8SxrQFqcQkh3o4MhHv4DKML/RCq8DV0oI5KBhzaOhVr0Ir37uHD7e+ybnQAFyXVosNSRnNjDnzsPkHXB6Dy4WzrBRLVFTHLtVq2yHS55QMXYdam9v4cOsp8nef77Rn0JibB2IyaymvyJfpyRJae00NZ19+kcPl5zkfGUKkYeL7P34QW2IiTqezU3si6EjK2stKsdrtBIwcqbYdIn1MdZLrjKOlndef/NDdCT4l086U74/QnkEiX8MSEowlJBhbfHxHCa2kFGd1NS7D2bEKrRslNGtkJEN/9Tj2nBzO/L/XcDpaaDt7Fr+EBDave4nI6Fgm3DKD8MgBwBfadpSV4bBY1LZDpI8pGbpO1JY1ExDiR0CwH0PGx3DuWA3TFqSQODLK06GJ9Csmmw0/ux1rTExHCa28nLbycpx1td0qoZlMJkJuvZWRY8fStGcPwVOmUFJ8hvILxZRfKMZsNjN99g8+f73FgjU6Bsf582D1w3/4MLXtEOkjSoauA0f2nGfPG4WMvCmeW+9OJeu7w7BYzFj8tHOCyNUymc1YIyOxRkZiS0ykraqK9pIS2svKOtprhId3afTGOmAA4ZcaW9tj45la00KBH4zED5fLRZvDwaE9Oxk/eSpBIaGX2nacxeRnVdsOkT6iZKgfa2lqIyDYjwh7EM52g4aqFgynoVViIj3MHByMf3Awtri4ayqhGc3NRIeEE/rpp7Se+hNtY8fxSfFJ8vbncPjgP/n2wvsYmDwEIiJxnDwFViu2pCS17RDpZfqp2Q811bWy781CSk7WsWBFJgkpkfzg0QnEDg7VN02RXnR5Ca2C9opy2urqMAcFdfRC+4rSljUykriVK6l/912MhgZsgwcTbzKItcfT1NzkXoJ/sb0Nk80Gp05jDQvDEhHRR59QxDcpGepHDMPF4ZzzfLj1JI5LewadO1bD0PEx2IdolZ1IX/liCc1ITPi8hFZe/rUlNJPZTPi3v+1+HhcZzcQP8zGGD4PGRoiMZO/f/8q5U4XcNHkaaWlj++pjifgsJUP9RPnZenb9+fM9g2IHhXLrwpHaM0jEwzqX0Gov9UKrBsPAHBKKOfirN1JsPXYMV1MTptyPubBsGeGLF1NTUU5ry0WCg0P66FOI+DbtM+TlWi+2d+wZlHMOXGALtDL5rqGMuSUBs/YMEvE67o0cL5XQjOaLmIODv7KE5jhzhso1a3CcOQNAYFYWLbNmkjAglsCMdKxRWhUq0puUDHkpl8vFiUPl7H2zkOb6jj2DRky0M+UHwwkOV1NVkf7AaGpyl9Cc9Q2Y/Pwwh4V96aaKrrY2at96i7q//AUMg4i5cwmZOlXJkEgfUJnMS1Wdb+Lvrx4BIDw2kGkLUkkapW+IIv2Ju4QWH097dQ1tpSU4q6sxnE7MoWGdSmgmPz8i588naMIE6rZsIfy738VZWenB6EV8h0aGvIizzeDf/yjmhqkJ2AKt7H69gIBQG+mzkrH6afM1kf6uuyW09pISjQyJ9AGNDHmRv63N5+zhKpprHdw8dwS3LEj1dEgi0oM6rUJLSuy8Cs1qxRwerr5kIh6gZMjDmusdNNW2EpMcStptiVQUNxA3LNzTYYlILzMHBeEfFNSxCu1rSmgi0rtUJvMQw3Dx6Z7z7N9yioBgKwuWZ2K1WWh3OLHaVBIT8TUulwtnbS3tFRW0l1dgNDdjMkFgRobKZCK9TCNDHlBR1MCuPx+j/GzHnkHhMYE0NzgIGxCoREjER5lMpi9s5NhRQnNWVqpZq0gfUDLUhxwX2/nw7VPk7zqHywW2AAuT5wzTnkEi0slnJTRXYqJa7Ij0ASVDfcDlcnEi99KeQXWX9gyaEMuU/xqhPYNE5IqUCIn0DSVDvayuopndrx+n6NNqoKMkNm1BKkmjNQdARETEGygZ6mX1VS0UfVqN2WoiY9Yg0r85SHsGiYiIeBElQ73gXEEN/3rvLN/8H2NJGhnFTd8bzpBx0UTYgzwdmoiIiPwHs6cDuN442w0++L9HKfq0mn/tKALgxm8kKxESERHxUhoZ6gEuw8WRvReIjAsiISWSqfNTKDpSxbjbEj0dmoiIiHwNbbp4jSqKG8hZX0DZ6Xoi7EHM/5+TsPhpwE1ERKS/0MjQVXK0tPPR26f55B/FuFzgF2Bh7K0JmCxaCisiItKfKBnqJpfLxal/VbBnYyFNta0ADJ8Qy80/GEFwhPYMEhER6W+UDHVDXcVFdm84TtGRKgDCYgKZNj+F5DEDPByZiIiIXC0lQ110ZM959mwsxNlmYLaaSP/GIDK+OUi9xERERPo5JUNfw9HSji3ASnCEP842g4TUSKYtSCEyLtjToYmIiEgP0GqyK2hpamPvm4WUnqpj/q8nYfWzcL6ghoEpEeoXJCIich3RGvD/8FluaDabKD5aTV3FRc4drQEgITVSiZCIiMh1RmWyL6g810DO+uPc9P3hxA8LZ0b2KGyBVuKGhHs6NBEREeklKpNxac+gd07zyQfncBku4oaG8/1fZvT4+4iIiIj38emRIZfLxam8CvZuLKSxpmPPoGHpMdz8XykejkxERET6is8mQ/WVF9n9xnHO5l/aMyg6gFvmpzLoBu0ZJCIi4kt8LhlythvkvV/EoW1naG8zMFtMpM/SnkEiIiK+yueSoW0vfkLxp9UAJKREMO3uVO0ZJCIi4sOuamn9Cy+8wODBgwkICCAzM5OPPvqoS+dt2LABk8nEnDlzruZte8SYqQMJDPVj5r2juWvpjUqEREREfFy3R4beeOMNli1bxssvv0xmZiarV69m1qxZFBQUEBsbe8Xzzpw5wyOPPMLUqVOvKeBrNXR8DEmjorAF+NygmIiIiHyJbo8M/fa3v+UnP/kJ9957L6NHj+bll18mKCiIP/zhD1c8x+l0snDhQp588kmGDh16TQFfK5PJpERIRERE3LqVDDkcDnJzc5k5c+bnFzCbmTlzJvv377/ieU899RSxsbHcd999XXqf1tZW6uvrOz1EREREekO3kqHKykqcTid2u73TcbvdTmlp6Zees3fvXl599VVeeeWVLr/PqlWrCA8Pdz+SkpK6E6aIiIhIl/Vqb7KGhgZ+9KMf8corrxAdHd3l8x577DHq6urcj+Li4l6MUkRERHxZtybPREdHY7FYKCsr63S8rKyMuLi4y15/8uRJzpw5w+zZs93HDMPoeGOrlYKCAoYNG3bZef7+/vj7+3cnNBEREZGr0q2RIZvNRkZGBjt37nQfMwyDnTt3kpWVddnrR44cSX5+Pnl5ee7Hd77zHaZPn05eXp7KXyIiIuJx3V5WtWzZMrKzs5kwYQKTJk1i9erVNDU1ce+99wKwaNEiEhISWLVqFQEBAdxwww2dzo+IiAC47LiIiIiIJ3Q7GZo3bx4VFRUsX76c0tJSxo8fz/bt292TqouKijCbe3UqkoiIiEiPMblcLpeng/g69fX1hIeHU1dXR1hYmKfDERERkeuIhnBERETEpykZEhEREZ+mZEhERER8mpIhERER8WlKhkRERMSnKRkSERERn6ZkSERERHyakiERERHxad3egdoTPtsXsr6+3sORiIiILwgNDcVkMnk6DOkj/SIZamhoAFBjVxER6RPqeOBb+kU7DsMwuHDhQo9k6vX19SQlJVFcXKx/6F9B96nrdK+6Tveq63Svuq437pVGhnxLvxgZMpvNJCYm9ug1w8LC9A2mC3Sfuk73qut0r7pO96rrdK/kamkCtYiIiPg0JUMiIiLi03wuGfL392fFihX4+/t7OhSvpvvUdbpXXad71XW6V12neyXXql9MoBYRERHpLT43MiQiIiLyRUqGRERExKcpGRIRERGfpmRIREREfJpPJUMvvPACgwcPJiAggMzMTD766CNPh+SVdu/ezezZsxk4cCAmk4ktW7Z4OiSvtGrVKiZOnEhoaCixsbHMmTOHgoICT4fllV566SXS0tLcm+JlZWXxt7/9zdNh9QvPPPMMJpOJhx9+2NOheJ2VK1diMpk6PUaOHOnpsKQf8plk6I033mDZsmWsWLGCjz/+mHHjxjFr1izKy8s9HZrXaWpqYty4cbzwwgueDsWr5eTksGTJEg4cOMCOHTtoa2vjG9/4Bk1NTZ4OzeskJibyzDPPkJuby6FDh7jtttu46667OHLkiKdD82oHDx5k7dq1pKWleToUrzVmzBhKSkrcj71793o6JOmHfGZpfWZmJhMnTmTNmjVAR7+zpKQkHnzwQX71q195ODrvZTKZ2Lx5M3PmzPF0KF6voqKC2NhYcnJyuOWWWzwdjteLiori2Wef5b777vN0KF6psbGR9PR0XnzxRX7zm98wfvx4Vq9e7emwvMrKlSvZsmULeXl5ng5F+jmfGBlyOBzk5uYyc+ZM9zGz2czMmTPZv3+/ByOT60ldXR3Q8UNerszpdLJhwwaamprIysrydDhea8mSJdx5552dvm/J5QoLCxk4cCBDhw5l4cKFFBUVeTok6Yf6RaPWa1VZWYnT6cRut3c6brfbOXbsmIeikuuJYRg8/PDDTJkyhRtuuMHT4Xil/Px8srKyaGlpISQkhM2bNzN69GhPh+WVNmzYwMcff8zBgwc9HYpXy8zMZN26daSmplJSUsKTTz7J1KlTOXz4MKGhoZ4OT/oRn0iGRHrbkiVLOHz4sOYrfIXU1FTy8vKoq6tj06ZNZGdnk5OTo4ToPxQXF/PQQw+xY8cOAgICPB2OV7vjjjvcX6elpZGZmcmgQYPYuHGjyq/SLT6RDEVHR2OxWCgrK+t0vKysjLi4OA9FJdeLBx54gHfeeYfdu3eTmJjo6XC8ls1mY/jw4QBkZGRw8OBBfve737F27VoPR+ZdcnNzKS8vJz093X3M6XSye/du1qxZQ2trKxaLxYMReq+IiAhSUlI4ceKEp0ORfsYn5gzZbDYyMjLYuXOn+5hhGOzcuVNzFuSquVwuHnjgATZv3swHH3zAkCFDPB1Sv2IYBq2trZ4Ow+vMmDGD/Px88vLy3I8JEyawcOFC8vLylAh9hcbGRk6ePEl8fLynQ5F+xidGhgCWLVtGdnY2EyZMYNKkSaxevZqmpibuvfdeT4fmdRobGzv9ZnX69Gny8vKIiooiOTnZg5F5lyVLlrB+/Xq2bt1KaGgopaWlAISHhxMYGOjh6LzLY489xh133EFycjINDQ2sX7+eXbt28d5773k6NK8TGhp62byz4OBgBgwYoPlo/+GRRx5h9uzZDBo0iAsXLrBixQosFgsLFizwdGjSz/hMMjRv3jwqKipYvnw5paWljB8/nu3bt182qVrg0KFDTJ8+3f182bJlAGRnZ7Nu3ToPReV9XnrpJQBuvfXWTsf/+Mc/cs899/R9QF6svLycRYsWUVJSQnh4OGlpabz33nvcfvvtng5N+rFz586xYMECqqqqiImJ4eabb+bAgQPExMR4OjTpZ3xmnyERERGRL+MTc4ZERERErkTJkIiIiPg0JUMiIiLi05QMiYiIiE9TMiQiIiI+TcmQiIiI+DQlQyIiIuLTlAyJiIiIT1MyJCJuu3btwmQyUVtb6+lQRET6jJIhERER8WlKhkRERMSnKRkS8SKGYbBq1SqGDBlCYGAg48aNY9OmTcDnJaxt27aRlpZGQEAAkydP5vDhw52u8dZbbzFmzBj8/f0ZPHgwzz33XKe/b21t5dFHHyUpKQl/f3+GDx/Oq6++2uk1ubm5TJgwgaCgIG666SYKCgp694OLiHiQkiERL7Jq1Spee+01Xn75ZY4cOcLSpUv54Q9/SE5Ojvs1v/jFL3juuec4ePAgMTExzJ49m7a2NqAjiZk7dy7z588nPz+flStX8utf/5p169a5z1+0aBGvv/46zz//PEePHmXt2rWEhIR0iuOJJ57gueee49ChQ1itVhYvXtwnn19ExBPUtV7ES7S2thIVFcX7779PVlaW+/iPf/xjmpub+elPf8r06dPZsGED8+bNA6C6uprExETWrVvH3LlzWbhwIRUVFfz97393n//LX/6Sbdu2ceTIEY4fP05qaio7duxg5syZl8Wwa9cupk+fzvvvv8+MGTMAePfdd7nzzju5ePEiAQEBvXwXRET6nkaGRLzEiRMnaG5u5vbbbyckJMT9eO211zh58qT7dV9MlKKiokhNTeXo0aMAHD16lClTpnS67pQpUygsLMTpdJKXl4fFYmHatGlfGUtaWpr76/j4eADKy8uv+TOKiHgjq6cDEJEOjY2NAGzbto2EhIROf+fv798pIbpagYGBXXqdn5+f+2uTyQR0zGcSEbkeaWRIxEuMHj0af39/ioqKGD58eKdHUlKS+3UHDhxwf11TU8Px48cZNWoUAKNGjWLfvn2drrtv3z5SUlKwWCyMHTsWwzA6zUESEfF1GhkS8RKhoaE88sgjLF26FMMwuPnmm6mrq2Pfvn2EhYUxaNAgAJ566ikGDBiA3W7niSeeIDo6mjlz5gDw85//nIkTJ/L0008zb9489u/fz5o1a3jxxRcBGDx4MNnZ2SxevJjnn3+ecePGcfbsWcrLy5k7d66nPrqIiEcpGRLxIk8//TQxMTGsWrWKU6dOERERQXp6Oo8//ri7TPXMM8/w0EMPUVhYyPjx4/nrX/+KzWYDID09nY0bN7J8+XKefvpp4uPjeeqpp7jnnnvc7/HSSy/x+OOPc//991NVVUVycjKPP/64Jz6uiIhX0GoykX7is5VeNTU1REREeDocEZHrhuYMiYiIiE9TMiQiIiI+TWUyERER8WkaGRIRERGfpmRIREREfJqSIREREfFpSoZERETEpykZEhEREZ+mZEhERER8mpIhERER8WlKhkRERMSn/X+znAOQDMdKdwAAAABJRU5ErkJggg==", "text/plain": ["<Figure size 616.125x500 with 1 Axes>"]}, "metadata": {}, "output_type": "display_data"}], "source": ["\n", "metrics = pd.read_csv(f\"{trainer.logger.log_dir}/metrics.csv\")\n", "del metrics[\"step\"]\n", "metrics.set_index(\"epoch\", inplace=True)\n", "display(metrics.dropna(axis=1, how=\"all\").head())\n", "sn.relplot(data=metrics, kind=\"line\")"]}, {"cell_type": "markdown", "id": "e1cd7cda", "metadata": {"lines_to_next_cell": 2, "papermill": {"duration": 0.006295, "end_time": "2025-04-03T19:58:22.691925", "exception": false, "start_time": "2025-04-03T19:58:22.685630", "status": "completed"}, "tags": []}, "source": ["### Bonus: Use [Stochastic Weight Averaging](https://arxiv.org/abs/1803.05407) to get a boost on performance\n", "\n", "Use SWA from torch.optim to get a quick performance boost. Also shows a couple of cool features from Lightning:\n", "- Use `training_epoch_end` to run code after the end of every epoch\n", "- Use a pretrained model directly with this wrapper for SWA"]}, {"cell_type": "code", "execution_count": 9, "id": "7ed6d133", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:58:22.705961Z", "iopub.status.busy": "2025-04-03T19:58:22.705672Z", "iopub.status.idle": "2025-04-03T19:58:22.713314Z", "shell.execute_reply": "2025-04-03T19:58:22.712519Z"}, "papermill": {"duration": 0.016009, "end_time": "2025-04-03T19:58:22.714274", "exception": false, "start_time": "2025-04-03T19:58:22.698265", "status": "completed"}, "tags": []}, "outputs": [], "source": ["class SWAResnet(LitResnet):\n", "    def __init__(self, trained_model, lr=0.01):\n", "        super().__init__()\n", "\n", "        self.save_hyperparameters(\"lr\")\n", "        self.model = trained_model\n", "        self.swa_model = AveragedModel(self.model)\n", "\n", "    def forward(self, x):\n", "        out = self.swa_model(x)\n", "        return F.log_softmax(out, dim=1)\n", "\n", "    def on_train_epoch_end(self):\n", "        self.swa_model.update_parameters(self.model)\n", "\n", "    def validation_step(self, batch, batch_idx, stage=None):\n", "        x, y = batch\n", "        logits = F.log_softmax(self.model(x), dim=1)\n", "        loss = F.nll_loss(logits, y)\n", "        preds = torch.argmax(logits, dim=1)\n", "        acc = accuracy(preds, y, task=\"multiclass\", num_classes=10)\n", "\n", "        self.log(\"val_loss\", loss, prog_bar=True)\n", "        self.log(\"val_acc\", acc, prog_bar=True)\n", "\n", "    def configure_optimizers(self):\n", "        optimizer = torch.optim.SGD(self.model.parameters(), lr=self.hparams.lr, momentum=0.9, weight_decay=5e-4)\n", "        return optimizer\n", "\n", "    # def on_train_end(self):  # todo: failing as trainer has only dataloaders, not datamodules\n", "    #     update_bn(self.trainer.datamodule.train_dataloader(), self.swa_model, device=self.device)"]}, {"cell_type": "code", "execution_count": 10, "id": "4e87a14b", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T19:58:22.728001Z", "iopub.status.busy": "2025-04-03T19:58:22.727703Z", "iopub.status.idle": "2025-04-03T20:44:09.582569Z", "shell.execute_reply": "2025-04-03T20:44:09.581347Z"}, "papermill": {"duration": 2746.880344, "end_time": "2025-04-03T20:44:09.600887", "exception": false, "start_time": "2025-04-03T19:58:22.720543", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.10/dist-packages/pytorch_lightning/utilities/parsing.py:208: Attribute 'trained_model' is an instance of `nn.Module` and is already saved during checkpointing. It is recommended to ignore them using `self.save_hyperparameters(ignore=['trained_model'])`.\n", "/usr/local/lib/python3.10/dist-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.\n", "  warnings.warn(\n", "/usr/local/lib/python3.10/dist-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`.\n", "  warnings.warn(msg)\n", "GPU available: True (cuda), used: True\n"]}, {"name": "stderr", "output_type": "stream", "text": ["TPU available: False, using: 0 TPU cores\n"]}, {"name": "stderr", "output_type": "stream", "text": ["HPU available: False, using: 0 HPUs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\n", "  | Name      | Type          | Params | Mode \n", "----------------------------------------------------\n", "0 | model     | ResNet        | 11.2 M | train\n", "1 | swa_model | AveragedModel | 11.2 M | train\n", "----------------------------------------------------\n", "22.3 M    Trainable params\n", "0         Non-trainable params\n", "22.3 M    Total params\n", "89.392    Total estimated model params size (MB)\n", "137       Modules in train mode\n", "0         Modules in eval mode\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "b394956d4e9347d488074e7a617d8d05", "version_major": 2, "version_minor": 0}, "text/plain": ["Sanity Checking: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "0e0f5a841f4240c497281233e2747a33", "version_major": 2, "version_minor": 0}, "text/plain": ["Training: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "a909514edc02444fb33fc35ecc6fcb60", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "7347625323324ff1b417cab15822fd6e", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "176ac752d4bc4935b2ef4bc4605a2829", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "be81087855a841b7b2754fd85d12e957", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "e70bdd1df74047e8b1421042467bca27", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stderr", "output_type": "stream", "text": ["`Trainer.fit` stopped: `max_epochs=5` reached.\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "cbe7f23f586b496588eb99700f0cd414", "version_major": 2, "version_minor": 0}, "text/plain": ["Testing: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stdout", "output_type": "stream", "text": ["\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n", "       Test metric             DataLoader 0\n", "\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n", "        test_acc            0.8149999976158142\n", "        test_loss           0.5376426577568054\n", "\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n"]}, {"data": {"text/plain": ["[{'test_loss': 0.5376426577568054, 'test_acc': 0.8149999976158142}]"]}, "execution_count": 10, "metadata": {}, "output_type": "execute_result"}], "source": ["swa_model = SWAResnet(model.model, lr=0.01)\n", "\n", "swa_trainer = pl.Trainer(\n", "    max_epochs=5,\n", "    accelerator=\"auto\",\n", "    devices=1,\n", "    logger=CSVLogger(save_dir=\"logs/\"),\n", ")\n", "\n", "swa_trainer.fit(swa_model, train_dataloaders=train_dataloader, val_dataloaders=val_dataloader)\n", "swa_trainer.test(swa_model, dataloaders=test_dataloader)"]}, {"cell_type": "code", "execution_count": 11, "id": "0e0a2a3a", "metadata": {"execution": {"iopub.execute_input": "2025-04-03T20:44:09.634895Z", "iopub.status.busy": "2025-04-03T20:44:09.634704Z", "iopub.status.idle": "2025-04-03T20:44:09.991403Z", "shell.execute_reply": "2025-04-03T20:44:09.990506Z"}, "papermill": {"duration": 0.376119, "end_time": "2025-04-03T20:44:09.993651", "exception": false, "start_time": "2025-04-03T20:44:09.617532", "status": "completed"}, "tags": []}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>lr-SGD</th>\n", "      <th>test_acc</th>\n", "      <th>test_loss</th>\n", "      <th>train_loss</th>\n", "      <th>val_acc</th>\n", "      <th>val_loss</th>\n", "    </tr>\n", "    <tr>\n", "      <th>epoch</th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.012079</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>0.0</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>1.816580</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.034132</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>0.0</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>1.662646</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.062440</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["         lr-SGD  test_acc  test_loss  train_loss  val_acc  val_loss\n", "epoch                                                              \n", "NaN    0.012079       NaN        NaN         NaN      NaN       NaN\n", "0.0         NaN       NaN        NaN    1.816580      NaN       NaN\n", "NaN    0.034132       NaN        NaN         NaN      NaN       NaN\n", "0.0         NaN       NaN        NaN    1.662646      NaN       NaN\n", "NaN    0.062440       NaN        NaN         NaN      NaN       NaN"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"text/plain": ["<seaborn.axisgrid.FacetGrid at 0x7f2b695c7220>"]}, "execution_count": 11, "metadata": {}, "output_type": "execute_result"}, {"data": {"image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHpCAYAAACBVjiOAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjkuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8hTgPZAAAACXBIWXMAAA9hAAAPYQGoP6dpAACeJklEQVR4nOzdd5hU1fnA8e+9d/ps74WFpS2dZakCCkgRQVHBrlGxYLAlxpgoP0vEGE2MErum2WIDDaAGRRGlSoelSZHeFraX2TLt3t8fAyvIAltm+/t5nnlkZs495wwJO+++95zzKoZhGAghhBBCtFJqY09ACCGEEKIxSTAkhBBCiFZNgiEhhBBCtGoSDAkhhBCiVZNgSAghhBCtmgRDQgghhGjVJBgSQgghRKvWLIIhwzAoLi5GjkQSQgghRLA1i2CopKSE8PBwSkpKGnsqQgghhGhhmkUwJIQQQghRXyQYEkIIIUSrJsGQEEIIIVo1CYaEEEII0apJMCSEEEKIVk2CISGEEEK0ahIMCSGEEKJVk2BICCGEEK2aBENCCCGEaNUkGBJCCCFEqybBkBBCCCFaNQmGhBBCCNGqSTAkhBBCiFZNgiEhhBBCtGoSDAkhhBCiVZNgSAghhBCtmgRDQgghhGjVJBgSQgghRKtmauwJNDR/YSG+4mJM4eGooaEoqsSDQgghRGvWqoIhQ9fZuWIZR9avZeDQEWhhYZjj41HDI9BCnI09PSGEEEI0glYVDOUfOcwXb78BQNqAwUS4SvHlbkWx2TFFRWGKjUGLiEC1Wht5pkIIIYRoKK3qHlF0mxQ69soAYMPKpZiiojAnJaPa7fhycijftImydeuo2LETX14ehtfbyDMWQgghRH1rVcEQwIAxlwDw49aNFORmA6Da7ZhiYzHFJ4BmwnPoIOUbNlC2fj3uvXvxFxZi6HpjTlsIIYQQ9aTVBUOxySm0a9cRMFi37NtT3lNUFc3pxByfgBYbh+Hz4969m7INGyhbvwHPocP4XS4Mw2icyQshhBAi6GocDC1ZsoQJEyaQlJSEoijMnTv3nNe8//77pKen43A4SExM5LbbbiMvL6828w2KjL6DAPhxy0ZKS4qrbKNoGlp4OOaERLSISPTycip++IGy9esp37IF79Gj6BUVDTltIYQQQtSDGgdDpaWlpKen8+qrr1ar/fLly7n55pu5/fbb2bp1Kx9//DGrV69mypQpNZ5ssMTGxnPeyHFcfcd9OEPDztleMZsxRUZiTkpCdTjx5+ZRvnlzYH3R9u34cnNlfZEQQgjRTNV4N9m4ceMYN25ctduvWLGC1NRUfvWrXwHQvn17fvnLX/KXv/ylpkMHVd+hI2p1nWqzodpsGIaBUVaG5/ARvAcPoYaGYIqLR4uMQAsLQ9G04E5YCCGEEPWi3tcMDR48mIMHD/LFF19gGAbHjh3jk08+Yfz48We8xu12U1xcfMqjPvh8XrasXcHKb+fX+FpFUVCdTszx8WhxcRi6gWfPbso3ZFK2IRPPoUP4S0pkfZEQQgjRxNV7MDR06FDef/99rr32WiwWCwkJCYSHh5/1NtszzzxDeHh45SMlJaVe5pZ37ChLvpzLhu8XU1yQX+t+FE1DCwvDlJCIFnl8fdG2bYH1RZs3483KQi8vD+LMhRBCCBEs9R4M/fDDD/z617/m8ccfZ926dcyfP599+/YxderUM14zbdo0ioqKKh8HDx6sl7nFJ6eQ0jENs8VCfs7RoPRZub4oMQk1JBR/fgHlm7dQtm49Fdu24cvJwfB4gjKWEEIIIepOMepwH0dRFObMmcMVV1xxxjY33XQTFRUVfPzxx5WvLVu2jAsuuIAjR46QmJh4znGKi4sJDw+nqKiIsLBzL3g+G8+hw1Ts2I45PiHQd2E+Vpsdq81ep37PxjAMjPJy/CUloOuoIcdvr0VGyvoiIYQQopHVezmOsrIyTKZTh9GOf/k3hfU0YRFRlX/2uCuwWG1BH0NRFBSHA9XhwPD70cvK8OzZA6qKGhqKKT4eU2QkakgIiqIEfXwhhBBCnFmNgyGXy8WuXbsqn+/du5fMzEyioqJo27Yt06ZN4/Dhw7z77rsATJgwgSlTpvD6668zduxYsrKyuP/++xk4cCBJSUnB+yR14Pf7WDr/M37csoHrpj5AaHhkvY2laBpaaCiEhmL4fOguF+4dO/GYzWgREZjjYgP10RyOepuDEEIIIX5S42Bo7dq1XHjhhZXPH3jgAQBuueUW3n77bbKysjhw4EDl+5MnT6akpIRXXnmF3/72t0RERDBy5MhG31p/Mk0zUZSfi9fjYcP3ixk27ooGGVcxmdAiItAiItDdbvxFRfiyj6E6HJgiI9FijwdGFkuDzEcIIYRojeq0Zqih1OeaoRMO79vNsq8+Z+CIMbTv0qNOY9SFYRgYFRWB9UV+P2qIM1A3LSoqsL7IVO93NoUQQohWpdUFQ8XfLKR43v+Ivv2O094zDKNJrdkxdB29tBSjrBQUBTUk5Kf1RaGhTWquQgghRHPVqtIM3uxsDv/mN+D1Yk/vg6N//1PeVxQFwzA4tHcXUbHx1SrVUZ8UVT11fVFpKe6dx9cXhYdjjosL3EZzOht1nkIIIURz1qqq1pvj4oiYOBGAvH/8A7209LQ2y776jM/f/xcbvl/UwLM7O8VkCgRAiUmoYeH4i0so37qV0vXrKd+yFe+xbHS3u7GnKYQQQjQ7rSoYAoi8+Wa02Fj8+fnkv/feae+npnUDYOv6VZS5Shp6etWiWiyYoqMxJyWj2uz4cnIo37QxUDh25058eXkYPl9jT1MIIYRoFlpdMKTabETeeAMArgULKN+y5ZT327TvTHybtvh9PjasWNwYU6wR1W4PLLCOTwBVw3PwIOWZmZStW4d73z78RUUYut7Y0xRCCCGarFYXDAFYO3cm9KKLAChft+6U9xRFYcAFowHYunZlk80O/ZyiqmghIZjjE9BiYjF8ftw//hioj5aZiefQYfyu028LCiGEEK1dq1pAfbLIX/wCe0YGjgEDTnsvpWMacUkpZB85SObKpQwZPb4RZlh7iqahhYejhYdjeL34S0rw5f6AYrNhiorEFBuLFh6Oagv+adtCCCFEc9NqgyHV4agMhHS3G39hIeb4eOB4dmjYaDatWU6Hro135lAwKGYzpqhAyRG9ogJfTi7erKzAwY4xsZiio9DCw1HM5kaeqRBCCNE4Wm0wdILnwAGyn3sOxWQi6S9/qQwK2nXuSrvOXRt5dsGl2myoNhuGYQTqox06hPfggcD5RXHxmKIiUcPCUNRWefdUCCFEK9Xqv/W0iAh0lwvvgQMUzZlz2vu67mf7xnVUlLWc9TaKoqA5nZjj49Fi4zB0A/ee3ZSt30DZ+g14Dh3C73I1iUK6QgghRH2TYCgsjKjbbgNVxfB6T3v/q0/e59vPZrFx1bJGmF39UzQNLSwMc0IiWmQkenk5Fdu2BxZeb96Mv7CwsacohBBC1KtWf5sMwDl0KJb27bEkJ5/2Xpfefdm7YyvbMtfQf9goNK3l/pUpZjOmyEggsI7Kd/QYiqZhj4ho3IkJIYQQ9ajlfrPXgKIolYGQv6gI9+7dOPr2BaB9l+4MHjWeLr37tuhA6OdUqxUiIvAXFKJXVMjOMyGEEC1Wq79NdjLvsWMc/s1vyHnuObxHjwKgKCoZQ4bjCAlt5Nk1PMVuRy8vx19c3NhTEUIIIeqNBEMnMcXFYWnbFsPjIe+NN05ZQFzmKmH5gv+x4fumfyp1sCiKAqoq64aEEEK0aBIMnURRFKKnTkWxWKjYsgXXwoWV7x3ev4eNK5eyfvl3uCvKG3GWDUt1OAK1zqpYXC6EEEK0BBIM/Yw5IYGI668HIP/dd/Hl5QHQsVsvImPisDkclBQWNOYUG5TqcGCUleEvaR5lSYQQQoiakmCoCmHjx2Pp1AmjrIyiTz8FQFVVLrn+Vq6/67fEJCQ18gwbjqJpYBiybkgIIUSLJcFQFRRNI+buuwm/6iqibrqp8vWwiChUVQNoNgVcg0GxO/Dl5GD4/Y09FSGEECLoWs9e8RqytG2LpW1bgMBCap8PxWymrNTFN3M/IjfrMDf96mHMFmsjz7T+qQ4H/sICdJcLLTy8sacjhBBCBJVkhs7Bl59P9l/+Qu5rrwFgs9spKcynoryMLWtXNPLsGoZiNmP4/PhLXI09FSGEECLoJBg6B39eHuXr11O6dCll69ahqhr9zh8FQOaKJXg9nkaeYcNQrFZ8uTlSr0wIIUSLI8HQOVg7dybskksAKF2+HIC0Xn0Ii4yivKyUretWNub0GozqcOAvLkYvLWvsqQghhBBBJcFQNURcdx0xv/oVMffdB3A8OzQSgA0rFuP1tvzskGqzYbjd6CWyq0wIIUTLIsFQNahWKyHDhqEoCobfjy8nh7RefQmNiCQ8Koby0taxlkYxmfHl5zf2NIQQQoigkt1kNeA9doycGTPQS0tJev55rrz1HuzOkEDZilZAdTikcKsQQogWRzJDNaCFhOAvKMB39CiFs2bhCAkNZIsMneKClp8xURwOKdwqhBCixZFgqAZUp5PoO+8EoPjzz3Hv2kVRfh4z//Eic955HZ+vZdfvksKtQgghWiIJhmrI0b8/zvPPB10n97XXcNoduCvKKS0pZnvm2saeXr2Twq1CCCFaGgmGaiHq1ltRQ0PxHjiA64svGHDBKHr0O492nbo29tTqnepwYJSXS+FWIYQQLUbrXEBdx4MDtfBwom67jdJlywgZMYLu0dFBmljTp2ga6Dr+4mJMUVGNPR0hhBCizlpdZkh12FFUFb2OJ0c7zz+fuIcfxnRSIOSuKGfD94vw+311nWaTVlm4VdcbeypCCCFEnbW6zJAWGYkpLh7vsWOo8fG17ufEdnrD66VozhyUkBDm7fuBwrwcrDY73fsOCtaUmxzV4cBfVIheUiKFW4UQQjR7rS4zpCgK5uQkFFVBd7vr3F/pypUUzppF4fvv0zWtBwA7Nq2vc79NmWI2Y3h9UrhVCCFEi9DqgiEALSICc1wc/sKCOvflHDoUW48eGG43iVt3MOKSSVz2iylBmGXTJoVbhRBCtBSt7jYZBLJDpqQkvDk56G43qtVa+75UleipUyn+4gsir7+eRIcjiDNtuk4u3KqFOBt7OkIIIUSttcrMEJyUHQrCydHmxESib78d9XgglHPkEF/OepftG9fVue+mqrJwq0u22AshhGjeWmVmCI6vHUpKwpudE7RaW36Xi4J332V7YQ57/WXk5xwlrVcfVFULwoybHsVkxpeXhzkhobGnIoQQQtRaq80MAajh4Zjj49CDsHYIwJ+Xh2vxYhIzt2A1WyjKz+PHLRuD0ndTdHLhViGEEKK5atXB0InsEGYzenl5nfuztGtH+KRJmHSD9scCt9/WLfsWvYWex6PY7ejl5ehyGrUQQohmrFUHQxA4TdqckIBeVBiU/iImTcKckkLbw9lYFIXCvBx2/7ApKH03NYqqgqriKwhOZk0IIYRoDK0+GILAAmgslqBkhxSzmZi77sJkQOqRXAD27Nha536bKincKoQQormTYAjQwsIwxyfgD1J2yJqWRtgll9BRszFqyEgumnRDUPptiioLt7rkAEYhhBDNk2I0g1PziouLCQ8Pp6ioiLCwsHoZw19SQtmGTFSbrXKLfF2cON36xBlGJ/6aT5TxaEl8R7OwdOqENTW1sacihBBC1FiNM0NLlixhwoQJJCUloSgKc+fOPec1brebRx55hHbt2mG1WklNTeXNN9+szXzrjRYaijkxeNkh1WqtDIR2zZ/HJ689z55tm4PSd1Oj2OxSuFUIIUSzVeNgqLS0lPT0dF599dVqX3PNNdewcOFC/v3vf7Njxw4+/PBDunTpUtOh6505MRHFZkMvLQ1anyULFrDn87nk5Oewdsk3GEbLCxhUpxO9tFR2lQkhhGiWanzo4rhx4xg3bly128+fP5/FixezZ88eoqKiAEhtordTtJAQzImJePbuRXUGp8SEY8gQOv73E/b7/ISWu/F6vFjqUP6jKTq5cKtUsRdCCNHc1PsC6s8++4z+/fvz7LPPkpycTFpaGg8++CDlZ9m55Xa7KS4uPuXRUCyJiah2O/4gZYc0p5PE2+9grM/C6GtubnGB0AmKxSKFW4UQQjRL9V6OY8+ePSxbtgybzcacOXPIzc3l7rvvJi8vj7feeqvKa5555hmmT59e31Orkup0Yk5Kxr17N1qwskMDBpDSrx+KquL1eCgtKSYiOiYofTcVqtOJv7hECrcKIYRoduo9M6TrOoqi8P777zNw4EDGjx/PjBkzeOedd86YHZo2bRpFRUWVj4MHD9b3NE9hTohHddjxB3ENjKKqHN67i3eff5L5b73W4jIogcKtFVK4VQghRLNT78FQYmIiycnJhJ+0lqRbt24YhsGhQ4eqvMZqtRIWFnbKoyGpDgfmpCR0V0lQgxZ71jF8bjf55aXsXrEsaP02FScKtwohhBDNSb0HQ0OHDuXIkSO4TjqUb+fOnaiqSps2bep7+FozJyQEdkkF8TDByMFD6Gay0/VIHtb/fYHh9wet76ZAdTjwF0rhViGEEM1LjYMhl8tFZmYmmZmZAOzdu5fMzEwOHDgABG5x3XzzzZXtb7jhBqKjo7n11lv54YcfWLJkCb/73e+47bbbsNvtwfkU9UC12zEnJ6OXBC87pCgKQ6b+io4uN/6dP1Iyf35Q+m0qFLsdvUwKtwohhGheahwMrV27loyMDDIyMgB44IEHyMjI4PHHHwcgKyurMjACCAkJYcGCBRQWFtK/f39uvPFGJkyYwEsvvRSkj1B/zPHxqKEhQf1yN8XEEPmLX+CymFn91ed4jh0LWt+NTQq3CiGEaI6kHMc5uA8cwL19O6bEpKCV0nCXl/P2X5/Ar8CYfufTefyEoPTbFPhLSlAUcPTrh2I2N/Z0hBBCiHOSQq3nYI6LQw0NRQ/iWUdWu51uvQKZtc3Zh1rUzjLV4UAvK5PCrUIIIZoNCYbOQbXZMLdpg17qCmrtrX6jx6NpJo4e3Mf+9WtazK0lRdNA1/EXFTX2VIQQQohqkWCoGsxxcWhhYUFdO+QMDaN734EArPz4ffL/9a+g9d3YpHCrEEKI5kSCoWpQrVbMbVLQy0qD+gWfMWQ4qqqS77RxaMtGSlesCFrfjamycKvcKhNCCNEMSDBUTaa42EB2KIhrh0LCIhg4YiyD49sSbba1mAXHlYVbi2WLvRBCiKZPdpPVgPfwYcq3/oApPj6wNiZIDK8XvaICLTQ0aH02Nl9eHlp4GPb09KDtwhNCCCHqg2SGasAUG4sWEY4/iNkhCGRSsgtyWfntfCq2baN8y5ag9t8YThRuNcrKGnsqQgghxFnVe9X6lkSxWLC0aUP5lq0YYWFByw6VuUr49D//QNd1rLsOE2MPIflvf0Ntwid0n4tqs+EvyMdfUoLqlCr2Qgghmi7JDNWQKTYWLSoyqNkhR0goXdL7AVAQH4M/N5eCDz4IWv+NRQq3CiGEaA4kGKohxWzG0qYNRkV5UAut9r9gNNdM+TWDf3EbACVffknFtm1B678xVBZudbsbeypCCCHEGUkwVAum6Gi0yCj8hYVB6zM0PIKYhCTsvXvjGDkSgNzXX0f3eII2RkOrLNwa5DVWQgghRDBJMFQLitmMJaUNhscT1OwQwNb1q5jvKaAkPgbfkSOUr10b1P4bUqBwq4IviEGjEEIIEWwSDNWSKToaU1RkULNDAEcP7sdVUsy+9O7E/d//4RwyJKj9NzTV4cSfl4fh9Tb2VIQQQogqSTBUS4rJhLlNCng9GD5f0Prtd/6FWO0O4tO6Ys/oA4BeXh7UMRqS6nCgl5ZK4VYhhBBNlhy6WAeG30/5pk34i4oxxcQErV+fz4vJFDiNunzzZvJef52Q0aOJmDQpaGM0JO/RLKydOmFNTW3sqQghhBCnkcxQHSiahjk5GXzeoN4GOhEIlRQVUnj4EL7sbAo//hjP4cNBG6MhqTY7vtxcKdwqhBCiSZJgqI5M0dFoMbFBXzu0LXMN77/yLJklOdgzMkDXcW/fHtQxGorqdKK7XFK4VQghRJMkwVAdKZqGJTkJdH9Qs0PxyW3RdZ2927fCVRNJ/POfCR01Kmj9N6RA4VavFG4VQgjRJEkwFARadDRaTExQs0NRsfF07N4LgMzN67G2bw+Ar6CgWZ7qrFisgVtlTX+JmhBCiFZGgqEgUFQVS3IyGHpQs0P9zw8cvrh722byso9Stn49h3/9a3Jff73ZBRWBwq3FUrhVCCFEkyPBUJBoUVFosbH4CgqC1md0fCIduvYEYN3ShZgTEjC8XioyMyldvDho4zQE1WbDcFfgL5FbZUIIIZoWCYaCRFFVLElJKBhBLaHR/4JRhIZH0qZ9J8xJSURecw0A+W+/HdTAqyEoJjP+ZniLTwghRMsmwVAQaZGRmOLi8RcGL0iJSUjixnt/T/e+gwAIu+wyLB06oLtc5P/730EbpyGoDgc+KdwqhBCiiZFgKIgUVcWclIiCEtQvfFUN/M+Uk3WYkuIiYu6+GzSNspUrKVu/Pmjj1Dcp3CqEEKIpMjX2BFqaQHYoDu+xY6jx8UHrd92y71j13XzSevVl9BXXEnHVVaBp2Hv3DtoY9e3kwq2m2NjGno4QQggBSGYo6BRFwZychKIGNzuU0qEzAD9u2YCruJCIq68mYtIkFJOpWe0sk8KtQgghmhoJhuqBFhGBOS4Of0F+0PqMS2pD/2GjueKWqYSERVS+7s3O5thTT1GemRm0seqTFG4VQgjR1EgwVA8C2aFkFJMZvaIiaP0OHD6GxJTUU14r+fJLKjZuJPfvf0cvLw/aWPVF0TQMw8BfVNTYUxFCCCEACYbqjRoejjk+Dj2IO8sAdN3P9o3rWLN4AQAR11yDKS4Of04OriVLgjpWfQkUbs2Twq1CCCGaBFlAXU8URcGclIQ3Oxu9vBzVbg9KvzlZR/j2s1moqkqX9H6ERUQRfddd+AsKcF5wQVDGqG+q04m/qBDd5UILC2vs6QghhGjlJDNUj7TwcMwJCehFhUHrMz45hTYdOqOqGtlHDgFg79WLkGHDUBQFw+tt8ouTpXCrEEKIpkQyQ/XMnJiI99ixoGaHhl18BRarFUdI6Cmvu3fvJvfVV3H070/kDTcEZaz6cqJwqzk5CUVRGns6QgghWjHJDNUzLSwMc3wC/iBmhyKiYyoDId9JWSBfbi7eAwcomjsX9969QRuvPkjhViGEEE2FBEMNwJyUiGKxogfxi9/v97N8wf9454U/4SouBMA5aBCO884DXSfvtdcw/P6gjRdsUrhVCCFEUyHBUAPQQkMxJwY3O6RpGjlZh3FXlLPh+58q2EfdfjtqSAievXsp+uyzoI1XH6RwqxBCiKZAgqEGYk5MRLHZ0EtLg9Zn/wtGAfDD+tWUlgTqfZkiI4maPBmAwlmz8B4+HLTxgk0KtwohhGgKJBhqIFpICObERPzFwTtsMDm1I4kpqfj9PjZ8v6jydefw4dj69MHRrx+q0xm08YJNCrcKIYRoCiQYakDmhERUux1/kLJDiqLQf1ggO7R1/arK7JCiKMT97nfEPfggWkREUMaqDycXbhVCCCEaiwRDDUgLcWJOSkIPYnaoTfvOxLdpi8VqozAvp/J11WoFQHe7KfjwQ3w5OWfqolFJ4VYhhBCNTc4ZamDm+Hi8R7Lwu1xoISF17k9RFMZccT32kBDMZstp7+f94x+ULl6MZ/du4h55pMmd6aM6HPhzc/C7XJgiIxt7OkIIIVohyQw1MNV5PDtUUoxhGEHpMywyqjIQqig/dft+xKRJYDZTnplJ2fffB2W8YJLCrUIIIRqbBEONwJwQj+pwoLtcQevT6/GwYM6H/OelP1Ne+lO/5uRkIq+7jrAJE7D37x+08YJJCrcKIYRoTBIMNQLV4cDcpg16SUnQskMms5nCvFy8HjeZK5ee8l745ZcTdcstleuImhrV6UR3lQQ1OBRCCCGqS4KhRmKOi0MNDUEP0gnMiqIwYNgoEtq0I6VD5yrb+IuKyHnhBUpXrQrKmMESKNzqk8KtQgghGkWNg6ElS5YwYcIEkpICBTbnzp1b7WuXL1+OyWSiT58+NR22xVHtdszJyeiu4GWH2nXuxsTJd9Gmfacq3y/5+mtKly0j/5//xN/EsjCKxYIvNzdofxdCCCFEddU4GCotLSU9PZ1XX321RtcVFhZy8803M2rUqJoO2WIFskOhQTt0UFEUFEXBMHT2bN9y2mLqsMsvx5SUhL+wkIJ33w3KmMEihVuFEEI0lhoHQ+PGjeOpp55i4sSJNbpu6tSp3HDDDQwePPicbd1uN8XFxac8WiLVZgusHSp1BXXx8DdzZjL/4/+wadWyU8ezWIi5+25QFFzffkv5pk1BG7OupHCrEEKIxtIga4beeust9uzZwx/+8IdqtX/mmWcIDw+vfKSkpNTzDBuPOS4OLSwsaGuHADp06wnAlnUr8ft8p7xn69qV0IsvBiDvjTfQy8uDNm5dSeFWIYQQjaHeg6Eff/yRhx9+mPfeew+TqXpnPE6bNo2ioqLKx8GDB+t5lo1HtVoxt0kJanaoQ9ceDBg2mqtvvw+tir/zyBtuQIuNRbFY8DehUhhSuFUIIURjqNcTqP1+PzfccAPTp08nLS2t2tdZrVasTXQbeH0wxcWiHQ5HLy4OSi0xRVEZMHzMGd9X7XYSHn0UU1wcitlc5/GCRbHb8R8rRi8uRo2NbezpCCGEaCXqNTNUUlLC2rVruffeezGZTJhMJp588kk2btyIyWTi22+/rc/hmw3VYsHSpg16WVlQ1w65K8pZs3gBG1ctPe09c3JyYEu7YVC2Zk2TqA0mhVuFEEI0hnrNDIWFhbF58+ZTXnvttdf49ttv+eSTT2jfvn19Dt+smGJj0SLC8RcVBa1G14HdO1mz5BusNjvd+gzAYrWd1ibvH//AtWAB4VdeSeT11wdl3LqoLNyamtqkslZCCCFarhpnhlwuF5mZmWRmZgKwd+9eMjMzOXDgABBY73PzzTcHOldVevbsecojLi4Om81Gz549cTqdwfskzZxyPDtkVJRj+P1B6bNjt15ERMfirihn85qq65LZ09MBKJo7F8++fUEZty5UhwO9tLTJnYMkhBCi5apxMLR27VoyMjLIyMgA4IEHHiAjI4PHH38cgKysrMrASNRMIDsUgT9IRwmoqkr/CwLnOmWuXIqnioXJzvPOw3Heedi6dUOx24Mybl1I4VYhhBANTTGawZG/xcXFhIeHU1RURFhYWGNPp155s7Io37IFU1w8iqbVuT9d1/no9ecpzM/lvJHj6Dt0xOltystRbDYURanzeMHgLyxEsdlw9M0IrCMSQggh6pF80zQxppgYtMiooGVGVFWl7/kjAdiWuQbDOH2Btmq3B06u9vsp+uwzvEeOBGXs2pLCrUIIIRpSvS6gFjWnmM1Y2iRTvnkLht8flOxQWq8+uCvK6JreH0U5c/xb8O67FM+bR9maNSRMn95oWZmTC7dqLTwTKIQQovFJZqgJCmSHIoN2IKKqaqQPugCr7exrgkIvuQTFZsO9bRslCxYEZezaksKtQgghGooEQ02QYjJhSUnB8HgwflZOoy6KC/NZNO+/Z9xZZo6LI/KGGwAo+M9/8OXkBG3smpLCrUIIIRqKBENNlCk6ClNMdFDLZRzau4sf1q9m3bJv8Z3hkMXQiy/G2rUrRkUFef/4R6NlZqRwqxBCiIYiwVATpZhMmJOTwecNWnaoS+++hIZHYneG4CqueoG2oqpE33UXmExUbN+O7+jRoIxdG4rJjD8/v9HGF0II0TrI1vomzPD7Kd+8GX9BIaYg1eoqKSogJCz8rAupAUpXrMDauTOmmJigjFsbemkphs+Lo39/1FZUq04IIUTDksxQE6ZoGpbkZND9QasdFhoeiaKoGIZBacmZD3d0Dh5cGQgF60TsmlLsdvSycvQgHUIphBBCVEWCoSZOi45Gi4kJ6tqhksICZr/1Gp+8+Qr+s9yC08vLyX/vPY48+GCjFHKVwq1CCCEaggRDTZyiqoHskKEHLSBxhITiKi6ktLiIbZlrztxQVSldtAjvwYO4Fi0Kytg1VVm4tRGCMSGEEK2DBEPNgBYVhRYbi6+gIDj9mUz0O38kab0ySE7tdMZ2qtVK+MSJAJQsWNAoO8ukcKsQQoj6JidQNwOKqmJJSsKfk4Pu8aBaLHXus2f/wfTsP/ic7ULGjMHQdUJHj26U2mUnF241RUY2+PhCCCFaPskMNRNaZCSmuDj8hcHJDp3g9XjYvOZ7/GdYJK1aLIRPmIDaiBXtVZsdX24ehn56XTUhhBCiriQz1Ewoqoo5KQlfdg662x2UreaGYTD7rdfIy85CM5nonjHwjG29R49SOGsW1k6dCBs/vs5j14TicKAXF6G7XFKrTAghRNBJZqgZ+Sk7VBiU/hRFoUt6XwDWL/vujNkhgIrNmyldsoTC2bPR3e6gjF9dqsVSWbhVCCGECDYJhpoRRVEwJyehqErQApIefc/D7nBSXJjPj1s2nLFdyIUXYoqLQy8spOSrr4Iydk1I4VYhhBD1RYKhZkaLiMAcxLVDZouFPoOHA7Bu2bfoetXZIcVkIvyqqwAomjsXvbw8KONXlxRuFUIIUV8kGGpmFEXBlJSEomlByw717H8eNoeTovw8ftyy8YztQoYPx5SQgF5cTPH8+UEZu7oUq1UKtwohhKgXEgw1Q1pEBOb4ePSgZYes9L9gFBmDh5PSMe2M7RRNI+KaawAoX7u2QW9ZKYoihVuFEELUC9lN1gwpioI5KQnvsWz0igpUm63OffYeOLRa7ZxDh6KYTDgGDWrwc4dUhwNfQUHQdtMJIYQQIJmhZksLD8ecELzs0AllrpLja4eqPtNH0TScQ4agaBrQsEVcpXCrEEKI+iDBUDNmTkoCiyVoi5l13c/H/3qJVd99xe5tm8/a1r17N0effJLCTz4JytjVUVm4taiowcYUQgjR8kkw1IxpYWGY4xPwFxUGpT9V1ejRdxAAP27JPGtbX3Y2FZs2UTxvXoMualYdTvy5uVK4VQghRNBIMNTMmZMSUSxW9CBtOe81cCijr7iOi6/+xVnbOQYNwtyuHUZZGaXffx+UsatDCrcKIYQINllA3cxpoaGYExPw7NuH6nDUuT+rzU5ar4zK54ZhVLlQWlFVom+7DcPnw9a7d53Hra7Kwq3FxVK4VQghRFBIZqgFMCcmoths6KWlQevz6KH9fPbeP1n13VdnLNNh69EDe3p6w+8qs9nx5eRK4VYhhBBBIcFQC6CFhGBOTMRfHLyFxYf27ubQ3l2sX/4du3/YdMZ2hmFQunIlR6ZNC1rNtHNRHA50Vwm63CoTQggRBBIMtRDmhERUux1/kLJD/c4fwYUTrqJtp6507pkOQGFeDiVVbOUvmjsXz48/UvTpp0EZ+1xOFG7V5TRqIYQQQSDBUAuhhTgxJyWhByk7pCgq3foM4NLrb0VRVAzD4LvPP+HD159n7ZJv8Pm8x9spRF53HQAlX32FryC45x6dcX4WC94cKdwqhBCi7iQYakHM8fGodke97LRyV5SjqCo+n5fVixfw0esz2LvjBwzDwJaejrVLFwyPh6LZs4M+dlVUh0MKtwohhAgKCYZaENV5PDtUUhz0jInN7uDym+5kzMTrcYaGUVyYz5ez3mHeh2/i83qIOJEdWrAAX15eUMeuimKzSeFWIYSowogRI7j//vsbexrNigRDLYw5IT5wFk89ZIcURaFzzz7ccPeDZAwZgaoGtrmbzBZsPXti7d4d/H7KMzODPnZVc5HCrUIIERyLFy9m5MiRREVF4XA46Ny5M7fccgsej6eyjWEY/POf/2Tw4MGEhYUREhJCjx49+PWvf82uXbsq2z3xxBOBn9GKgslkIiYmhmHDhvHCCy/gdrsb4+OdkwRDLYzqcGBOTkYvKam39TRmi5XBo8Zx3dQHGDZuIoqioOs6a9rFUX7PLwkZObJexv055aTCrUIIIc7t5ODmhB9++IGLL76Y/v37s2TJEjZv3szLL7+MxWKpPFrFMAxuuOEGfvWrXzF+/Hi+/vprfvjhB/79739js9l46qmnTumzR48eZGVlceDAAb777juuvvpqnnnmGYYMGUJJE8zoy6GLLZA5Ph7vkSPoLhdaaGi9jRMRHVP55+2Zazh05CCHjhykwmqmz8DzK4u51hfVbsefXYxeXIwaG1uvYwkhhGEYlHsbrjj1CXazVuvz3FJTU7n99tv58ccfmTt3LpMmTeLtt98+pc3XX39NQkICzz77bOVrHTt25OKLL658PnPmTD766CM+/fRTLrvsssrX27Zty3nnnXfaL98mk4mEhAQAkpKS6NWrF2PGjCE9PZ2//OUvpwVPjU2CoRZItdsxJyfj3rkTNSSkQQ5F7JLej/KyUn5Yv4o2uUUcuuceov5vGqa4OKw2e72MqagqhhIo3GqSYEgIUc/KvX66P/5Vg4/7w5NjcVhq/3X93HPP8fjjj/OHP/yhyvcTEhLIyspiyZIlDBs2rMo2H374IV26dDklEDpZdb5nunbtyrhx45g9e3aTC4bkNlkLZY6PRw0JabCzeEwmM/0vGMWN9/we/8ZN+HNzWf7Ru7z/6l/5YcNqDKN+TotW7Y5A4Vafr176F0KI5m7kyJH89re/pWPHjnTs2PG096+++mquv/56hg8fTmJiIhMnTuSVV16huLi4ss3OnTvp0qXLKdfdf//9hISEEBISQps2bao1l65du7Jv3746fZ76IJmhFkq12QLZoe3bUUNDG6xkhmYyEXnttRzemMmx4gIqrGYyv19Ml9590bTgx96q04k/Lxd/SYnUKhNC1Cu7WeOHJ8c2yrh10b9//8o/T506lffee6/yucvlQtM03nrrLZ566im+/fZbVq1axdNPP81f/vIXVq9eTWJiYpX9PvLII9x7773Mnj2bp59+ulpzOVO9y8YmwVALZo6Px3fkCHpxMVp4eIONa+3cmZg7pnBtRgbb9uwgKi4BTQv8X23T6uV06pGOwxkSlLEUTcPQdSncKoSod4qi1Ol2VWNxOp2Vf37yySd58MEHq2yXnJzMTTfdxE033cQf//hH0tLSeOONN5g+fTqdO3dmx44dp7SPjY0lNjaWuLi4as9l27ZttG/fvnYfpB7JbbIWTLVaMbdJQS91NXhR07CxY7HExZF+3gWkdOgMwL6d21j21Wd88Opf2bR6OboenIWIUrhVCCGqJy4ujk6dOlU+ziQyMpLExERKj5d4uv7669mxYwef1qHs0vbt25k/fz5XXnllrfuoL80vxBU1YoqLRTscHsgORUQ06Nj+khKKP/8cf1ERMXfdhd0ZQkxCErlHj7Dsq8/4YcNqLrj4cpLbdajTOIrDgV5cHNg9FxYWpNkLIUTr8Pe//53MzEwmTpxIx44dqaio4N1332Xr1q28/PLLAFx33XXMnj2b6667jmnTpjF27Fji4+PZv38/M2fORPvZ7mGfz8fRo0fRdZ28vDwWLVrEU089RZ8+ffjd737XGB/zrCQz1MKpFguWNm3Qy8oaPHPiz8ujaPZsXN9+i+fAAeKTU7jq9vsYPn4iVruD/OyjfPru31mz5Js6jRMo3OqVwq1CCFELAwcOxOVyMXXqVHr06MHw4cNZuXIlc+fOZfjw4UDgFuHMmTN54YUX+OKLLxg1ahRdunThtttuIyUlhWXLlp3S59atW0lMTKRt27aMGDGCWbNmMW3aNJYuXUpISHCWSQSTYjSDSpfFxcWEh4dTVFREmPzmX2OGx0NZZia629Pg62qyn3uOspUrcZx3HnEn3aeuKCtl1aKv2bZhNRNvvZv4pBQMQ0f362immicsfXl5aOHh2NN7N8nFeUIIIZouyQy1Asrx7JBRUY7hb9gDwyKuvRYUhbKVK3Hv3Vv5us3hZPj4ifzivoeIT0oBYMemDXz09xns37W9xuOoDgf+EincKoQQouZqHAwtWbKECRMmkJSUhKIozJ0796ztZ8+ezZgxY4iNjSUsLIzBgwfz1VcNf2hVa2eKiUGLiMB/0rkRDcGSkoJz6FAACmfOPO39kLAIILDdctPqZRTl5/HVJ+9RXlqz2mqKzYZRUYG/HmqyCSGEaNlqHAyVlpaSnp7Oq6++Wq32S5YsYcyYMXzxxResW7eOCy+8kAkTJrBhw4YaT1bUXmNmh8KvvhpUFffOnWcMxhRF4Yqbf0mfwcMYMGwM9uNb7w/t3YXXe3otnaquV0xm/Hl5QZ27EEKIlq9Oa4YURWHOnDlcccUVNbquR48eXHvttTz++OPVai9rhoLD8Hop27gJvawMU1RUg45dtno1tl69UO3VL81RXJDPh68/jz0khOHjJtKuc9eztveXloLPi6N/f1Srta5TFkII0Uo0+JohXdcpKSkh6ixfxm63m+Li4lMeou4UsxlLm2QMt7vBs0OOgQMrA6Hqjl3qKsYREoqrqBCPu+Kc7VW7HaO8XHaVCSGEqJEGD4aee+45XC4X11xzzRnbPPPMM4SHh1c+UlJSGnCGLZspJgYtMhJ/YWGDj+3LyyP31VfJ/vOfq9U+MSWV6+56gBGXXkmnHukAZB3cx/KvP8ddUX5a+8rCrY3w2YQQQjRfDRoMffDBB0yfPp1Zs2ad9fjuadOmUVRUVPk4ePBgA86yZVNMJiwpbTA8ngbPDhk+H64lSyjfsIGKbduqdY3ZbKF7xkAURcEwdJZ++SkbVy3jg9eeY/vGdacVgJXCrUIIIWqqwYKhjz76iDvuuINZs2YxevTos7a1Wq2EhYWd8hDBY4qOxhQd1eDZIXN8PCEjRwJQsnBhja9XFJXzRl1MRFQM5aUuvv1sFrPffp2crMOVbVSHA72sDL/cKhNCCFFNDRIMffjhh9x66618+OGHXHLJJQ0xpDgLxWTCnNwGvJ4Gz6BETJpE9D33EHPXXbW6vm3HLlw79TcMHjUOk9nCsUMH+PhfL1OQmw0EPtuJwq1CCCFEddT4qF+Xy8WuXbsqn+/du5fMzEyioqJo27Yt06ZN4/Dhw7z77rtA4NbYLbfcwosvvsigQYM4evQoAHa7nfAGrKQuTmWKiUaLjsZfWIgpJqbhxo2NJfTCC+vUh6aZyBgygs49M1ix8Av8Ph+RMYHbrsUF+djMFnw5uVhSUlBUOVdUCCHE2dV4a/2iRYu4sIovs1tuuYW3336byZMns2/fPhYtWgTAiBEjWLx48RnbV4dsra8f3uxsKjZvRouKRjGbG3Rs948/UjBzJuETJmBPT69TX36/H03T8Hm9fPTGDMwWC0OHXEiHSyZI4VYhRKszYsQI+vTpwwsvvBCU/iZPnkxhYeE5D1luzmqcGRoxYgRni59+HuCcCIpE02OKjkaLjsFfUIApNrZBx3YtW0ZFZiZGWRm23nWrJ3aiWnJezlHcFeUUF+azb/dOUktKJBgSQghxTnIPoRVTNA1Lm2QwdAyvt0HHDr/iChSLBffOnZRnZgalz/ikFG64+0HSz7uAvoPOx5uTi6sgn7X/m4Pf17CfTwjRgnlKz/7wn7QW0+c5e1vvSceEGMbp79fQ5MmTWbx4MS+++GLgZH5FYd++fWzZsoVx48YREhJCfHw8N910E7m5uZXXffLJJ/Tq1Qu73U50dDSjR4+mtLSUJ554gnfeeYdPP/20sr/qJDkeeugh0tLScDgcdOjQgcceewzvz75nPv/8cwYMGIDNZiMmJoaJEydWvud2u3nooYdISUnBarXSqVMn/v3vf9f476O6al4eXLQoWlQUWkwMvtw8zGc57iDYTJGRhI4dS/Hnn1P40UfY+/QJSrV5uzOEoWMuRS8vx19SzLL//Jsfli9m08KvuOqRJwmLabjPKIRooZ5OOvv7V78NPY5/sX/7JHz/8pnbJmXAnYsCfy7Lg792PPX9J4pqNLUXX3yRnTt30rNnT5588kkAzGYzAwcO5I477uBvf/sb5eXlPPTQQ1xzzTV8++23ZGVlcf311/Pss88yceJESkpKWLp0KYZh8OCDD7Jt2zaKi4t56623AM56aPIJoaGhvP322yQlJbF582amTJlCaGgov//97wGYN28eEydO5JFHHuHdd9/F4/HwxRdfVF5/8803s2LFCl566SXS09PZu3fvKcFbsEkw1MopqoolORl/Xh6G19uga4fCr7iCkq+/xrN7N+Xr1uHo3z9ofSs2G0ZhAUmpHdi7OROTxUJIVDQQKAobjMBLCCGamvDwcCwWCw6Hg4SEBACeeuopMjIyePrppyvbvfnmm6SkpLBz505cLhc+n49JkybRrl07AHr16lXZ1m6343a7K/urjkcffbTyz6mpqTz44IN89NFHlcHQn/70J6677jqmT59e2S79+PrRnTt3MmvWLBYsWFB5FE+HDh1q+ldRIxIMCbTIyEB2KCcHc1x8w40bHk7ouHEUz51L2dq1wQ2GFAU0E106daPLC3+nrKgIVdUwDIPZf36CxE5dGHD5lZgtUsNMCFFD/3fk7O9rJ/1cGfk4jJh25rbKSatVHNHn7rsWNm7cyHfffUdISMhp7+3evZuLLrqIUaNG0atXL8aOHctFF13EVVddRWRkZK3HnDlzJi+99BK7d++uDLZO3gCVmZnJlClTqrw2MzMTTdMYPnx4rcevKQmGxE/ZoZxcdI8H1WJpsLHDL7sMe8+e2Oq4o6wqqtOJr7AQR8eO2JKSAdi/aQP7MtexL3MdWxcv5MJbptCx/yDJFAkhqs/irH5bkwWo5s9URalZ39XkcrmYMGECf/nLX057LzExEU3TWLBgAd9//z1ff/01L7/8Mo888girVq2iffv2NR5vxYoV3HjjjUyfPp2xY8cSHh7ORx99xPPPP1/Zxn6Wot1ne6++yAJqAQSyQ6a4OPwFBQ07blhY5XohQ9cxdP3cF1WTardjlJWdUri1Xe8MLr3/IUKiYyjOOcanzz3F7Gf+QP6RQ0EbVwghGpPFYsF/Urmlvn37snXrVlJTU+nUqdMpD6czEHwpisLQoUOZPn06GzZswGKxMGfOnCr7O5fvv/+edu3a8cgjj9C/f386d+7M/v37T2nTu3dvFp6hEkGvXr3Qdb3KY3nqiwRDAgj8QzAnJ6GoCrrb3eDjl61fz5Hf/Y6ylSuD1qeiqhhwSuFWRVHoMvgCbpvxBoMmXoNmMrFv43q+e+efQRtXCCEaU2pqKqtWrWLfvn3k5uZyzz33kJ+fz/XXX8+aNWvYvXs3X331Fbfeeit+v59Vq1bx9NNPs3btWg4cOMDs2bPJycmhW7dulf1t2rSJHTt2kJube9qusJ/r3LkzBw4c4KOPPmL37t289NJLlYHVCX/4wx/48MMP+cMf/sC2bdvYvHlzZeYqNTWVW265hdtuu425c+eyd+9eFi1axKxZs+rnLwwJhsRJtIgIzHFx+AsbNjsE4Nm1C+/+/RTOmhXUArKqw4k/N++0siNmm43zr7uZW55/jY79BzH8F7cBoPv97Fqz8qxnaQkhRFP24IMPomka3bt3JzY2Fo/Hw/Lly/H7/Vx00UX06tWL+++/n4iICFRVJSwsjCVLljB+/HjS0tJ49NFHef755xk3bhwAU6ZMoUuXLvTv35/Y2FiWL19+1vEvu+wyfvOb33DvvffSp08fvv/+ex577LFT2owYMYKPP/6Yzz77jD59+jBy5EhWr15d+f7rr7/OVVddxd13303Xrl2ZMmUKpaU1P2qgump8AnVjkBOoG46voIDyjRtRQ8NQrQ23uFgvLeXQ3Xejl5aSMH06th49gtKv4fPhz8/DnpGBqRqLATfM/5xv3/o7yV17cPHdvyEivvq7J4QQQjRPsoBanEKLiMAcH4/3yBHUBgwEVKeT6LvuwhQfj7UWC/bO5OTCrdUJhgzDwGSxkntwH5ZGWMQnhBCi4UlmSJzGX1hIWeZG1JAQVJutsadTZ76CAlS7HUffjGoVbi3OzSH/0AFS+/QDYOV/P8IREUHPC8egqlp9T1cIIZq0p59++pQzi052wQUX8OWXXzbwjOpOgiFRpYrt2/EeOoQpIbFBxzW8Xkq+/ZbS5ctJePxxFFPdk5e6x4NeXIyjX1+00NAaXZt3+CDv/u5edL+fLoMv4NL7H6rzfIQQojnLz88nPz+/yvfsdjvJyckNPKO6k9tkokrmxES8x46hl5ejNuDtIsPvp3DmTPTiYlyLFxM6alSd+1QtFvxeL3pxcY2DoYj4RIbdeBvff/w+3YeNrHy9otSFzXn6AWZCCNHSRUVFVaskR3Miu8lElbTwcMwJifgLC4J69s+5qDYb4ceL9RX9979BKyCrWCx4c2pe10Yzmeh3yeVMeeVNOvQdAMDezHX8857bWP/Fp+hB3PkmhBCicUgwJM7I0q4tpqgofDnZDTpu6EUXoUVE4MvOxvXdd0HpU3U48JcUo5eV1ep620nH2G9d9A2e8jK+e+ef/OehX3Fw66agzFEIIUTjkGBInJFqs2Ht3BnV4cB3hvvD9TKu1Ur4pEkAFAYpO6TYbBgVFfhPOo26tsb/6kHGTLkXW2gYuQf3M+vJ/+N/L/wFd1n9nYEhhBCi/kgwJM5KCwvD1qkT6Dp+l6vBxg0ZPRotKgp/URHuH3+sc38nCrf68/Lq3JeqavQefTG3vfB30i+6BEVR2bFiKduXL6lz30IIIRqe7CYT1eI+eBD39h1oUVENdhhjxQ8/YIqPxxQdHZT+/KWl4Pfh6NcvqJ/hwJZNGIZOu159gtanEEKIhiOZIVEtluRkLG3b4s/LPa20RX2xde9eGQgFo0RHVYVbg6Ftz96VgZC3ogJ/A/39CCFEU7Rv3z4URSEzM7Oxp1JtEgyJalFUFWv7VEyJifhycxqsdpfudlPw4Yccvv/+OheQrapwazDtzVzH2w/ezfovPq2X/oUQojpGjBjB/fffH7T+Jk+ezBVXXBG0/poiCYZEtSkWC7aOHdHCw/Hn1nybeq3G1DRKly7Fl5VFyfz5de7vTIVbg6G0sIDinGy+/+QDinMbdgeeEEKI2pNgSNSI6nBg7dQJxWzCX1RU7+MpJhPhV10FQMnChXU+80h1ONDLSoOyq+znegwbSduevel78QTsIbK2TYiWqsxbRpm3rDJDXu4rp8xbhl8P3M53+92Uecvw6oGdsF6/lzJvGR6/BwCf7qPMW0aFrwIA3dAr+/z5GDU1efJkFi9ezIsvvoiiKCiKwr59+9iyZQvjxo0jJCSE+Ph4brrpJnJP+qX2k08+oVevXtjtdqKjoxk9ejSlpaU88cQTvPPOO3z66aeV/S1atKjG81q8eDEDBw7EarWSmJjIww8/jO+kX0rPND7AokWLGDhwIE6nk4iICIYOHcr+/ftrPIezkWBI1JgpMhJrp04Y7opan9tTEyHDhxN5yy0k/fnP1aotdjaKyYTh9+MvLg7S7E7qW1W56pGnuOCGyZhbQE03IUTVBn0wiEEfDKLAXQDA9f+7nkEfDGJ99noApi2dxqAPBvHJzk8A+OfmfzLog0E8u+ZZABYeWMigDwZx1zd3AbCncA+DPhjExf+9+LQxaurFF19k8ODBTJkyhaysLLKysggNDWXkyJFkZGSwdu1a5s+fz7Fjx7jmmmsAyMrK4vrrr+e2225j27ZtLFq0iEmTJmEYBg8++CDXXHMNF198cWV/Q4YMqdGcDh8+zPjx4xkwYAAbN27k9ddf59///jdPPfXUOcf3+XxcccUVDB8+nE2bNrFixQruvPPOwA7hIJJyHKJWTPHxWMrKce/ehWI2o5jN9TaWommET5gQvP5sdnw5uVhSUuocXJ3W9/H+SgsLWDV3FhdcfwtmqwRGQoiGER4ejsViweFwkJCQAMBTTz1FRkbGKcVV33zzTVJSUti5cyculwufz8ekSZNo164dAL169apsa7fbcbvdlf3V1GuvvUZKSgqvvPIKiqLQtWtXjhw5wkMPPcTjjz9OVlbWGcfPz8+nqKiISy+9lI4dOwLQrVu3Ws3jbCQYErWiKAqWdm0x3BV4Dh3CFBePotVvRXdvdjZF//0vpvh4Io4fylgbqtOJXlyMXlpa41pl1WEYBp889Si5B/djsTk4/7qbgj6GEKLxrLphFQB2U6Bu44eXfohhGFi1wJEdz1zwDE8NfQqzFvglcUqvKUzuMRmTGvjKHdV2FKtuWIWqBH556hDRobLPn48RDBs3buS7774jJOT0eoq7d+/moosuYtSoUfTq1YuxY8dy0UUXcdVVVxEZGRmU8bdt28bgwYNPyeYMHToUl8vFoUOHSE9PP+P4UVFRTJ48mbFjxzJmzBhGjx7NNddcQ2JicIuIy20yUWuKpmHp0AFTTAz+Bthh5t65E9fChRTNnRs4M6iWVIsF43gl+/qgKApDrrkRgIM/bEbXpX6ZEC2Jw+zAYXZUfrnbTXYcZgeaGviF0KpZcZgdmNVAMGTWzDjMDiyaBQCTasJhdmAzBbLGqqJW9vnzMYLB5XIxYcIEMjMzT3n8+OOPDBs2DE3TWLBgAV9++SXdu3fn5ZdfpkuXLuzduzco45/LucZ/6623WLFiBUOGDGHmzJmkpaWxcuXKoM5BgiFRJ6rVGijZ4XTir+eSHc7BgzGnpGCUlVH8v//VqS/FasUbhNOoz6TTgMFc8fvHuPaJZ1DV+s2YCSHEySwWC/6Tzmbr27cvW7duJTU1lU6dOp3ycDqdQOCXuKFDhzJ9+nQ2bNiAxWJhzpw5VfZXU926dWPFihWn/MK8fPlyQkNDadOmzTnHB8jIyGDatGl8//339OzZkw8++KDW86mKBEOizrSQEKydO4NCvezSOkHRNCKOL/gr/t//6jSW6nDgLyqqtwXgiqLQsd8gVFXD0HWKso/WyzhCCPFzqamprFq1in379pGbm8s999xDfn4+119/PWvWrGH37t189dVX3Hrrrfj9flatWsXTTz/N2rVrOXDgALNnzyYnJ6dybU5qaiqbNm1ix44d5Obm4q1hvci7776bgwcPct9997F9+3Y+/fRT/vCHP/DAAw+gqupZx9+7dy/Tpk1jxYoV7N+/n6+//poff/wx6OuGJBgSQWGKjsbaoSNGqQu9oqLexnEMGoQ5NRWjvJzizz+vdT/BLNx6Nq78PGZOf5gPH/udFHIVQjSIBx98EE3T6N69O7GxsXg8HpYvX47f7+eiiy6iV69e3H///URERKCqKmFhYSxZsoTx48eTlpbGo48+yvPPP8+4ceMAmDJlCl26dKF///7ExsayfPnyGs0nOTmZL774gtWrV5Oens7UqVO5/fbbefTRRwHOOr7D4WD79u1ceeWVpKWlceedd3LPPffwy1/+Mqh/Z1KbTASNYRi4d+/Gs2dPYEG1qX7W55etXk32s89iTk0l6dlna70jzJudjSUhHlv37kGe4U98Xi/v/u5eCrIOk3HxBEbeGtx/wEIIIepOMkMiaBRFwdquHeakZHw52XU+IPFM7AMGEPvAA3U+d0h1OvEVFqJ7PEGc3alMZjOjbgucJZL51TyO7dlVb2MJIYSoHQmGRFApZjPWjh3QIqPw5ebUzxiKgnPIkMrMU22LuFYWbq2nXWUntOvdhy5DhmEYOt/861XZXSaEaNaefvppQkJCqnycuLXW3MhtMlEv/EVFlG/ZgqEbmIJ0VsXPefbvp+C99zAnJxM1eXKt+vAezcKSmoqtU6fgTu5nXAX5vPWbqXjKyxh9x92kjxlfr+MJIUR9yc/PJ/8Mu4ftdjvJyckNPKO6k0MXRb3QwsOxdupMxQ9b0UtLUY9v3wwmf0EB5Rs2ULF1K2GXXYYpKqrGfVQWbk1Nrbc1TgAhkVEMvfYmdq9bRUqP9HobRwgh6ltUVBRRtfh525TJbTJRb8zxcVg6dMBfXIzudge9f1t6OtYuXTA8HkqXLq1VH/VZuPXnMsZewlWP/JGopOb3W5MQQrRkkhkS9cqSkoJRUYFn/wGU+OCW7FAUhchbbkF3ubBnZNSuj5MKt9bX7bzKsY4v9tb9fjbM/5z4Dp1o061nvY4phBDi3CQzJOqVoqpY27fHFB+HPyc76CU7bGlpOPr2rVMF4xOFW+tr99vPrZo7i0Xv/otv/vUafp+vQcYUQghxZhIMiXqnWCxYO3ZCDQvDn5sb9P4Nw6Bs7VqOTJuGNzu7xterTie6y4Veh3pnNZExdgL2sHBKCwvIP3ywQcYUQghxZhIMiQahhTixduoEmoa/qCiofSuKQvEXX+D58UeK/vvfGl9f34Vbf84WEsJlv/0/bv3bG8S2a98gYwohhDgzCYZEgzFFRWHr1BHDXYFeXh7Uvk/ULHN99x3eozWvA1bfhVt/rk3XHjjCwgEoPCZ1y4QQojFJMCQalCkxEUtqKv7CAowaFvs7G1vXrtj79AFdr112qJ4Lt57J4vfe5M1f38nudasbdFwhhKiO1NRUXnjhhaD0tWjRIhRFobCwMCj9BZMEQ6JBKYqCpW1bLElJ+HJzgrpoOeLaawFwLV6MNyurZvNqoMKtVTEMnW/f+jt+X/CCQyFE6zVixAjuv//+oPS1Zs0a7rzzzqD01ZRJMCQanGIyYenYEVNUFL6cmi94PhNr587Y+/UDXad8/fqazUlRQDPhP8OpqvVlyFU30LZnOmOm3INmMjfo2EKI1skwDHzV3MkaGxuLw+Go5xk1PgmGRKNQbTasaWmoDge+IAYgkTffTOKzzxJ2ySU1n5PTia+goF4Lt/6c2Wbj6sf+RGp63wYbUwhRN3pZWZWPE3USDV0/5fUTDK+36mtPWkOpezw/vV6Ln0WTJ09m8eLFvPjiiyiKgqIovP322yiKwpdffkm/fv2wWq0sW7aM3bt3c/nllxMfH09ISAgDBgzgm2++OaW/n98mUxSFf/3rX0ycOBGHw0Hnzp357LPPajzPE/773//So0cPrFYrqampPP/886e8/9prr9G5c2dsNhvx8fFcddVVle998skn9OrVC7vdTnR0NKNHj6a0lruCaxwMLVmyhAkTJpCUlISiKMydO/ec1yxatIi+fftitVrp1KkTb7/9di2mKloaLTQ0UBNM1/G7XEHp05KcjLVDB6DmBVwbqnDrmexZv4b5r70Q9LOYhBDBtaNvvyofZWvXAeA9cOCn1wcOqryuYNasKq/be/XVlW2yn3uu8vXs556r8dxefPFFBg8ezJQpU8jKyiIrK4uUlBQAHn74Yf785z+zbds2evfujcvlYvz48SxcuJANGzZw8cUXM2HCBA4cOHDWMaZPn84111zDpk2bGD9+PDfeeOMZa5Wdzbp167jmmmu47rrr2Lx5M0888QSPPfZYZYywdu1afvWrX/Hkk0+yY8cO5s+fz7BhwwDIysri+uuv57bbbmPbtm0sWrSISZMm1frnZ42DodLSUtLT03n11Ver1X7v3r1ccsklXHjhhWRmZnL//fdzxx138NVXX9V4sqLlMcXGYunYAcNVEtSSHSULFnDo3nvxnOMf9ckUVcUAfI2wuK+0sIDPZzzD1sXfsH354gYfXwjRMoSHh2OxWHA4HCQkJJCQkIB2/OT/J598kjFjxtCxY0eioqJIT0/nl7/8JT179qRz58788Y9/pGPHjufM9EyePJnrr7+eTp068fTTT+NyuVi9uuabQGbMmMGoUaN47LHHSEtLY/Lkydx777389a9/BeDAgQM4nU4uvfRS2rVrR0ZGBr/61a+AQDDk8/mYNGkSqamp9OrVi7vvvpuQkJAazwNqUY5j3LhxjBs3rtrt33jjDdq3b1+Z+urWrRvLli3jb3/7G2PHjq3yGrfbjfukL8biRvpNXTQMS3IyRnk5nn37UOLig1IwtXzTJvw5ORTOmkXcgw9W+7qGKtz6c86ISAZNupblM//Donf/RfuM/tictftHLYSoX13Wr6vydcVqBcDctm2VbSKvuYaIiROruPCnE/TjHnyQuBOLn4P8M6h///6nPHe5XDzxxBPMmzevMrgoLy8/Z2aod+/elX92Op2EhYWRXYsDb7dt28bll19+ymtDhw7lhRdewO/3M2bMGNq1a0eHDh24+OKLufjiiytvz6WnpzNq1Ch69erF2LFjueiii7jqqquIrGVZpXpfM7RixQpGjx59ymtjx45lxYoVZ7zmmWeeITw8vPJxIsUnWqbKkh2JiYEdZkG4TRRxzTWgKJStW4evoKDa1zVk4daf6z9hEpFJbSgrKmT5zPcafHwhRPWoDkeVjxO1FxVVPeX1ExSzuepr7faf+rZYfnrdYgnqvJ1O5ynPH3zwQebMmcPTTz/N0qVLyczMpFevXnjOsVbJbD51s4eiKOj1UM4oNDSU9evX8+GHH5KYmMjjjz9Oeno6hYWFaJrGggUL+PLLL+nevTsvv/wyXbp0Ye/evbUaq96DoaNHjxIfH3/Ka/Hx8RQXF1N+hoP3pk2bRlFRUeXj4EEpWdDSKWYzto4d0cLD8eXk1Lk/S0oK0VOn0uall2pUgPXkwq0NzWQ2M/r2uwDY+PUXHNuzq8HnIIRo/iwWC/5qrJlcvnw5kydPZuLEifTq1YuEhAT27dtX/xM8rlu3bixfvvy0OaWlpVXe2jOZTIwePZpnn32WTZs2sW/fPr799lsgEIQNHTqU6dOns2HDBiwWC3PmzKnVXJpk1Xqr1Yr1eLpRtB6qw4G1Uycqtm7FX1SEFh5ep/5CR42q1XUnCrdaUlIqK803lLY90+k6dDjbv1/Cwa2biO/QqUHHF0I0f6mpqaxatYp9+/YREhJyxqxN586dmT17NhMmTEBRFB577LF6yfCcyW9/+1sGDBjAH//4R6699lpWrFjBK6+8wmuvvQbA//73P/bs2cOwYcOIjIzkiy++QNd1unTpwqpVq1i4cCEXXXQRcXFxrFq1ipycHLp161arudT7T/qEhASOHTt2ymvHjh0jLCwM+0mpQSEATJGRWDt1CpTsCMJp0HppKYWzZpFTgxNUG7pw68+NuPkObnjqOfpPmNQo4wshmrcHH3wQTdPo3r07sbGxZ1wDNGPGDCIjIxkyZAgTJkxg7Nix9O3bcMd89O3bl1mzZvHRRx/Rs2dPHn/8cZ588kkmT54MQEREBLNnz2bkyJF069aNN954gw8//JAePXoQFhbGkiVLGD9+PGlpaTz66KM8//zzNVrTfDLFqMMCDUVRmDNnDldcccUZ2zz00EN88cUXbN68ufK1G264gfz8fObPn1+tcYqLiwkPD6eoqIiwsLDaTlc0E4Zh4Nm3D/euXWjRMXW6b+7NyuLwr38Nuk7C009jS0ur3nVHjmDv0R1zcnKtxw6GilIXhq5jD5X/3wshRH2pcWbI5XKRmZlJZmYmENg6n5mZWRl5Tps2jZtvvrmy/dSpU9mzZw+///3v2b59O6+99hqzZs3iN7/5TXA+gWhxKkt2tGmDPy+3xucFncycmEjIiBEAFM6cWf05NHDh1qrs3bCWt34zlUXv/LNR5yGEEC1djYOhtWvXkpGRQUZGBgAPPPAAGRkZPP7440Bg7//JKbn27dszb948FixYQHp6Os8//zz/+te/zritXggARdMCJTtiYvDnZNdph1n4lVeCplGxcSMV27ZV65rGKtx6MltoKGXFRfyw9DsObd/aaPMQQojqmDp1KiEhIVU+pk6d2tjTO6s63SZrKHKbrPXyu1xUbNmC7vZgio6udT+5f/87rgULsPXsScITT5yzvWEY+I5mYe/dG/PPdkM2pEXv/gt7aBj9J0yU2mVCiCYtOzv7jOcChoWFERcX18Azqj4JhkST58vLo3zrVhSzBS00tHZ95ORw6L77UK1WkmbMqFZg5c3OxpKYgK2WuxOEEEI0D1KoVTR5puhobB07YpS60CsqatdHbCxxv/sdbV57rdoZpsYo3HomRdlH+XzGMxTn1PyUVyGEEGcnwZBoFkxJSZhTU/Hn52F4vbXqw9GvH+rxE1irsyhbtdsxShuvcOvJvvnXa+xctZxv3/5HY09FCCFaHAmGRLOgKArWdu0wJyUHSnbU8mAwf2EhuW+8wdHp08+5KFtRVQylcQq3/tzwm25H1TQ85WV4a5kdE0IIUbUmeQK1EFVRzGasHTugV1Tgy83BHFfzhc2GYVC6ZAmGx0N5ZiaO47siz6SxCrf+XExKO258+m/EtmuPclJRRyGEEHUnmSHRrKh2O7bOnVCt1hoVYD3BFBlJ6PFjHVzffHPu8RqxcOvPxaV2CBRE9Ps5vKN6RwQIIYQ4NwmGRLOjhYdj7dQZfF78tSiZEX7FFUT/8pfE3n//Ods2ZuHWqrjLSnn//x5g1vRp5B2SAsZCiOBLTU3lhRqUMGoJJBgSzZI5Pg5Lhw7oxcXobneNrtXCwwkdMwbFXL1ze04Ubq3tOqVgsjqchERHo/t9LPz3a3U6jFIIIUSABEOi2bKkpGBpm4I/L69WJTvce/Zw7M9/pnTVqrO2a+zCrT83cvKdmCxWDv6wme3LFjX2dIQQotmTYEg0W4qqYm3fHlN8XK1KdpStWkX52rUUzpx51qyParFgeD1NYos9QHhcAudNuhaARf/5NxWlrkaekRCti9ftr9bD7w/8XPH79MBzb+C57ter3UdN/eMf/yApKQn9Zz/TLr/8cm677TZ2797N5ZdfTnx8PCEhIQwYMIBvqrF+8kxmzJhBr169cDqdpKSkcPfdd+Nynfozafny5YwYMQKHw0FkZCRjx46l4PiaT13XefbZZ+nUqRNWq5W2bdvypz/9qdbzqS3ZTSaaNcViwdapE+VuN/7cXEyxsdW+NmzCBIq//BLvgQOUrVyJc8iQs4wTKNza2FXsT+g/YSI/LPmW/COHWPHxB1w4+c7GnpIQrcY/fr24Wu2GXZdGrxFtWPflPtbM20fP4ckMv74LezJz+eqfW6rVxz1vjKzR3K6++mruu+8+vvvuO0aNGgVAfn4+8+fP54svvsDlcjF+/Hj+9Kc/YbVaeffdd5kwYQI7duygbdu2NRoLQFVVXnrpJdq3b8+ePXu4++67+f3vf89rr70GQGZmJqNGjeK2227jxRdfxGQy8d133+E/ns2fNm0a//znP/nb3/7G+eefT1ZWFtu3b6/xPOpKgiHR7KlOJ9bOnSnfsgV/URFaeHi1rtNCQgi/9FIKZ82icNYsHIMGoWha1WOcVLhVdTiCOf1a0UxmRt1+N5lf/Y9+l05s7OkIIZqIyMhIxo0bxwcffFAZDH3yySfExMRw4YUXoqoq6enple3/+Mc/MmfOHD777DPuvffeGo93/0kbUVJTU3nqqaeYOnVqZTD07LPP0r9//8rnAD169ACgpKSEF198kVdeeYVbbrkFgI4dO3L++efXeB51JcGQaBFMkZHYOnWiYts29HILqt1erevCLrmE4nnz8B46ROn33xNywQVVtlNsNozCAvwlJU0iGAJo27M3bXv2buxpCNHq3Pni8Gq1U02BM8H6jUsl46J2qGrgeYc+MdXuozZuvPFGpkyZwmuvvYbVauX999/nuuuuQ1VVXC4XTzzxBPPmzSMrKwufz0d5eTkHDhyo1VjffPMNzzzzDNu3b6e4uBifz0dFRQVlZWU4HA4yMzO5+uqrq7x227ZtuN3uyqCtMcmaIdFimBISsKSm4i8sqHbJDtXpJOyyywAoX7v2jO0URQHNhL8WZxvVN5/Hw/cff8CmhfMbeypCtApmq1ath6YFvmI1kxp4bg48VzW12n3UxoQJEzAMg3nz5nHw4EGWLl3KjTfeCMCDDz7InDlzePrpp1m6dCmZmZn06tULTy1qMO7bt49LL72U3r1789///pd169bx6quvAlT2Zz/LL6Zne6+hSWZItBiKomBp2xajvBzPkSOY4uLPeNvrZGHjx2Np1w57v35nbac6nfjy89E9HlSLJVjTrrNtyxex4pMPsDqcdOw3CGdEZGNPSQjRiGw2G5MmTeL9999n165ddOnShb59+wKBxcyTJ09m4sTA7XWXy8W+fftqNc66devQdZ3nn38eVQ0EerNmzTqlTe/evVm4cCHTp08/7frOnTtjt9tZuHAhd9xxR63mECySGRItimIyYenUCVN0NL7cnGpdo9rtOPr3R1EUDMM44zb9plS49WQ9ho8ivkMnTFYrRdlHG3s6Qogm4MYbb2TevHm8+eablVkhCAQgs2fPJjMzk40bN3LDDTectvOsujp16oTX6+Xll19mz549/Oc//+GNN944pc20adNYs2YNd999N5s2bWL79u28/vrr5ObmYrPZeOihh/j973/Pu+++y+7du1m5ciX//ve/6/TZa0OCIdHiqFYr1s6dUR0OfPn51b6ufNMmsh56CNeiRVW+35QKt55MVTUuvf9hbp3xBklp3Rp7OkKIJmDkyJFERUWxY8cObrjhhsrXZ8yYQWRkJEOGDGHChAmMHTu2MmtUU+np6cyYMYO//OUv9OzZk/fff59nnnnmlDZpaWl8/fXXbNy4kYEDBzJ48GA+/fRTTMdrPT722GP89re/5fHHH6dbt25ce+21ZGdn1/6D15JiNIMjbIuLiwkPD6eoqIiwsLDGno5oJnw5OZRv/QHFZkMLCTln+6LPP6fgnXfQYmNp89JLVZ5Q7S8uRlFVHP37NWrh1rPJ+nEHce07oJmqd8K2EEK0dpIZEi2WKTYWS8cOGK6SapXsCL3oIrSICPw5OZRv3lxlm6ZUuLUqS95/iw8e/S1r/ze3sacihBDNhgRDokWzJCdjbtcOf14uhs931raq1Ur01Kkk/vnPOM6QNm5qhVt/LialHQCrZs+kwiUnUwshau/9998nJCSkyseJs4JaCrlNJlo8w+ulfPt2fEePYkpIDGyTrwNfQUFg0XXfDBS1af0+YRgGC//9Gt2HjZT1Q0KIOikpKeHYsWNVvmc2m2nXrl0Dz6j+SDAkWgW9rIzyrVvxl7gwx8Wdta3h9+NatAjXt98S//jjqFbrqX253eglJTj69UULDa3PadeZYRh1Dv6EEKKla1q/1gpRT1SHA1vnzqgWC/5z7QbTdQo//hj3jh2ULFhwel9Wa5Mq3FoVwzDYtnwxHz72IN6KisaejhBCNGkSDIlWQ4uIwNq5E4bHg15WdsZ2itlMxJVXAlA0Zw56FcHEicKtTZXP62HZh++Q9eMOVs7+qLGnI4QQTZoEQ6JVMcXFYenQHn9RIfpZjp8PufBCTHFx6EVFlHz11Wnvn1y4tSkyW6xcOPmXAKz93xzyDtWu7pAQQrQGEgyJVkVRFCwpKVjatAnsMDvDadOKyUT4VVcBUPTpp+jl5ae+b7NhuN1Ndos9QKf+g+jYfxC63883/36NZrA8UAghGoUEQ6LVUTQNS8eOmGJj8edknzFICBk+HFNCAnpZGRXbt5/ah6KAqjXJwq0nu/CWOzFZrBz6YQvbln7X2NMRQogmSYIh0SqpFgvWTp1QQ0Lxn6Fkh6JpxNx7L8kvvYQjI+P0Pk4q3NpUhcfFc96V16FqGiX5TXeNkxCi6UhNTeWFF16oVltFUZg7d269zqchNM16AkI0AC0kBGvnTse33JdUuU3e1rVr5Z8Nvx9F0yqfq3Y7/uxj6MXFqDExDTLn2uh/6RV06j+I6DZtG3sqQgjRJElmSLRqpuhobB07YpS6qtw1BoFDGws//pjD992Hv7S08nVFVTGgyZ5GfYJmMlcGQqWFBeQfOdTIMxJCiKZFgiHR6pmSkjCnpuIvyMfwek9voGmUfv89vuxsiv/3v1PeUh1OfNk55yz10RTs35TJW7+ZyhcvP4euV71wXAhxbt6KiiofJ/5dGbpe+Zrf5z3tOt9Jt9a9HneVfZ18XU384x//ICkpCV3XT3n98ssv57bbbmP37t1cfvnlxMfHExISwoABA/jmm29qNVZVNm/ezMiRI7Hb7URHR3PnnXfiOqk00KJFixg4cCBOp5OIiAiGDh3K/v37Adi4cSMXXnghoaGhhIWF0a9fP9auXRu0uZ2N3CYTrZ6iKFhTUzEq3HizjmCKTzilzIaiqkRcey05zz2H67vviLjyysqK9arDgT8/D39JCabIyMb6CNUS0zZwdP6xPbvYsXwJ3S64sJFnJETz9NItV1X5+jWPP01Kj94UHsvizfsDR1sMu/FWBlwWOLfs73fdgruslLRBQ5nwwDQA5j77Rw5szjytr0ETr+H8626u8dyuvvpq7rvvPr777jtGjRoFQH5+PvPnz+eLL77A5XIxfvx4/vSnP2G1Wnn33XeZMGECO3bsoG3but1KLy0tZezYsQwePJg1a9aQnZ3NHXfcwb333svbb7+Nz+fjiiuuYMqUKXz44Yd4PB5Wr15deUr+jTfeSEZGBq+//jqappGZmYnZbK7TnKpLgiEhCGylt3bsgF5RgS8nB3N8/CnvOwYOJOrWW3EOH14ZCJ24ztD1ZhEMOSMiGXHzHXg9broMHdbY0xFC1IPIyEjGjRvHBx98UBkMffLJJ8TExHDhhReiqirp6emV7f/4xz8yZ84cPvvsM+699946jf3BBx9QUVHBu+++i9PpBOCVV15hwoQJ/OUvf8FsNlNUVMSll15Kx44dAejW7acaigcOHOB3v/sdXY+v1ezcuXOd5lMTEgwJcZxqt2M7vqDaV1BwSnCjqCphl1xS5XWK1YYvOwdLmzZNrnDrz/W8cEzln6VumRC186t3Pqnydc0SyGJExCdWtlFNP226+OXr7wCc8nPiit8/Bvrpx3ucfF1N3XjjjUyZMoXXXnsNq9XK+++/z3XXXYeqqrhcLp544gnmzZtHVlYWPp+P8vJyDhyo+8Gs27ZtIz09vTIQAhg6dCi6rrNjxw6GDRvG5MmTGTt2LGPGjGH06NFcc801JCYmAvDAAw9wxx138J///IfRo0dz9dVXVwZN9a1p/+QWooFp4eFYO3UCv++UxdIn+PLyyPvnPyn48MPK11SHA93lQi8pwdD1ZnG4Yd6hA3z85P9xYMumxp6KEM2O2War8qGqgQBGUdXK1zST+bTrTBbLT69ZrFX2dfJ1NTVhwgQMw2DevHkcPHiQpUuXcuONNwLw4IMPMmfOHJ5++mmWLl1KZmYmvXr1wtNAR4S89dZbrFixgiFDhjBz5kzS0tJYuXIlAE888QRbt27lkksu4dtvv6V79+7MmTOnQeYlmSEhfsYcF4deUYF7x04Uk+mUqvWeffso+eorFIuFsHHj0CIiUK1W/Hl5lP/wQyDToiigaaCoKJoa2I6vnvRfkynwX1UN/FdRQFUD1ykqinrycyXQ7nibU9r+7HlNslKZX3/BwR82U1pYwM1/fblOP3iFEE2LzWZj0qRJvP/+++zatYsuXbrQt29fAJYvX87kyZOZOHEiAC6Xi3379gVl3G7duvH2229TWlpamR1avnw5qqrSpUuXynYZGRlkZGQwbdo0Bg8ezAcffMB5550HQFpaGmlpafzmN7/h+uuv56233qqca32SYEiIKljatMEoL8ezbz9KQkLl+UL2vn2xdO6M58cfKZo7l6jJkwEwxcaiezwYug6GAT4PGAa6YQSeGwacyBqd9FAUBQMDjEB8g6Icb3P8OQqoSmWghMJPAdNJ7ykn3tNMgfc07fQgTDOhaIEAbOAFo9ixfDERUTGUHjiAPST0p8DqRJBVGWipgblU9d6J50KIJuXGG2/k0ksvZevWrfziF7+ofL1z587Mnj2bCRMmoCgKjz322Gk7z+oy5h/+8AduueUWnnjiCXJycrjvvvu46aabiI+PZ+/evfzjH//gsssuIykpiR07dvDjjz9y8803U15ezu9+9zuuuuoq2rdvz6FDh1izZg1XHi+aXd8kGBKiCoqqYm3fHr2iAn9ONlp8AoqioCgKkddey7GnnqLk668Ju+wyTFFRKGYzWj3sejCOB1FAlcHUidcC7QzwuU96rle2M05qH/iAMOny63A4nCh79lIOJwVgnBZ8/RR0nRQIQSAIUwOlSX7KgmnHgy4Njr92IiADBUVV0CIjUe32oP99CSECRo4cSVRUFDt27OCGG26ofH3GjBncdtttDBkyhJiYGB566CGKg3RWmsPh4KuvvuLXv/41AwYMwOFwcOWVVzJjxozK97dv384777xDXl4eiYmJ3HPPPfzyl7/E5/ORl5fHzTffzLFjx4iJiWHSpElMnz49KHM7F8VoBgsciouLCQ8Pp6ioiLCwsMaejmhF9NJSyrduRS8twxQbCwQClKOPPYZ7+3ZCx40j+vbbG3mWdeP3+dizfQude/apfM04KZA6LZj6+Wsnnv/smsrXAHQdRQFDUcDvxxQXh61bt1NuQQohRGORzJAQZ6E6nVg7d6Z8yxb8RUVo4eEoikLEtddybPp0yjMzMXy+U7bbNyd+v5+P//Uy+TlHMZnNtO/SA+C09UfBvBFm+P34so/hNpmxpXVGOWkxqRBCNAbZTSbEOZgiI7F16oThrkAvLwfA3qsXsQ8+SPKMGc02EALQNI3UtMA5H0u/+gxvA+woUTQNU2wc3iOHce/e3SxO725ofq9OzsES/P7grOUQojbef/99QkJCqnz06NGjsacXVHKbTIhqMAwDz959uHfvwhQTi/Kz9UE/L+LanHi9Hj56fQYlRQVkDBnB4FHjGmRc3ePBn5uLpX0q1o4dm/wZTfXBMAzKijzkHnaRd8hF7iEXeYddFB4tQ9cNrntsINHJIY09TdFKlZSUcOzYsSrfM5vNtGvXroFnVH+a76+0QjQgRVGwtE3BKC/DcyQLU1wciqbhOXyYgvfeQwsLI+auuxp7mrViNlu44OLL+GLmO2xcuYQuvTKIikuo93FViwWiowM79kwmLKmpLX5nWv6RUo7tKya+fRhRiU6WzvyRzYuqLpxrdZgoLXJLMCQaTWhoKKGhoY09jQZRq1/FXn31VVJTU7HZbAwaNIjVq1eftf0LL7xAly5dsNvtpKSk8Jvf/IaKM1QIF6KpUkwmLJ06YYqOwpebA4BeUkL5mjW4vv2W8k3N9wDD1LTupKZ1R9d1Vn73VYONq1qtaOHhePbswXP4cIONW58Mw8BV4Gb/ljzWf7Wfr/+9ldxDJQCs/t9evn13G/s25wIQHmdHUSAywUGn/nEMurwDl9zdm5ufHsLtz19A2+7RjflRhGg1apwZmjlzJg888ABvvPEGgwYN4oUXXmDs2LHs2LGDuLi409p/8MEHPPzww7z55psMGTKEnTt3MnnyZBRFqdxuJ0RzoVqtWDt3Rt+yBV9eHrauXbFnZFC+YUPl2hfD70cvKUGLiGjcydbQBWMvw+50ct6FFzfouKrDgeH34/nxR1STCXNC/WelgsXn9ZN/pJS8wz/d4so7VEpF6akVx5PTIohpE0pix3AqXB6c4YFddN2GJNLj/CRMluZ5i1WIlqLGa4YGDRrEgAEDeOWVVwDQdZ2UlBTuu+8+Hn744dPa33vvvWzbto2FCxdWvvbb3/6WVatWsWzZsmqNKWuGRFPjy82lfMtWFKsVFIXiefOIuOoqFE2jbM0asp9/HsfAgYRedBG2Hj2a5e2fhq5d5i8qwvD7sXfvhikmpsHGrS6f18+h7QUU5ZSTPjIFv1/nn/cvwe89fZGzoipExDuISXYS3SaE1F4xcrtLiCasRpkhj8fDunXrmDZtWuVrqqoyevRoVqxYUeU1Q4YM4b333mP16tUMHDiQPXv28MUXX3DTTTedcRy3243b7a58HqwDoYQIFlNMDJaOHfDs2IEaGUXktddWvlfxww/g81H2/feUff895uRkQi+6COfw4WghTf8L0eN2s2bJAnS/nwsuvrzBxtXCw/Hl5VGxcyc2TTulUG5D8nn85GeVBjI9h1x43H5G3dwNv1dn3quBW6FdBiVgc5oJj7VTVuQhuk0IMckhgf+2CSEy0YHJLNkeIZqLGgVDubm5+P1+4uPjT3k9Pj6e7du3V3nNDTfcQG5uLueffz6GYeDz+Zg6dSr/93//d8ZxnnnmmQY7dVKI2rIkJ2NUVODZsxclPr5yi33ULbfgHDaMkq+/pnTpUryHD5P/1lt49u0j5p57GnnW55Z79DAbVy4FFNJ69SU+OaXBxjZFR+PLycG9cydK9+5o9bh488TanpN3ceUddlF4rIyT8+WqqjDi+i5YHWZSukdhc5rxefzgNDPpd/2w2LRmmfkTQvyk3neTLVq0iKeffprXXnuNQYMGsWvXLn7961/zxz/+kccee6zKa6ZNm8YDDzxQ+by4uJiUlIb7gSxEdSiqijU1Fb2iAt/Ro5jiEyq3h1vbt8f6y18SddNNuJYupeSrrwgZPRoA3e0m+5lncJ5/Ps7zz0e12RrzY5wmqV0H0nr15eihffj9DX8GkBYTgy/7GBU7dmLv3g3V4QhKv4XZZRzZWUhIpJW2PaLZtjyL796r+pc4W4iZmDYhlRmfE6sJLvtVn1PaWe2yIVeIlqBG/5JjYmLQNO20cweOHTtGwhkWPT722GPcdNNN3HHHHQD06tWL0tJS7rzzTh555BHUKs4WsVqtWOWYftEMKGYzto4dKXe78WcfQ4uOOeUMItXhIGzsWEIvuqjytdLvv6diyxYqtmyhcNYs2rz+epM7o+iCiy9D00yY6qHe2rkoioIpNi4QEO38EVu3rtUu22EYBiX5FeQdz/TkHiqlfXoMXQYlsCczhxWzd9Oxbxxte0QTleREVRUiEx1EJ4eccqvLEWaRbI8QrUiNgiGLxUK/fv1YuHAhV1xxBRBYQL1w4ULuvffeKq8pKys7LeDRjv/gbwbnPQpxTqrDga1rNzz79uHNykJ1OFDDwk75Mj35z45+/dBvuomSBQuw9epVGQgVz5uHGh6Oc9Cg0w51bGhW209FVA/s3kF0XCLO0IbbvKCoamVA5DaZqizb4XX7K29t5R1yVR5c6Knwn9LOYtPoMiiBhPZhpHSLJD418Dni2oVy54vD0cyt77BHIcSpapzjfeCBB7jlllvo378/AwcO5IUXXqC0tJRbb70VgJtvvpnk5GSeeeYZACZMmMCMGTPIyMiovE322GOPMWHChMqgSIjmTgtxYuvWFVN0FO59+/AdzUKLjgkcLPjztmFhhF9+OWETJmAc3yigl5VR8OGHGBUV5IeFETJyJKFjxmD+2fq8hrZ60desXbqQzj37MGbi9Q069sllOxRNJasiitwjZfQcnow9xMLcGevJ3l9y2nWqphCZ4CS6jZOY5FASO4UDkNQ5kst+HXlSOxXkR5AQgloEQ9deey05OTk8/vjjHD16lD59+jB//vzKRdUHDhw4JRP06KOPoigKjz76KIcPHyY2NpYJEybwpz/9KXifQogmQNE0zImJaGFheA4cwHv4MLrVhhYRUeUtF0VVUezHMzCGQfjll1OyYAH+/HyK586leO5cbH36EHPXXZiiG+fwvdQu3Vm37Ft2bd3EwOEXER5Vv/PwenQK8n3k5/rIz/NRkOtj9MUxeA4dYvm3ORQV+EhoH05K9yiik0NwFbhPub0VnRxCZIIDzSTZHiFE9UltMiHqgaHr+HJy8Ozdh7+kGC0qulrrXgy/n/J16yj++msqMjNRw8NJeeMNFLMZ79GjKBYLpqioBvgEP9m0ejlJbdsTk5AUtD4Nw6Ck2E9B3vHA53jwU1LkP63tpVdFEhOhs2ZJIR5LKOmXdiE+NRy/T5egRwgRFBIMCVGP9PJyPAcO4j1yGFQNLTKy2gVJvUeP4s3KwpGRAUD2889TtmoVjgEDCJ80CWvHjvU59Sr5/T40rXY7qPz+QAAUEWkiL8fLpzPzq2xnd6hExZgCj2gTyW2t2OwqelkZuqsEa1oXLG2S6/IxhBDiFLIvVIh6pNrtWNM6Y4qKPL6W6ChaZCSq3X7Oa80JCZWlKU6U+EDXKVu1ipARI6Bjx8DrZWX1eh4PgGHo/LB+NWuXLmTiLXcRFlmz7FR+rpcF8wpRFIUrb4wmIsqEyawQHqERFW0i8njgExljxm6vOlg8UbbDvetHFLOp0ddTCSFaDgmGhKhnga3isahhYXgOHsR76BC6y4UWFVXtLfWKppHwxBN49u/HtXQp9r59ASjfuJHsv/4V5+DBhI4dizUtrZ62hCvs+mETpSXFLP3qU8ZfO/mc4xiGwdEjXhKTLYSGm9D9oCgGxUV+IqNM/GJKLKpas7lqoaH4dZ2KHTsDC6ybYNkOIUTzI7fJhGhgvrw83Hv34c/PQwuPQHU6a91X3ltvUTJvXuVzc2oqoWPGEDJsWLWyTzVRkJvNzL+/gK77ufjqm+nQtUeV7QzD4PABD+tWusjL8XHJlZHEJ1rIy/ESHmnCZKp7sObLy0Mxm7B3797sCuIKIZoeCYaEaASGx4Pn0GE8Bw9g+P2YomNqdfCiYRh4du0KlP5YvhzD4wEg5MIL66X0x8pv57N++XeEhIVz/V2/xWw5dVH40SOBIOjYkUDVdrNZYfDwUDp1DW5gBuDLyUF12LH16NEsar4JIZouCYaEaES+ggI8+/fjy85BDQur05e63+WidPFiSr7+muipU7F164bu8ZDz17/iHDoUx+DB1T7J+Uy8Xg8fvTGDksICMgYPZ/Do8QDk5XhZt9LFof2BYEzToFsvB737ObGdYQ1QXRmGge/YUbSIyKCW7RBCtD4SDAnRyAyvF09WFp79+zE8nkCWyFT75Xwn/kkrioJr8WJyX34ZCNT8avPqq3Uu/bFv5za++u97DBg2ho7dz2f9Khd7d7mPjwlp3e30GeDEGVL/Jxoauo4v+ximmNgale0QQoiTSTAkRBPhLy7GvX8/vqNHUZ0haEH4/7q/sJCShQsp+eYb7L17E3PXXQAUz5+PFhGBo3//WgVeZa4SCvItfP15YWWF9w5pNvoOdBIW0bD7Mgy/H192NubExCrLdgghxLlIMCREE2L4/XizjuLZvw+jvPy0wq916deoqEB1OtHLyzl4552B/iMjCRk1itDRo6u1M6u8TGfvrgq693bg8xnMens3TmcJF4zpSVRM49VTM3w+fNnHsLRti7VTpzpl1oQQrY/8xBCiCVE0DUubZLSIcDz79p+x8Gtt+lWO71ozdJ2wceMoWbgQf0EBRZ98QtHs2dj79iX6zjvPeMK112sw+/1c3G6DiEgNTT1GSc7buIssOJxdgMYLhhSTCS0mFs/Bg2AyYe3QodqHWwohhPy0EKIJ0kJCsHXvhr1nD1AVfEez0I8Xda1z304nkTfcQMobbxD7wAPYevYEXce9c2fl4Y3e7Gz8RUX4vAab1pfiKvFjNit07GIjJi6wPT4mIYmwiEjKy0rZnrk2KHOrC9ViQYuMwrN3H54DB2gGSW8hRBMht8mEaOL00tJA4dcjR8BiPWPh17rwHD6M78gRHAMGAHDsby/y436N/R0vxa3YSetu5/yRYfh8BppG5fhZB/ZSXFhAWq+MejrsseakbIcQoqYkGBKiGQgUfs3Fs28v/uJitMgoVJst6OPousHu7WWs/fow5aZwAJwWL/2HR9OhsxW9vBztDIdE6roOgNoEbk/5S0ow3BXYunWTsh1CiHOSNUNCNAOKqmKOj0MLCw0Ufj18CL20tEaFX8/GMAwO7HWzbqWLwnw/mMKxWXXS2Eafmy/AZDVTtmEDOc89h/P88wkdMwZrp06V12cfOcTiL2bTpXc/eg8cWuf51JUWGorf76di504UkwlTdHRjT0kI0YRJMCREM1KXwq9ncvigm3UrXORm+wCwWBV693XSvbcDkzmxsl35+vUYbjeuhQtxLVyIpWNHQi+6COf555OddYicrMMU5efSsVsvnKGNn8HVIiLw5eVRsWOHlO0QQpyV3CYTopnS3e7Kwq8Y1Kjw6wkV5Toz38nB7wOTWaFHuoOeGQ6s1tOzTYZh4N6+nZKvvqJ05UrwBYIn54gRRN99N7Pfeo2I6BiGjrkUu7PplMfwZmejOR1StkMIcUYSDAnRzPny8/Hs3Ysvr3qFX/NzvaxfXcrAoSGEhZtYv8qFx2OQ3s+B3VG9YMpfVITru+8oWbCAmLvvxtajB96yMvJffhnn0KE4Bw0KyvlIwSBlO4QQ5yLBkBAtQGXh10MHMXy+sxZ+/frzAg7t99Cxi43hY8LrNq6ug6IESn8sW0buCy/gUxUOtkvmgj/+GVM9LPKuDUPX8R07iik2Tsp2CCFO0/jbPoQQdaZYLFg7tMfeqxemqGh8x47hLykBoNTlZ/l3xWzJLAWg76AQUjtaSe9/9gxStcZV1cot9bZu3Qi76ipWp7VlW5iVzDXLAShZsICytWsx/P46j1eXeZri4vHlZOP+cReG19tocxFCND2SGRKihTlR+LV4xz62bPayY7eC3w9Wq8K1k2Mxmev3PKCdm9bzzacz0Uwmrr31Hop+/zBGWRlaTAyho0cTMmoUpsjIep3DmRheL76cbCzt2gXKdtSxaK0QomWQYEiIFsZT4SPzm4NkLtiP1x04+ycuTqX/+eEkJNV/EVPDMPjsvX9yeN9u2qZ2YrBuoXTRIvTjmSpMJiKuvprwK65olGBE93jw5+Viad9eynYIIQAJhoRoMXweP1uWHGbd/P1UuAK3gWJSQuh/fjhxWg5UVASt8Ou5FORmM/PvL6Drfi6++iZSO6RRtnIlJfPn4965E9XpJOlvfztjHbT6pldU4C8owJrWGUvbtk3m9GwhROOQc4aEaOYMw+CHZUdYM28fpYWB+mUR8Q4GXdaBjhmxKKqC35WMZ99+fEezUGx21PDweg0AImPiyBgynHXLvmX98kW079KDkGHDcF5wAaVLlwYOQjweCFXs3Im1Y8cGzRKpNhuEheHZvRvVZMKcLGU7hGjNJBgSopkydAPdb6CZVfZvyaO00E1IpJUBl7an63kJqNpPt39OFH71RUcdP6wxCy0qul53VfU9/0IURSH9vAsqAy9FUQgZNqyyjXvPHo4+9hjWtDRi7rkHc0JCvc3n51SnE0PXqfjxRzCZpGyHEK2Y3CYTohk6tD2fZR//SMe+cQy4pD15R1wc2lZAz2HJaOazr4HRy8rw7N9fr4Vfq+L3+9C0U3//Kl25ktxXXsGoqMCckkLS8883+Boef2EhhqFj795dynYI0UrJykEhmhF3WWAtULnLS97hUn5YdgTdrxOdFEL6qJRzBkIAqsOBtWtXbD17oVrM+I4eRa+oqLc5V5SX8d3/PuHz9/7Fz3/3cp53HkkzZmDr2ZOo22+vDIT8Lle9zefntIgI0A0qdu7EX1jYYOMKIZoOyQwJ0Qwc21fMqk93U1rk4dpHB6IAmQsP0m1IIjZn7RdE6xUVePYfwHv4MGha0Aq/nqykqIAPX38en9fLyMuupmt6/9PaGIZRmZ0qW7+enBdeIOrWWwkZMaLBFjd7c7LRnE5s3btL2Q4hWhlZMyREE5Z/pJRVn+9hz4YcAFRNIedACfGpYWSMaVvn/lWbLVD4NToK9779QSn8+nOh4ZEMGDaGHZvWEx4VU2WbkwMe18KFGGVl5L36KmUrVxI9dWqDnEtkionFd+woFdt3SNkOIVoZyQwJ0QQV55az+n972bnqKIYBKNBlUAIDL21PWEzwApWT6R5PoPDrwYO1Lvx6Jv7jp09r1ejP8Psp/vxzCj76CHw+1JAQoqdMwTl0aFDmctaxT5TtiIvD1lXKdgjRWkgwJEQTUlrkZt0X+9i67Ai6P/BPs0NGLAMntCc6qWFu3fjy8/Hs24cvN7dahV9rwjAMdm3dSM7RI/QdMhyb48x9ew4cIPfll/Hs3QuKQtKMGVhSUoI2lzPO0e/Hl30Mc2ISti5pTabgrBCi/kgwJEQTsXnRIb7/7y583sCp0SndIhl0eUfiUxv+//OGx4Pn8GE8B89d+LUmtqxbyZIv5gDQtmMal95w+9nn4fNR+N//Yng8RN10EwD+oiK08LoVmD0XKdshROsia4aEaESeCh8l+RVEJ4XgjLDi8+rEtw/jvCs60qZL49TvguOFX9u3xxQZGVhLlH0MNSQULTS0Tv326DuIkNBwVi/6mowhIwAwDJ2t61aR1qsvlp/dllJMJiKvvbbyub+khMO//S323r2Juv12tCBmrU4Z12xGi4nFs/8AaJqU7RCihZPMkBCN5NjeYua9thGrw8z1jw9EURUO7ywkOa1hzv2pLsPnw5OVhXf/fvSKikCWqI63jk7ePfbj1o0smP0BNoeTvkNG0LP/YExn6N+1bBm5L70Euo4pIYHkv/2tXm9j6RUV6IUFWDpL2Q4hWjL5VUeIBqT7dQ7+kA9AZKIDwwBdNyjJr0BRFNp0iWxyX7iKyYQ1JQV7796Y4uPx5ebiLyqqW58nfUazxUJ4VDQVZaV8/8083nvlL2xe8z1+n++060LOP5+EP/4RU2IioWPHVgZC9fU7nWqzoYYGynb4jhyplzGEEI1PMkNCNABDN9i9IYdVn+2h8FgZVz7Uj4T24eQddhGR4EDTmsfvJYbfj+/oUdz79mGUlwet8Kuu+9mxaT1rlyykpKgAgB79zmP4+IlVt3e7UcxmFFXFm5VF9l//SvTtt2Pr0aPOc6mKv6QEw+3G1q0b5vi4ehlDCNF4ZM2QEPXIMAwObM1n5ae7yT0YOFXZ5jRTWuCG9hCd3LwO91M0DXNyMmp4BN79+/BmBafwq6pqdOszgLReGWzbsIb13y+i14AhAPi8Xvbu2ErH7r1Rj6/bOXnLe+HMmXgPHODoH/5A6CWXEHnDDUHfEq+FhuL3+6nYuQPFpEnZDiFaGMkMCVFPjuwqZOXc3WTtCtxSMts0+oxuS59RKVjszf/3EEPX8WVn4967F93lCmrhV13XKwOfjSuXsnzB/4iMieOiK28kOu7UYq56WRn5776L65tvADAlJRFz773Y0tKCMpeT+fLyUCxm7N271/uONiFEw2n+P5GFaGJyDpSw8tM9HNiaB4BmUuk1Ipm+F7fDHmJp5NkFj6KqmBMS0MLCAoVfs7LQTeZASY86rntST9q5pZnNWG12ykpdhIZHAOD1ejCZzCiKgupwEDN1Ko6BA8l74w18R45w9NFHSXjySWxdu9ZpHj9nio7Gm32Mih07pGyHEC2IZIaECKI9mTl8+cZmABRVofvQRPqPTyUk0tbIM6tfhmHgy87Bs28v/uJitMgoVFvwPrPHXUFe9lESU1IB+O7zT8jLzmLgiItI6ZBWGXz5XS7y33wTf34+8Y8/jqKqGH5/UM8JMgwDf/YxtIgIbN27B7V0iRCicUhmSIg6MAyD/ZvzKMwuo8/otqR0j8IZYSWpcwQDJ7QnIq511LdSFAVzfBxaeNjxkh6H0EtLg1b41WK1VQZC7opydm/bjMddwcpv55PS4afbYVpICLG/+lVggfXxQOjo9OnYe/UifOJEFFPdf+QpioIWGxeoY7ZzJ7Zu3VAtLSfjJ0RrJJkhIc7BXeal4FgZhUfLKv9bnFfO1dMGoKoK/35wKRUuLxN/m0FS50g8FT4sttb7e4ZhGPjz8nDv248/Pz/ohV8BykpdbPh+ESntO9O2UxcMw2DZ15/TqXvvyqAJoHTlSnKeew4AS4cOJEyfHrS5SNkOIVqO1vsTW4gqFOeVs2dDzinBT3mxp8q2rvwKwmLspPaOwe/VMR8PgFpzIASBzIkpJgY1LAzvoUN4Dhw8vsA6eIVfHc4Qho65tPL5/h+3s3n1cjavXk7bTl0ZOGIMcYltcAwaRMz995P/r39hbtMmqEGZommYYmLxHj6MYjZJ2Q4hmjHJDIlWxVPuo+BYGRabRmSCk90bsln9+V4S2odx4U3dOLQ9n09fyDztOme4hYgEJ5HxDiISHETGO0jsFIHZKl9+5+IrKMCzdy++3FzU8Ih6KaFRUlTA2iUL2b5xHYYRqO3WvksPBo64iOi4BHz5+SgWC1pICHpFBXlvvEHEtddiTkys89i6240/Lw9rp45YUlOlbIcQzVDr/hVWtEi6buDKr/jZra1SCo6VUVYUyPL0GtGGYdcF1prkHynFZA58gUUmOunYN47IBAcR8Y7Af+McLWIrfGMxRUaiOZ14jhzBc+AAXpcLU1RUUG8rhYZHcuGEq+g7dARrlnzDzs2Z7N2xFV3XueS6yZiioirbFs6cSemyZZStXk3kL35B6MUX1ymAUa1WiIzEs2cPaJqU7RCiGapVZujVV1/lr3/9K0ePHiU9PZ2XX36ZgQMHnrF9YWEhjzzyCLNnzyY/P5927drxwgsvMH78+GqNJ5khcSbZ+4spOFpG+94xWOwm5v9jC/s25+I/Xvm9Ko4wC2kD4xl6VWfKSzxk7y8hMsFBWIzsCqpv/sJC3Pv348/LwzBACwurl91Y+TnHWLN4AX2HXkhsYjJ+v5+V335Jr/5DcPj85L76KhVbtgBg69mT6LvvxhxXt5Ol9dJS9LJSbGlpmJOTg/ExhBANpMbB0MyZM7n55pt54403GDRoEC+88AIff/wxO3bsIK6KHyYej4ehQ4cSFxfH//3f/5GcnMz+/fuJiIggPT29WmNKMNR6GbpBSUHFKYuXC7PLuOSe3pjMGu/+3/eU5Fcw8cG+JHWK4Kt/bmHXumxUk0JEXOB2VmWGJ95JRIIDq2R5GpXh9+MvKsJ39Cje3FwMtxs1JBTV6ay3W0xb169i8bzZqKrKRVfeSPu07pR89RUF772H4Xaj2GzEPfww9p496zSOlO0Qonmq8bfCjBkzmDJlCrfeeisAb7zxBvPmzePNN9/k4YcfPq39m2++SX5+Pt9//z3m42nx1NTUs47hdrtxu92Vz4uLi2s6TdEMlbs8HPwhn4KjZRQeK6PgaBlF2WX4qsjyFGX/f3t3Hh11ff97/DlLJvtKkknIwp6wSMAECBERESy1lkqXH4u0RLHtPT/RKtTWqreA2nPwXq891IML9dhyvS0iYgErFotYwlJQiE0NCCGsCZB9X0gmme/cP4KjKaIJJJkJ83qcM4fMl/l+5z3fA8k7n/fn83lfZEBCCPHDwwmt+Xw/m8zvDGXynKGEDgjEbFapwhuZLBasUVFYo6Lwa2ykvbKStpIS2stKMdn8sYSF9fjKrJj4BJKGjqD0XBEDk4d0bBg57RYiUkbQ/Md1tFdUYBsy5JrfxxIaSnt7O62FxzH5WTuV50TEe3VrZMjhcBAUFMSmTZuYM2eO+3h2dja1tbVs3br1snO+9a1vERUVRVBQEFu3biUmJoa7776bRx99FMsVVl6sXLmSJ5988rLjGhnq31yGi8baVlwuF2EDAjlfUMOhv50hPDaIW+9OpfR0HW/9r9zLzjNbTIR/NspzafLy4LHRBIRoKfP1wnA4cFZV0VZSgrO2ttdKaI31dYSEdbTR2LN9K0f/dZAbJmRx4+hxBCYkAlD9pz9hS04meOrUq577o7YdIv1Lt0aGKisrcTqd2O32TsftdjvHjh370nNOnTrFBx98wMKFC3n33Xc5ceIE999/P21tbaxYseJLz3nsscdYtmyZ+3l9fT1JSUndCVU8qK3VSW3ZZ6M7TR1/Xnre7jAYeVM8MxaNwuk0OHeshqZLk5o7VmiFXyptBbsnMYdFB2DuJ13d5eqYbTbM8fFYY2M7SmhlZbRVVOKsrcEcHII5JKRHSmifJUIul0FVeSnt7W2cPXGMyTPuAKDl6FHqt2wBoPnAAQYsWXJVq986t+0YgyWk51fQiUjP6fXJE4ZhEBsby+9//3ssFgsZGRmcP3+eZ5999orJkL+/P/493HVael5jTSs1ZU3EJofiH+TH3jcLOflxOY01rVc8x2w24XQ4AYhNDuO2RaOIiu/4QeEf5Mf3Hsnok9jFO3UqoSX1XgnNZDJz149+ytkTx7BYLO5eaP/IP0jozFuIy/knbeXl17SztDUmFmdZKa0Fx9S2Q8TLdSsZio6OxmKxUFZW1ul4WVkZcXFxX3pOfHw8fn5+nUpio0aNorS0FIfDgU3b2Hu1doeT2vLmTvN4pi1IwT/Ij7efz6OmpIlvPziOQWMG4LjY7k6EAkL83GWtCHtHaSsyLpjQ6AAsl0Z5AkL8GHXTte/zItcnS0gIlpAQ/AYOxFldTduFCzhrqnG5XFjCwq85uTCZTAweMcr9vKToNKcLjgBw/MZU0samE4sLq8tF/TvvEDJ9ercas5pMJiyxdrXtEOkHupUM2Ww2MjIy2Llzp3vOkGEY7Ny5kwceeOBLz5kyZQrr16/HMAz3b1/Hjx8nPj5eiZCXMpwG+bvO88k/iqmvaoH/mFWWdlsicUPCGTAwGJfhwmjvmOA8bkYSo6YMJNIepPk80mPMNhvmuLiOElptba+V0OyJg5g5Zz4Hd79PXXUlHx36J4eP5TMmJoHoLduof/ttBvz3fxOUnt7la5rMZqyxdtrLy3BYrfinqG2HiDe6qqX12dnZrF27lkmTJrF69Wo2btzIsWPHsNvtLFq0iISEBFatWgVAcXExY8aMITs7mwcffJDCwkIWL17Mz372M5544okuvaeW1vedstP17Fp/jMriRvcx/yBrx/ydSzswj5hoJzQqAJfLpc3lxCOcjY20V1XRduECRlMTJj9bj5XQDMNJwScfc2jPThpqa4iPjWfCkVM4L1wAIGTGDKKyszEHdb0Jr6utjfaKcmyDBqlth4gX6vacoXnz5lFRUcHy5cspLS1l/PjxbN++3T2puqioyD0CBJCUlMR7773H0qVLSUtLIyEhgYceeohHH3205z6FXDOXy8WejYXk7zoHro4EaPKcYQy7MYaAEL8vTXqUCImnuEto8fEdJbSSkh4roZnNFkaNn0jK2Bs5mneIaHs8sffEUb1+Pbs+zSX+4w9J+ve/iV26lIDU1C5d0+Tnh2VANI6iIkx+fmrbIeJl1JvMx7lcLpxtBlabhX2bCsl7v5jUyXHc9L3hBIWpjCn9g8swOpXQXK2tmIODe6yEBlB4OI8dm18HYER5LdN+8QS25ORuXcO4eBGjrhbbiBFq2yHiRZQM+bDasmZ2rS8gNMqfGdmjcbS0U1HUQEJKpKdDE7lqzsYm2qsqaS8pwdnQ0GOr0NocDg4f+ieffLSPb0++jQGTs2hpbuL0ju0MThlN4KhRX38RwNnUhKu5iYDUVPwGDrymmESkZygZ8mGlp+p469lcrFYzP3w6i+AIbWcg1w/D4fhCCa2mx1ahGYYTs7ljzs++v27i33kHCW9u4ZaUNBIW/qhLK8ac9fW4HA617RDxEipa+5iiI1X85f/k0trcRtzQcKbNT2H+8kwlQnLdMdts+MXFEThuHIE33ogtIQGj5WJHclRXh8u4cjPfr7yu+fPJz7agYKyYcFgsOHP2YDQ20tbm+NprWMLCwGKhtfA47dXVVxWHiPQcjQz5iKbaVva+WciJ3HIA0mcNIuu7wzwclUjf6o0SWnNTIxX/3Ed0aDjBkyezbcMfcdTUMvmb3yF+yFf/H2uvrMTkb1PbDhEPUzJ0nTMMF/m7zvHh26doa3FiMkHabUlMmj0EW4C6t4tvcjkctNfUXNrIsRaXy8ASGtat5fJfpqGuhj+v+d8Yl0adEhOSmXzHXcTGJ17xnLbyMiyhoQSMGq22HSIeomToOlZ2pp6c9QVUFDUAYB8SxrQFqcQkh3o4MhHv4DKML/RCq8DV0oI5KBhzaOhVr0Ir37uHD7e+ybnQAFyXVosNSRnNjDnzsPkHXB6Dy4WzrBRLVFTHLtVq2yHS55QMXYdam9v4cOsp8nef77Rn0JibB2IyaymvyJfpyRJae00NZ19+kcPl5zkfGUKkYeL7P34QW2IiTqezU3si6EjK2stKsdrtBIwcqbYdIn1MdZLrjKOlndef/NDdCT4l086U74/QnkEiX8MSEowlJBhbfHxHCa2kFGd1NS7D2bEKrRslNGtkJEN/9Tj2nBzO/L/XcDpaaDt7Fr+EBDave4nI6Fgm3DKD8MgBwBfadpSV4bBY1LZDpI8pGbpO1JY1ExDiR0CwH0PGx3DuWA3TFqSQODLK06GJ9Csmmw0/ux1rTExHCa28nLbycpx1td0qoZlMJkJuvZWRY8fStGcPwVOmUFJ8hvILxZRfKMZsNjN99g8+f73FgjU6Bsf582D1w3/4MLXtEOkjSoauA0f2nGfPG4WMvCmeW+9OJeu7w7BYzFj8tHOCyNUymc1YIyOxRkZiS0ykraqK9pIS2svKOtprhId3afTGOmAA4ZcaW9tj45la00KBH4zED5fLRZvDwaE9Oxk/eSpBIaGX2nacxeRnVdsOkT6iZKgfa2lqIyDYjwh7EM52g4aqFgynoVViIj3MHByMf3Awtri4ayqhGc3NRIeEE/rpp7Se+hNtY8fxSfFJ8vbncPjgP/n2wvsYmDwEIiJxnDwFViu2pCS17RDpZfqp2Q811bWy781CSk7WsWBFJgkpkfzg0QnEDg7VN02RXnR5Ca2C9opy2urqMAcFdfRC+4rSljUykriVK6l/912MhgZsgwcTbzKItcfT1NzkXoJ/sb0Nk80Gp05jDQvDEhHRR59QxDcpGepHDMPF4ZzzfLj1JI5LewadO1bD0PEx2IdolZ1IX/liCc1ITPi8hFZe/rUlNJPZTPi3v+1+HhcZzcQP8zGGD4PGRoiMZO/f/8q5U4XcNHkaaWlj++pjifgsJUP9RPnZenb9+fM9g2IHhXLrwpHaM0jEwzqX0Gov9UKrBsPAHBKKOfirN1JsPXYMV1MTptyPubBsGeGLF1NTUU5ry0WCg0P66FOI+DbtM+TlWi+2d+wZlHMOXGALtDL5rqGMuSUBs/YMEvE67o0cL5XQjOaLmIODv7KE5jhzhso1a3CcOQNAYFYWLbNmkjAglsCMdKxRWhUq0puUDHkpl8vFiUPl7H2zkOb6jj2DRky0M+UHwwkOV1NVkf7AaGpyl9Cc9Q2Y/Pwwh4V96aaKrrY2at96i7q//AUMg4i5cwmZOlXJkEgfUJnMS1Wdb+Lvrx4BIDw2kGkLUkkapW+IIv2Ju4QWH097dQ1tpSU4q6sxnE7MoWGdSmgmPz8i588naMIE6rZsIfy738VZWenB6EV8h0aGvIizzeDf/yjmhqkJ2AKt7H69gIBQG+mzkrH6afM1kf6uuyW09pISjQyJ9AGNDHmRv63N5+zhKpprHdw8dwS3LEj1dEgi0oM6rUJLSuy8Cs1qxRwerr5kIh6gZMjDmusdNNW2EpMcStptiVQUNxA3LNzTYYlILzMHBeEfFNSxCu1rSmgi0rtUJvMQw3Dx6Z7z7N9yioBgKwuWZ2K1WWh3OLHaVBIT8TUulwtnbS3tFRW0l1dgNDdjMkFgRobKZCK9TCNDHlBR1MCuPx+j/GzHnkHhMYE0NzgIGxCoREjER5lMpi9s5NhRQnNWVqpZq0gfUDLUhxwX2/nw7VPk7zqHywW2AAuT5wzTnkEi0slnJTRXYqJa7Ij0ASVDfcDlcnEi99KeQXWX9gyaEMuU/xqhPYNE5IqUCIn0DSVDvayuopndrx+n6NNqoKMkNm1BKkmjNQdARETEGygZ6mX1VS0UfVqN2WoiY9Yg0r85SHsGiYiIeBElQ73gXEEN/3rvLN/8H2NJGhnFTd8bzpBx0UTYgzwdmoiIiPwHs6cDuN442w0++L9HKfq0mn/tKALgxm8kKxESERHxUhoZ6gEuw8WRvReIjAsiISWSqfNTKDpSxbjbEj0dmoiIiHwNbbp4jSqKG8hZX0DZ6Xoi7EHM/5+TsPhpwE1ERKS/0MjQVXK0tPPR26f55B/FuFzgF2Bh7K0JmCxaCisiItKfKBnqJpfLxal/VbBnYyFNta0ADJ8Qy80/GEFwhPYMEhER6W+UDHVDXcVFdm84TtGRKgDCYgKZNj+F5DEDPByZiIiIXC0lQ110ZM959mwsxNlmYLaaSP/GIDK+OUi9xERERPo5JUNfw9HSji3ASnCEP842g4TUSKYtSCEyLtjToYmIiEgP0GqyK2hpamPvm4WUnqpj/q8nYfWzcL6ghoEpEeoXJCIich3RGvD/8FluaDabKD5aTV3FRc4drQEgITVSiZCIiMh1RmWyL6g810DO+uPc9P3hxA8LZ0b2KGyBVuKGhHs6NBEREeklKpNxac+gd07zyQfncBku4oaG8/1fZvT4+4iIiIj38emRIZfLxam8CvZuLKSxpmPPoGHpMdz8XykejkxERET6is8mQ/WVF9n9xnHO5l/aMyg6gFvmpzLoBu0ZJCIi4kt8LhlythvkvV/EoW1naG8zMFtMpM/SnkEiIiK+yueSoW0vfkLxp9UAJKREMO3uVO0ZJCIi4sOuamn9Cy+8wODBgwkICCAzM5OPPvqoS+dt2LABk8nEnDlzruZte8SYqQMJDPVj5r2juWvpjUqEREREfFy3R4beeOMNli1bxssvv0xmZiarV69m1qxZFBQUEBsbe8Xzzpw5wyOPPMLUqVOvKeBrNXR8DEmjorAF+NygmIiIiHyJbo8M/fa3v+UnP/kJ9957L6NHj+bll18mKCiIP/zhD1c8x+l0snDhQp588kmGDh16TQFfK5PJpERIRERE3LqVDDkcDnJzc5k5c+bnFzCbmTlzJvv377/ieU899RSxsbHcd999XXqf1tZW6uvrOz1EREREekO3kqHKykqcTid2u73TcbvdTmlp6Zees3fvXl599VVeeeWVLr/PqlWrCA8Pdz+SkpK6E6aIiIhIl/Vqb7KGhgZ+9KMf8corrxAdHd3l8x577DHq6urcj+Li4l6MUkRERHxZtybPREdHY7FYKCsr63S8rKyMuLi4y15/8uRJzpw5w+zZs93HDMPoeGOrlYKCAoYNG3bZef7+/vj7+3cnNBEREZGr0q2RIZvNRkZGBjt37nQfMwyDnTt3kpWVddnrR44cSX5+Pnl5ee7Hd77zHaZPn05eXp7KXyIiIuJx3V5WtWzZMrKzs5kwYQKTJk1i9erVNDU1ce+99wKwaNEiEhISWLVqFQEBAdxwww2dzo+IiAC47LiIiIiIJ3Q7GZo3bx4VFRUsX76c0tJSxo8fz/bt292TqouKijCbe3UqkoiIiEiPMblcLpeng/g69fX1hIeHU1dXR1hYmKfDERERkeuIhnBERETEpykZEhEREZ+mZEhERER8mpIhERER8WlKhkRERMSnKRkSERERn6ZkSERERHyakiERERHxad3egdoTPtsXsr6+3sORiIiILwgNDcVkMnk6DOkj/SIZamhoAFBjVxER6RPqeOBb+kU7DsMwuHDhQo9k6vX19SQlJVFcXKx/6F9B96nrdK+6Tveq63Svuq437pVGhnxLvxgZMpvNJCYm9ug1w8LC9A2mC3Sfuk73qut0r7pO96rrdK/kamkCtYiIiPg0JUMiIiLi03wuGfL392fFihX4+/t7OhSvpvvUdbpXXad71XW6V12neyXXql9MoBYRERHpLT43MiQiIiLyRUqGRERExKcpGRIRERGfpmRIREREfJpPJUMvvPACgwcPJiAggMzMTD766CNPh+SVdu/ezezZsxk4cCAmk4ktW7Z4OiSvtGrVKiZOnEhoaCixsbHMmTOHgoICT4fllV566SXS0tLcm+JlZWXxt7/9zdNh9QvPPPMMJpOJhx9+2NOheJ2VK1diMpk6PUaOHOnpsKQf8plk6I033mDZsmWsWLGCjz/+mHHjxjFr1izKy8s9HZrXaWpqYty4cbzwwgueDsWr5eTksGTJEg4cOMCOHTtoa2vjG9/4Bk1NTZ4OzeskJibyzDPPkJuby6FDh7jtttu46667OHLkiKdD82oHDx5k7dq1pKWleToUrzVmzBhKSkrcj71793o6JOmHfGZpfWZmJhMnTmTNmjVAR7+zpKQkHnzwQX71q195ODrvZTKZ2Lx5M3PmzPF0KF6voqKC2NhYcnJyuOWWWzwdjteLiori2Wef5b777vN0KF6psbGR9PR0XnzxRX7zm98wfvx4Vq9e7emwvMrKlSvZsmULeXl5ng5F+jmfGBlyOBzk5uYyc+ZM9zGz2czMmTPZv3+/ByOT60ldXR3Q8UNerszpdLJhwwaamprIysrydDhea8mSJdx5552dvm/J5QoLCxk4cCBDhw5l4cKFFBUVeTok6Yf6RaPWa1VZWYnT6cRut3c6brfbOXbsmIeikuuJYRg8/PDDTJkyhRtuuMHT4Xil/Px8srKyaGlpISQkhM2bNzN69GhPh+WVNmzYwMcff8zBgwc9HYpXy8zMZN26daSmplJSUsKTTz7J1KlTOXz4MKGhoZ4OT/oRn0iGRHrbkiVLOHz4sOYrfIXU1FTy8vKoq6tj06ZNZGdnk5OTo4ToPxQXF/PQQw+xY8cOAgICPB2OV7vjjjvcX6elpZGZmcmgQYPYuHGjyq/SLT6RDEVHR2OxWCgrK+t0vKysjLi4OA9FJdeLBx54gHfeeYfdu3eTmJjo6XC8ls1mY/jw4QBkZGRw8OBBfve737F27VoPR+ZdcnNzKS8vJz093X3M6XSye/du1qxZQ2trKxaLxYMReq+IiAhSUlI4ceKEp0ORfsYn5gzZbDYyMjLYuXOn+5hhGOzcuVNzFuSquVwuHnjgATZv3swHH3zAkCFDPB1Sv2IYBq2trZ4Ow+vMmDGD/Px88vLy3I8JEyawcOFC8vLylAh9hcbGRk6ePEl8fLynQ5F+xidGhgCWLVtGdnY2EyZMYNKkSaxevZqmpibuvfdeT4fmdRobGzv9ZnX69Gny8vKIiooiOTnZg5F5lyVLlrB+/Xq2bt1KaGgopaWlAISHhxMYGOjh6LzLY489xh133EFycjINDQ2sX7+eXbt28d5773k6NK8TGhp62byz4OBgBgwYoPlo/+GRRx5h9uzZDBo0iAsXLrBixQosFgsLFizwdGjSz/hMMjRv3jwqKipYvnw5paWljB8/nu3bt182qVrg0KFDTJ8+3f182bJlAGRnZ7Nu3ToPReV9XnrpJQBuvfXWTsf/+Mc/cs899/R9QF6svLycRYsWUVJSQnh4OGlpabz33nvcfvvtng5N+rFz586xYMECqqqqiImJ4eabb+bAgQPExMR4OjTpZ3xmnyERERGRL+MTc4ZERERErkTJkIiIiPg0JUMiIiLi05QMiYiIiE9TMiQiIiI+TcmQiIiI+DQlQyIiIuLTlAyJiIiIT1MyJCJuu3btwmQyUVtb6+lQRET6jJIhERER8WlKhkRERMSnKRkS8SKGYbBq1SqGDBlCYGAg48aNY9OmTcDnJaxt27aRlpZGQEAAkydP5vDhw52u8dZbbzFmzBj8/f0ZPHgwzz33XKe/b21t5dFHHyUpKQl/f3+GDx/Oq6++2uk1ubm5TJgwgaCgIG666SYKCgp694OLiHiQkiERL7Jq1Spee+01Xn75ZY4cOcLSpUv54Q9/SE5Ojvs1v/jFL3juuec4ePAgMTExzJ49m7a2NqAjiZk7dy7z588nPz+flStX8utf/5p169a5z1+0aBGvv/46zz//PEePHmXt2rWEhIR0iuOJJ57gueee49ChQ1itVhYvXtwnn19ExBPUtV7ES7S2thIVFcX7779PVlaW+/iPf/xjmpub+elPf8r06dPZsGED8+bNA6C6uprExETWrVvH3LlzWbhwIRUVFfz97393n//LX/6Sbdu2ceTIEY4fP05qaio7duxg5syZl8Wwa9cupk+fzvvvv8+MGTMAePfdd7nzzju5ePEiAQEBvXwXRET6nkaGRLzEiRMnaG5u5vbbbyckJMT9eO211zh58qT7dV9MlKKiokhNTeXo0aMAHD16lClTpnS67pQpUygsLMTpdJKXl4fFYmHatGlfGUtaWpr76/j4eADKy8uv+TOKiHgjq6cDEJEOjY2NAGzbto2EhIROf+fv798pIbpagYGBXXqdn5+f+2uTyQR0zGcSEbkeaWRIxEuMHj0af39/ioqKGD58eKdHUlKS+3UHDhxwf11TU8Px48cZNWoUAKNGjWLfvn2drrtv3z5SUlKwWCyMHTsWwzA6zUESEfF1GhkS8RKhoaE88sgjLF26FMMwuPnmm6mrq2Pfvn2EhYUxaNAgAJ566ikGDBiA3W7niSeeIDo6mjlz5gDw85//nIkTJ/L0008zb9489u/fz5o1a3jxxRcBGDx4MNnZ2SxevJjnn3+ecePGcfbsWcrLy5k7d66nPrqIiEcpGRLxIk8//TQxMTGsWrWKU6dOERERQXp6Oo8//ri7TPXMM8/w0EMPUVhYyPjx4/nrX/+KzWYDID09nY0bN7J8+XKefvpp4uPjeeqpp7jnnnvc7/HSSy/x+OOPc//991NVVUVycjKPP/64Jz6uiIhX0GoykX7is5VeNTU1REREeDocEZHrhuYMiYiIiE9TMiQiIiI+TWUyERER8WkaGRIRERGfpmRIREREfJqSIREREfFpSoZERETEpykZEhEREZ+mZEhERER8mpIhERER8WlKhkRERMSn/X+znAOQDMdKdwAAAABJRU5ErkJggg==", "text/plain": ["<Figure size 616.125x500 with 1 Axes>"]}, "metadata": {}, "output_type": "display_data"}], "source": ["\n", "metrics = pd.read_csv(f\"{trainer.logger.log_dir}/metrics.csv\")\n", "del metrics[\"step\"]\n", "metrics.set_index(\"epoch\", inplace=True)\n", "display(metrics.dropna(axis=1, how=\"all\").head())\n", "sn.relplot(data=metrics, kind=\"line\")"]}, {"cell_type": "markdown", "id": "f4ba0bcf", "metadata": {"papermill": {"duration": 0.018182, "end_time": "2025-04-03T20:44:10.031117", "exception": false, "start_time": "2025-04-03T20:44:10.012935", "status": "completed"}, "tags": []}, "source": ["## Congratulations - Time to Join the Community!\n", "\n", "Congratulations on completing this notebook tutorial! If you enjoyed this and would like to join the Lightning\n", "movement, you can do so in the following ways!\n", "\n", "### Star [Lightning](https://github.com/Lightning-AI/lightning) on GitHub\n", "The easiest way to help our community is just by starring the GitHub repos! This helps raise awareness of the cool\n", "tools we're building.\n", "\n", "### Join our [Discord](https://discord.com/invite/tfXFetEZxv)!\n", "The best way to keep up to date on the latest advancements is to join our community! Make sure to introduce yourself\n", "and share your interests in `#general` channel\n", "\n", "\n", "### Contributions !\n", "The best way to contribute to our community is to become a code contributor! At any time you can go to\n", "[Lightning](https://github.com/Lightning-AI/lightning) or [Bolt](https://github.com/Lightning-AI/lightning-bolts)\n", "GitHub Issues page and filter for \"good first issue\".\n", "\n", "* [Lightning good first issue](https://github.com/Lightning-AI/lightning/issues?q=is%3Aopen+is%3Aissue+label%3A%22good+first+issue%22)\n", "* [Bolt good first issue](https://github.com/Lightning-AI/lightning-bolts/issues?q=is%3Aopen+is%3Aissue+label%3A%22good+first+issue%22)\n", "* You can also contribute your own notebooks with useful examples !\n", "\n", "### Great thanks from the entire Pytorch Lightning Team for your interest !\n", "\n", "[![Pytorch Lightning](data:image/png;base64,NDA0OiBOb3QgRm91bmQ=){height=\"60px\" width=\"240px\"}](https://pytorchlightning.ai)"]}, {"cell_type": "raw", "metadata": {"raw_mimetype": "text/restructuredtext"}, "source": [".. customcarditem::\n", "   :header: PyTorch Lightning CIFAR10 ~94% Baseline Tutorial\n", "   :card_description: Train a Resnet to 94% accuracy on Cifar10!\n", "   :tags: Image,GPU/TPU,Lightning-Examples"]}], "metadata": {"jupytext": {"cell_metadata_filter": "colab,colab_type,id,-all", "formats": "ipynb,py:percent", "main_language": "python"}, "language_info": {"codemirror_mode": {"name": "ipython", "version": 3}, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.10.12"}, "papermill": {"default_parameters": {}, "duration": 2835.557789, "end_time": "2025-04-03T20:44:11.673369", "environment_variables": {}, "exception": null, "input_path": "lightning_examples/cifar10-baseline/baseline.ipynb", "output_path": ".notebooks/lightning_examples/cifar10-baseline.ipynb", "parameters": {}, "start_time": "2025-04-03T19:56:56.115580", "version": "2.6.0"}, "widgets": {"application/vnd.jupyter.widget-state+json": {"state": {"013fe6b131e8413ea2b4fd404095e6d5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_9016c2ecd5e4471b9420f4773051b3c7", "placeholder": "\u200b", "style": "IPY_MODEL_3830b892705d49308d8bb1581f437efe", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200749.59it/s]"}}, "014b3e6072ea4d0b8aed9599645d0783": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "04109f8039dc43908f09b5ebea8fd126": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_272945fa9b4e4ba8bec3bfb52839c753", "placeholder": "\u200b", "style": "IPY_MODEL_5856fb5a92c242ee903d9546929b4de0", "tabbable": null, "tooltip": null, "value": "Sanity\u2007Checking\u2007DataLoader\u20070:\u2007100%"}}, "0520d8814f21403da1114bae0993ac38": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "05e020a80e6040adb8896e56978b77c9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_c94a6410d1e74de5be7381e1563b5ee1", "placeholder": "\u200b", "style": "IPY_MODEL_e93f911dce3645e3844ee1497b9ded14", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "06713fd6c88c4839a095b838053171f4": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "0733e929137a42f986dcf277e76b2f5d": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "07b88e6098864755bb475d96421013ff": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "07f23a6960714879af90570b24601080": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "08c2f87e38594848977def5dbbf64fc9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "091d9790ef8e4a5b947166d828f448a6": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "0a7f4e0633fc420a892a3705947ad728": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "0e0f5a841f4240c497281233e2747a33": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_beaef69a0fc246b5aa74835caa43a824", "IPY_MODEL_2d2641d25b57446ab1ff3d4b77e3ae77", "IPY_MODEL_5ffd28f9cd4948b1b6cd642f47e9c1f9"], "layout": "IPY_MODEL_091d9790ef8e4a5b947166d828f448a6", "tabbable": null, "tooltip": null}}, "0f5e9c1cdd1a4a91a3cde9d00546167c": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "1110d389efcb48c0a430e17ff856759b": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "11e5639ff8be407cbd7bc38c0d8b759c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "126fa6f1230e4687b6d72a29d67b9f20": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "128fe2414db34cecadf5f13b341ec55a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "14b67a7d0c2e47acba491c4fbad24327": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "176ac752d4bc4935b2ef4bc4605a2829": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_f184f014756643f9a2b4ef072a5883e4", "IPY_MODEL_db641f20b1584a4eb42eb0300f21ea20", "IPY_MODEL_bb3cc35e325144e2ab13e87922d6192d"], "layout": "IPY_MODEL_c8b2d412943f4883b9b029230bc92b39", "tabbable": null, "tooltip": null}}, "1783bd9f591a48adbb4c445663872041": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "19637e56e7f940dd9247859e2c5cb265": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "19e12e4d0e4640eab380b7b21c39794a": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "1f626e832f0545728a4f3d994e62a3e9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "211fa9472d0c4d3b83f91d68a8802776": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "240f0f0ab779464d9632675c52e7bea0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "26c054dd431746e7a15579479a3336bf": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "272945fa9b4e4ba8bec3bfb52839c753": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "281d972d7a80421a8714cbc976a759b8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_7fe6d53e06ca4ac99c5038f4600d94d5", "placeholder": "\u200b", "style": "IPY_MODEL_e9ef107572ef42568745ce246b9a5b2a", "tabbable": null, "tooltip": null, "value": "\u20072/2\u2007[00:00&lt;00:00,\u2007\u20074.39it/s]"}}, "2ae89a0e99854c30ab267582afdb55bb": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "2c98f1d84fe74d65b726d8390fe5f3d5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "2ce495e8f1f14872993ef5cf642ccd71": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_cb04a514cdc4473295ed791ddd477ad7", "placeholder": "\u200b", "style": "IPY_MODEL_3540308fd9574a9488db2d8ed054c4c3", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200751.97it/s]"}}, "2d2641d25b57446ab1ff3d4b77e3ae77": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_a7484d3752ee44d5bf97ade13b1d841a", "max": 157.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_f786a89aaffc476f8d9f185f5f2dd394", "tabbable": null, "tooltip": null, "value": 157.0}}, "2d84750640614b5190967f67ee703343": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_06713fd6c88c4839a095b838053171f4", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_95e22e4788074b979bb11f039f504350", "tabbable": null, "tooltip": null, "value": 40.0}}, "2f67ab52706d49a0a037c5c644b463a0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "31996c5f07a5462ea6b2f104029c4ce5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "3465a64f0c1f422e8fc052a9bc38dca5": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "3540308fd9574a9488db2d8ed054c4c3": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "3588b2f4a66749999fe025d3b7d280a3": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "3736a346c1f14e0fb1d4ea7c7d5ef6d9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "37cb978a99c6419d92ab5b07ac9eb6f6": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "37fec1c3b79146108f8f6ae4a84e9f39": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "38144a76c5db4760b1af6ac67cd8da43": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_a7994402950b48da91b75024c16c8171", "placeholder": "\u200b", "style": "IPY_MODEL_edad39f3b51c41b19b51a97d34a0a812", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200751.02it/s]"}}, "3830b892705d49308d8bb1581f437efe": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "3b2370152e874a7cb90e38321a6642c4": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "3c60d1eff2354bc2972a8ffc95f6a314": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_feec48f1c15a43ab96fed0237b94dd32", "max": 2.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_7a004a1f282242a9994dcf11d91c52eb", "tabbable": null, "tooltip": null, "value": 2.0}}, "3dd9b4b524e3495793002eb2ad4d1955": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_561fbfbbc95d4a4e8a5b49e2ff135d0f", "placeholder": "\u200b", "style": "IPY_MODEL_c6fcfa7f7acc447da329ce1472f41113", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "3f381f21714d45c587e04114e4a42754": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_b58e5e77e4194fc58bdecfd7789b13b7", "placeholder": "\u200b", "style": "IPY_MODEL_3736a346c1f14e0fb1d4ea7c7d5ef6d9", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "3f3f0c2e58b142d4b1262b75ece5000a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_0733e929137a42f986dcf277e76b2f5d", "placeholder": "\u200b", "style": "IPY_MODEL_ef5864236aad45d38b460cc9da72a6ed", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "3fa068d1ac9a4c7dba21fbcc5beb5b45": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "3fff51b6deef4346a0498fd1a57eb663": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "4306ddfb885a46748b4dce8af5c4739c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "43171ed405564ddda8cd04592cdd203b": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "435993e1fc664c95bcf0b46b032e337e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "438fbad435df4b4eb06ccd5af3503dcd": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "53ed414c218e4c1c8611801a512e48b8": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "54581158996349b3a5a6e1a3161bea02": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_5ee8f1d5d2b341e89beb0025886273d9", "placeholder": "\u200b", "style": "IPY_MODEL_f8e9e8deba274b68bb8cc8a9e495241e", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200750.56it/s]"}}, "561fbfbbc95d4a4e8a5b49e2ff135d0f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "573031c8c57340c296c515fcf36da3f1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "5856fb5a92c242ee903d9546929b4de0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "58ca533f051c42fa92b38a380a60e3b8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_94bb595d60b04515946755e65cce2b9c", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_f1c377119a7d4f9985a2ec6cea6f9554", "tabbable": null, "tooltip": null, "value": 40.0}}, "59300ebcd8854bd8a5fee3f4b8db44bc": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "5c4636262e434db0b35ce9133b804040": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "5e2cf956404541b8ae549bfc9228e125": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "5ee43c9eeaf141c89d746ca0bdbaf2e3": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e5fa2526dd6d42bda634733541d86947", "placeholder": "\u200b", "style": "IPY_MODEL_9b2dd9246f2e47e9a64e246c9dcc57f7", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "5ee8f1d5d2b341e89beb0025886273d9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "5ffd28f9cd4948b1b6cd642f47e9c1f9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_84f6982b945d42f58fe1ab294add867a", "placeholder": "\u200b", "style": "IPY_MODEL_5e2cf956404541b8ae549bfc9228e125", "tabbable": null, "tooltip": null, "value": "\u2007157/157\u2007[07:08&lt;00:00,\u2007\u20070.37it/s,\u2007v_num=1,\u2007val_loss=0.522,\u2007val_acc=0.818]"}}, "636778a6876b4a9fb1b1cf04a0a1e1f9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "63b9aa5fda2f45708e13567684cda937": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_07b88e6098864755bb475d96421013ff", "placeholder": "\u200b", "style": "IPY_MODEL_d7898207cb854067a9d4d21ac47b4034", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200750.43it/s]"}}, "659b9a8dde4448f3855026af2301aa83": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_c6d1db00dc574f31a9a312faf989e0e2", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_f37ebc1d44fa4ee1994c7dd1c339b5cb", "tabbable": null, "tooltip": null, "value": 40.0}}, "68f12097d227441299d86c6c73377dbd": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "6a5438db07ec4a9bad62dda53a5b8f2f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "6c359fa14d204287b8f83facf9dbed38": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_757a664ed0684c2ca2dceb459ad7a176", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_2c98f1d84fe74d65b726d8390fe5f3d5", "tabbable": null, "tooltip": null, "value": 40.0}}, "6c9af3c1b2aa4ad4bc34c765a5f8319f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "7151077734fe4691b420800c7add954e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "722569e4f8ea4fc9ae85d251e242cd88": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_fc89121f2bb64567ae816671c44fa5ef", "placeholder": "\u200b", "style": "IPY_MODEL_b2b788b768c64368be1169892f15b2fc", "tabbable": null, "tooltip": null, "value": "Sanity\u2007Checking\u2007DataLoader\u20070:\u2007100%"}}, "7347625323324ff1b417cab15822fd6e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_e586788974d64795ae818200d27842ce", "IPY_MODEL_ca6c108745d04fdd9f3c5af3e87b2676", "IPY_MODEL_dca93335334a452fa60ec4394f312bc0"], "layout": "IPY_MODEL_1783bd9f591a48adbb4c445663872041", "tabbable": null, "tooltip": null}}, "747a26404e184a94a332ee5a3e1df81b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_6c9af3c1b2aa4ad4bc34c765a5f8319f", "placeholder": "\u200b", "style": "IPY_MODEL_68f12097d227441299d86c6c73377dbd", "tabbable": null, "tooltip": null, "value": "Testing\u2007DataLoader\u20070:\u2007100%"}}, "7482b856372f459286f06fb108d0c32d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_ea5d4c6638c447728673b72cd27a4f79", "IPY_MODEL_a9694f70df374b1ab20e20a35ba1da5e", "IPY_MODEL_f00770caf41249eaaec5c3239d529f32"], "layout": "IPY_MODEL_900cb05ebd534619ab18843547d2487f", "tabbable": null, "tooltip": null}}, "757a664ed0684c2ca2dceb459ad7a176": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "77a7739c815d422ca469fa0dfcfdef0d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_3f3f0c2e58b142d4b1262b75ece5000a", "IPY_MODEL_b64e1f36011b44c8874a97f1c7940e13", "IPY_MODEL_63b9aa5fda2f45708e13567684cda937"], "layout": "IPY_MODEL_1110d389efcb48c0a430e17ff856759b", "tabbable": null, "tooltip": null}}, "7a004a1f282242a9994dcf11d91c52eb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "7d83319df2d74fa3bb06ef02195c43b8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e279f11fb319439ebb36ac3ae8416cc9", "placeholder": "\u200b", "style": "IPY_MODEL_f66e382a9af648f9bf0c3dd892453738", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200750.33it/s]"}}, "7e71cc5c0087467abdcac91fda3dfaf3": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_cdcacbf98e1041f9a9789d5a81f2b5c8", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_f50a1e87c68d4f28961a8eef346641b5", "tabbable": null, "tooltip": null, "value": 40.0}}, "7fe6d53e06ca4ac99c5038f4600d94d5": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "83ef57b528174a05899ef90f9687e643": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "845f4b3eb2a94313a41f6eea9e5649bc": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_04109f8039dc43908f09b5ebea8fd126", "IPY_MODEL_b964835b99534bdd937b284a78ab4037", "IPY_MODEL_281d972d7a80421a8714cbc976a759b8"], "layout": "IPY_MODEL_26c054dd431746e7a15579479a3336bf", "tabbable": null, "tooltip": null}}, "849a56db28824c1b80c6bf40628832a2": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "84f6982b945d42f58fe1ab294add867a": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "8734804d6f574457a797d5ecf1068b4e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "8789825603144d8c93d1db3185dfac60": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "88124b4760e541c3bd4865642bd15e1c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_8789825603144d8c93d1db3185dfac60", "placeholder": "\u200b", "style": "IPY_MODEL_e00c6ea3c2784bcdb82aae96efe5a513", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200751.41it/s]"}}, "8b260ac7f05a4869aaeb2827bcd5a248": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "8e8c230adacc4c888082b8280f9debaf": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_3465a64f0c1f422e8fc052a9bc38dca5", "placeholder": "\u200b", "style": "IPY_MODEL_435993e1fc664c95bcf0b46b032e337e", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "900cb05ebd534619ab18843547d2487f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "9016c2ecd5e4471b9420f4773051b3c7": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "9018bd8e0fad4f7eb67706754656c86b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_43171ed405564ddda8cd04592cdd203b", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_4306ddfb885a46748b4dce8af5c4739c", "tabbable": null, "tooltip": null, "value": 40.0}}, "91760a332ccf4bd9a57d66eab93801a3": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_08c2f87e38594848977def5dbbf64fc9", "placeholder": "\u200b", "style": "IPY_MODEL_2f67ab52706d49a0a037c5c644b463a0", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "9353619d52b14870a6f3903cb944e585": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "94bb595d60b04515946755e65cce2b9c": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "95311d4bf34a47f8b16ddf0961f16728": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "95e22e4788074b979bb11f039f504350": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "967f4f024aff4ea68843deab5f022709": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_1f626e832f0545728a4f3d994e62a3e9", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_11e5639ff8be407cbd7bc38c0d8b759c", "tabbable": null, "tooltip": null, "value": 40.0}}, "9b2dd9246f2e47e9a64e246c9dcc57f7": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "a06180382e024b68be2bb6702ef0d445": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "a0a70551e34b4cec9f94336a2a27cc22": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "a3e5c3ff2fe84b9390bf1929114da6dc": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_8e8c230adacc4c888082b8280f9debaf", "IPY_MODEL_a9f1ee56d30145ed9ec9ce40b211558f", "IPY_MODEL_88124b4760e541c3bd4865642bd15e1c"], "layout": "IPY_MODEL_37fec1c3b79146108f8f6ae4a84e9f39", "tabbable": null, "tooltip": null}}, "a7484d3752ee44d5bf97ade13b1d841a": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "a7994402950b48da91b75024c16c8171": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "a909514edc02444fb33fc35ecc6fcb60": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_3f381f21714d45c587e04114e4a42754", "IPY_MODEL_b2127209242844adb7e1629037bbe653", "IPY_MODEL_7d83319df2d74fa3bb06ef02195c43b8"], "layout": "IPY_MODEL_37cb978a99c6419d92ab5b07ac9eb6f6", "tabbable": null, "tooltip": null}}, "a9694f70df374b1ab20e20a35ba1da5e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_3fff51b6deef4346a0498fd1a57eb663", "max": 157.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_d5a7885ffe744a44972a0f412f26b69f", "tabbable": null, "tooltip": null, "value": 157.0}}, "a9f1ee56d30145ed9ec9ce40b211558f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_59300ebcd8854bd8a5fee3f4b8db44bc", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_128fe2414db34cecadf5f13b341ec55a", "tabbable": null, "tooltip": null, "value": 40.0}}, "abfb06de7746494e9d5d324a0908951b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "ac55f4acd4594124b0296e8645f7cb4c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_0520d8814f21403da1114bae0993ac38", "placeholder": "\u200b", "style": "IPY_MODEL_f30c705e9e5b47a8938a9a4fe24c16fe", "tabbable": null, "tooltip": null, "value": "Testing\u2007DataLoader\u20070:\u2007100%"}}, "b0a46264aba4441ab9f476e8508e694e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "b2127209242844adb7e1629037bbe653": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_8b260ac7f05a4869aaeb2827bcd5a248", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_f5f91af9871f45bc96d29720a24bd91b", "tabbable": null, "tooltip": null, "value": 40.0}}, "b2b788b768c64368be1169892f15b2fc": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "b394956d4e9347d488074e7a617d8d05": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_722569e4f8ea4fc9ae85d251e242cd88", "IPY_MODEL_3c60d1eff2354bc2972a8ffc95f6a314", "IPY_MODEL_c705ee68cc294322939a508b6d7d9c7e"], "layout": "IPY_MODEL_95311d4bf34a47f8b16ddf0961f16728", "tabbable": null, "tooltip": null}}, "b52d2f3c14e94ca0bf2862eb15cfb33c": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "b58e5e77e4194fc58bdecfd7789b13b7": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "b64e1f36011b44c8874a97f1c7940e13": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_9353619d52b14870a6f3903cb944e585", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_211fa9472d0c4d3b83f91d68a8802776", "tabbable": null, "tooltip": null, "value": 40.0}}, "b6ae30fa989543e58b3d326abcfd9d0a": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "b964835b99534bdd937b284a78ab4037": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_636778a6876b4a9fb1b1cf04a0a1e1f9", "max": 2.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_a06180382e024b68be2bb6702ef0d445", "tabbable": null, "tooltip": null, "value": 2.0}}, "bb3cc35e325144e2ab13e87922d6192d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_53ed414c218e4c1c8611801a512e48b8", "placeholder": "\u200b", "style": "IPY_MODEL_240f0f0ab779464d9632675c52e7bea0", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200752.23it/s]"}}, "be81087855a841b7b2754fd85d12e957": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_5ee43c9eeaf141c89d746ca0bdbaf2e3", "IPY_MODEL_659b9a8dde4448f3855026af2301aa83", "IPY_MODEL_2ce495e8f1f14872993ef5cf642ccd71"], "layout": "IPY_MODEL_3588b2f4a66749999fe025d3b7d280a3", "tabbable": null, "tooltip": null}}, "beaef69a0fc246b5aa74835caa43a824": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_dd9334cc21b34c60b1a28ed527c71832", "placeholder": "\u200b", "style": "IPY_MODEL_f465daf94d33407fac6dca02a00e1a5f", "tabbable": null, "tooltip": null, "value": "Epoch\u20074:\u2007100%"}}, "c2b5ddfd68b047d0a23d52be541515d6": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e8e88d53b8b848ef915af0d2fa7d6fad", "placeholder": "\u200b", "style": "IPY_MODEL_07f23a6960714879af90570b24601080", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "c6d1db00dc574f31a9a312faf989e0e2": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "c6fcfa7f7acc447da329ce1472f41113": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "c705ee68cc294322939a508b6d7d9c7e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_fad906acde69465092f63430e1f67113", "placeholder": "\u200b", "style": "IPY_MODEL_014b3e6072ea4d0b8aed9599645d0783", "tabbable": null, "tooltip": null, "value": "\u20072/2\u2007[00:00&lt;00:00,\u200727.95it/s]"}}, "c8b2d412943f4883b9b029230bc92b39": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "c93c51e5608f4712aae5b7e295807d6f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_91760a332ccf4bd9a57d66eab93801a3", "IPY_MODEL_6c359fa14d204287b8f83facf9dbed38", "IPY_MODEL_54581158996349b3a5a6e1a3161bea02"], "layout": "IPY_MODEL_b0a46264aba4441ab9f476e8508e694e", "tabbable": null, "tooltip": null}}, "c94a6410d1e74de5be7381e1563b5ee1": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "ca6c108745d04fdd9f3c5af3e87b2676": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_a0a70551e34b4cec9f94336a2a27cc22", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_849a56db28824c1b80c6bf40628832a2", "tabbable": null, "tooltip": null, "value": 40.0}}, "cb04a514cdc4473295ed791ddd477ad7": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "cbe7f23f586b496588eb99700f0cd414": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_747a26404e184a94a332ee5a3e1df81b", "IPY_MODEL_7e71cc5c0087467abdcac91fda3dfaf3", "IPY_MODEL_fbe670cc345c4d64a738d98227051ba4"], "layout": "IPY_MODEL_b52d2f3c14e94ca0bf2862eb15cfb33c", "tabbable": null, "tooltip": null}}, "cdcacbf98e1041f9a9789d5a81f2b5c8": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "d5a7885ffe744a44972a0f412f26b69f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "d7898207cb854067a9d4d21ac47b4034": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "db641f20b1584a4eb42eb0300f21ea20": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_7151077734fe4691b420800c7add954e", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_fb57e112e0b64381b94afdb61c2532f2", "tabbable": null, "tooltip": null, "value": 40.0}}, "dca93335334a452fa60ec4394f312bc0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_14b67a7d0c2e47acba491c4fbad24327", "placeholder": "\u200b", "style": "IPY_MODEL_31996c5f07a5462ea6b2f104029c4ce5", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200751.50it/s]"}}, "dd9334cc21b34c60b1a28ed527c71832": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e00c6ea3c2784bcdb82aae96efe5a513": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "e279f11fb319439ebb36ac3ae8416cc9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e586788974d64795ae818200d27842ce": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_5c4636262e434db0b35ce9133b804040", "placeholder": "\u200b", "style": "IPY_MODEL_8734804d6f574457a797d5ecf1068b4e", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "e5fa2526dd6d42bda634733541d86947": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e70bdd1df74047e8b1421042467bca27": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_05e020a80e6040adb8896e56978b77c9", "IPY_MODEL_58ca533f051c42fa92b38a380a60e3b8", "IPY_MODEL_ee9bf85cf6614af58bc0b17a4bbb1340"], "layout": "IPY_MODEL_19e12e4d0e4640eab380b7b21c39794a", "tabbable": null, "tooltip": null}}, "e86042f544ee4d55844f2fa9c6176558": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_efe79474b9074b1e9762832533108805", "placeholder": "\u200b", "style": "IPY_MODEL_0a7f4e0633fc420a892a3705947ad728", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200749.70it/s]"}}, "e8e88d53b8b848ef915af0d2fa7d6fad": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e93f911dce3645e3844ee1497b9ded14": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "e9ef107572ef42568745ce246b9a5b2a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "ea5d4c6638c447728673b72cd27a4f79": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_6a5438db07ec4a9bad62dda53a5b8f2f", "placeholder": "\u200b", "style": "IPY_MODEL_438fbad435df4b4eb06ccd5af3503dcd", "tabbable": null, "tooltip": null, "value": "Epoch\u20074:\u2007100%"}}, "edad39f3b51c41b19b51a97d34a0a812": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "ee9bf85cf6614af58bc0b17a4bbb1340": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_126fa6f1230e4687b6d72a29d67b9f20", "placeholder": "\u200b", "style": "IPY_MODEL_19637e56e7f940dd9247859e2c5cb265", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200751.21it/s]"}}, "eeb9efdb744748e19d58f308478e9a71": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_3dd9b4b524e3495793002eb2ad4d1955", "IPY_MODEL_2d84750640614b5190967f67ee703343", "IPY_MODEL_013fe6b131e8413ea2b4fd404095e6d5"], "layout": "IPY_MODEL_3fa068d1ac9a4c7dba21fbcc5beb5b45", "tabbable": null, "tooltip": null}}, "ef5864236aad45d38b460cc9da72a6ed": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "efe79474b9074b1e9762832533108805": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "f00770caf41249eaaec5c3239d529f32": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_fe4e46d1f8004e3e8ce22bee7759a790", "placeholder": "\u200b", "style": "IPY_MODEL_abfb06de7746494e9d5d324a0908951b", "tabbable": null, "tooltip": null, "value": "\u2007157/157\u2007[00:14&lt;00:00,\u200711.16it/s,\u2007v_num=0,\u2007val_loss=0.522,\u2007val_acc=0.818]"}}, "f184f014756643f9a2b4ef072a5883e4": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_0f5e9c1cdd1a4a91a3cde9d00546167c", "placeholder": "\u200b", "style": "IPY_MODEL_573031c8c57340c296c515fcf36da3f1", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "f1b604be84674394885e23b041792ffb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_c2b5ddfd68b047d0a23d52be541515d6", "IPY_MODEL_9018bd8e0fad4f7eb67706754656c86b", "IPY_MODEL_38144a76c5db4760b1af6ac67cd8da43"], "layout": "IPY_MODEL_2ae89a0e99854c30ab267582afdb55bb", "tabbable": null, "tooltip": null}}, "f1c377119a7d4f9985a2ec6cea6f9554": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "f30c705e9e5b47a8938a9a4fe24c16fe": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "f37ebc1d44fa4ee1994c7dd1c339b5cb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "f465daf94d33407fac6dca02a00e1a5f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "f50a1e87c68d4f28961a8eef346641b5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "f5f91af9871f45bc96d29720a24bd91b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "f66e382a9af648f9bf0c3dd892453738": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "f786a89aaffc476f8d9f185f5f2dd394": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "f8e9e8deba274b68bb8cc8a9e495241e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "fad906acde69465092f63430e1f67113": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "fb57e112e0b64381b94afdb61c2532f2": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "fbe670cc345c4d64a738d98227051ba4": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_83ef57b528174a05899ef90f9687e643", "placeholder": "\u200b", "style": "IPY_MODEL_3b2370152e874a7cb90e38321a6642c4", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[01:24&lt;00:00,\u2007\u20070.48it/s]"}}, "fc89121f2bb64567ae816671c44fa5ef": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "fd9f591fc41b43518a97305b3a1fc1fb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_ac55f4acd4594124b0296e8645f7cb4c", "IPY_MODEL_967f4f024aff4ea68843deab5f022709", "IPY_MODEL_e86042f544ee4d55844f2fa9c6176558"], "layout": "IPY_MODEL_b6ae30fa989543e58b3d326abcfd9d0a", "tabbable": null, "tooltip": null}}, "fe4e46d1f8004e3e8ce22bee7759a790": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "feec48f1c15a43ab96fed0237b94dd32": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}}, "version_major": 2, "version_minor": 0}}}, "nbformat": 4, "nbformat_minor": 5}