/gpfs/projects/LynchGroup/spacewhale/git_spacewhale/spacewhale/shell_scripts
/gpfs/projects/LynchGroup/spacewhale
Mon May 20 22:35:07 EDT 2019
training resnext, lr=test??
######################################################################################################
WELCOME TO SPACEWHALE!
######################################################################################################
We will now train your model.. please be patient
Using resneXt Your trained model will be named resnect_tester
------------------------------------------------------------------------------
<torch.utils.data.dataloader.DataLoader object at 0x2aaafb361c88>
Your dataset size is: 12545
You have 2 classes in your dataset
------------------------------------------------------------------------------
Labels for the dataset are:
water = 0
whale = 1
------------------------------------------------------------------------------
Data loaded into gpu
------------------------------------------------------------------------------
/gpfs/projects/LynchGroup/spacewhale/git_spacewhale/spacewhale
Epoch 0/23
----------
Traceback (most recent call last):
  File "training_tester_weighted3.py", line 130, in <module>
    model_ft = s.train_model(opt, device, dataset_sizes, dataloaders, model_ft, criterion, optimizer_ft, exp_lr_scheduler, num_epochs=opt.epochs)
  File "/gpfs/projects/LynchGroup/spacewhale/git_spacewhale/spacewhale/m_util2.py", line 127, in train_model
    loss = criterion(outputs, labels)
  File "/gpfs/projects/LynchGroup/spacewhale/space_env/lib/python3.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/gpfs/projects/LynchGroup/spacewhale/space_env/lib/python3.7/site-packages/torch/nn/modules/loss.py", line 862, in forward
    ignore_index=self.ignore_index, reduction=self.reduction)
  File "/gpfs/projects/LynchGroup/spacewhale/space_env/lib/python3.7/site-packages/torch/nn/functional.py", line 1550, in cross_entropy
    return nll_loss(log_softmax(input, 1), target, weight, None, ignore_index, None, reduction)
  File "/gpfs/projects/LynchGroup/spacewhale/space_env/lib/python3.7/site-packages/torch/nn/functional.py", line 1409, in nll_loss
    return torch._C._nn.nll_loss2d(input, target, weight, _Reduction.get_enum(reduction), ignore_index)
RuntimeError: 1only batches of spatial targets supported (non-empty 3D tensors) but got targets of size: : [32]
Mon May 20 22:35:15 EDT 2019
