calib config bs=-1:RuntimeError: Sizes of tensors must match except in dimension 0. Expected size 134 but got size 512 for tensor number 1 in the list

[Worromots]

my calib dataset is c4

It seems that different samples have different lengths and cannot be directly torch.cat(samples, dim=0)。

llmc/llmc/data/dataset/base_dataset.py", line 89, in get_calib_dataset
batch = torch.cat(samples, dim=0)
RuntimeError: Sizes of tensors must match except in dimension 0. Expected size 134 but got size 512 for tensor number 1 in the list

[helloyongyang]

Please show me your config