1

我已将大量 CSV 文件列表添加到我的 dvc 存储库中,但是当我尝试进行 DVC 推送时,它会抱怨

ERROR: unexpected error - KeyError('fileSize')

编辑 所以搜索它似乎可能有助于包含有关错误的详细日志。

T11:27:08~/documents/*****/data$ dvc push -v
2022-02-01 11:32:13,186 DEBUG: Adding '/home/jhylands/Documents/*****/.dvc/config.local' to gitignore file.
2022-02-01 11:32:13,199 DEBUG: Adding '/home/jhylands/Documents/*****/.dvc/tmp' to gitignore file.
2022-02-01 11:32:13,200 DEBUG: Adding '/home/jhylands/Documents/*****/.dvc/cache' to gitignore file.
2022-02-01 11:32:14,102 DEBUG: Preparing to transfer data from '/home/jhylands/Documents/*****/.dvc/cache' to '*********'
2022-02-01 11:32:14,102 DEBUG: Preparing to collect status from '********'
2022-02-01 11:32:14,103 DEBUG: Collecting status from '*******'
2022-02-01 11:32:14,439 DEBUG: GDrive remote auth with config '{'client_config_backend': 'settings', 'client_config_file': 'client_secrets.json', 'save_credentials': True, 'oauth_scope': ['https://www.googleapis.com/auth/drive', 'https://www.googleapis.com/auth/drive.appdata'], 'save_credentials_backend': 'file', 'save_credentials_file': '/home/jhylands/Documents/*****/.dvc/tmp/gdrive-user-credentials.json', 'get_refresh_token': True, 'client_config': {'client_id': '*****.apps.googleusercontent.com', 'client_secret': '****************', 'auth_uri': 'https://accounts.google.com/o/oauth2/auth', 'token_uri': 'https://oauth2.googleapis.com/token', 'revoke_uri': 'https://oauth2.googleapis.com/revoke', 'redirect_uri': ''}}'.
2022-02-01 11:32:14,994 DEBUG: Estimated remote size: 256 files
2022-02-01 11:32:14,995 DEBUG: Querying '316' hashes via traverse
2022-02-01 11:32:15,325 ERROR: unexpected error - KeyError('fileSize')
------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jhylands/.local/lib/python3.8/site-packages/pydrive2/files.py", line 226, in __getitem__
    return dict.__getitem__(self, key)
KeyError: 'fileSize'


During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/main.py", line 55, in main
    ret = cmd.do_run()
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/command/base.py", line 45, in do_run
    return self.run()
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/command/data_sync.py", line 57, in run
    processed_files_count = self.repo.push(
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/repo/__init__.py", line 49, in wrapper
    return f(repo, *args, **kwargs)
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/repo/push.py", line 56, in push
    pushed += self.cloud.push(
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/data_cloud.py", line 85, in push
    return transfer(
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/objects/transfer.py", line 153, in transfer
    status = compare_status(src, dest, obj_ids, check_deleted=False, **kwargs)
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/objects/status.py", line 158, in compare_status
    dest_exists, dest_missing = status(
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/objects/status.py", line 131, in status
    exists.update(odb.hashes_exist(hashes, name=odb.fs_path, **kwargs))
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/objects/db/base.py", line 499, in hashes_exist
    remote_hashes = set(
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/objects/db/base.py", line 334, in _list_hashes_traverse
    yield from itertools.chain.from_iterable(in_remote)
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 611, in result_iterator
    yield fs.pop().result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 439, in result
    return self.__get_result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/objects/db/base.py", line 324, in list_with_update
    return list(
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/objects/db/base.py", line 215, in _list_hashes
    for path in self._list_paths(prefix, progress_callback):
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/objects/db/base.py", line 195, in _list_paths
    for file_info in self.fs.find(fs_path, prefix=prefix):
  File "/home/jhylands/.local/lib/python3.8/site-packages/dvc/fs/fsspec_wrapper.py", line 107, in find
    yield from self.fs.find(path)
  File "/home/jhylands/.local/lib/python3.8/site-packages/pydrive2/fs/spec.py", line 323, in find
    "size": int(item["fileSize"]),
  File "/home/jhylands/.local/lib/python3.8/site-packages/pydrive2/files.py", line 229, in __getitem__
    raise KeyError(e)
KeyError: KeyError('fileSize')
4

0 回答 0