get / import: No storage files available #10572
Comments
|
Do you use local config in
is it a correct path? is it defined somewhere? |
shcheklein
added
triage
Hi, yes, I use
Hm, I don't understand your question. That path comes from within the dvc module. I suppose it downloads things into a temporary directory. |
was it committed into Git? did it have enough information alone to download objects from remote or you still had some local config or some other way to provide credentials for example?
👍 |
|
I nuked the blob store container to make sure. I made a clean one and re-added the data with |
|
I added log statements into the dvc code: def _get_fs_path(self, path: "AnyFSPath", info=None) -> FileInfo:
from .index import StorageKeyError
info = info or self.info(path)
if info["type"] == "directory":
raise IsADirectoryError(errno.EISDIR, os.strerror(errno.EISDIR), path)
entry: Optional[DataIndexEntry] = info["entry"]
assert entry
hash_info: Optional[HashInfo] = entry.hash_info
for typ in ["cache", "remote", "data"]:
try:
info = self.index.storage_map[entry.key]
storage = getattr(info, typ)
if not storage:
logger.error("No %s storage for %s", typ, entry) # <-- added
continue
data = storage.get(entry)
except (ValueError, StorageKeyError) as err:
logger.error("Failed to get %s file from %s: %s", typ, storage, err) # <-- added
continue
if data:
fs, fs_path = data
if fs.exists(fs_path):
return FileInfo(typ, storage, info.cache, hash_info, fs, fs_path)
raise FileNotFoundError(errno.ENOENT, "No storage files available", path)This is I get for So it says |
|
So when I pause the dvc program with an def _get_fs_path(self, path: "AnyFSPath", info=None) -> FileInfo:
from .index import StorageKeyError
info = info or self.info(path)
if info["type"] == "directory":
raise IsADirectoryError(errno.EISDIR, os.strerror(errno.EISDIR), path)
entry: Optional[DataIndexEntry] = info["entry"]
assert entry
hash_info: Optional[HashInfo] = entry.hash_info
for typ in ["cache", "remote", "data"]:
try:
info = self.index.storage_map[entry.key]
storage = getattr(info, typ)
if not storage:
logger.error("No %s storage for %s", typ, entry)
continue
else:
logger.debug("%s storage for %s", typ, entry)
data = storage.get(entry)
print("data", data)
except (ValueError, StorageKeyError) as err:
logger.error("Failed to get %s file from %s: %s", typ, storage, err)
continue
if data:
fs, fs_path = data
print("fs_path", fs_path)
print("fs", fs)
import IPython; IPython.embed()
if fs.exists(fs_path):
return FileInfo(typ, storage, info.cache, hash_info, fs, fs_path)and I check on the temporary directory, I see that it is empty. The print is But More prints and logs I added: It says |
|
|
what does it exactly mean? Is it can you try to do |
|
I tried with both. First used the one, then the other. Same error. |
|
okay, just to make sure we are running this on a clean env - have you tried to drop also, when |
Bug Report
Description
I have tracked files in
repo-aunderdata.dvc importanddvc getboth fail when trying to get files fromrepo-ainrepo-b.Reproduce
I cloned my own repo (
repo-a) under/tmpto test whetherdvc pullworks. It does. Then I checked status and remote:So that is all correct.
Then I go to my
repo-b. I configured the remote to be the same as the one ofrebo-a. Here is the check:Then I try to get the data from
repo-a. It failsThen I tried if I can push from
repo-b. I can.Same problem when I target a specific file:
But the file IS on the remote. I can pull it in the cloned
repo-a.Also, see this:
This file (
files/md5/8a/6de34918ed22935e97644bf465f920.dir) DOES exist on the remote!Environment information
Output of
dvc doctor:I already deleted
/var/tmp/dvc/. Did not help.The text was updated successfully, but these errors were encountered: