Is there an easy way to sync an s3 bucket to a local directory?

[lukehsiao]

I have a directory of files stored in an s3 bucket, and want to be able to sync them to a local directory on my machine, edit them, and then push them back. Is there an easy way to do so with s3fs?

[lukehsiao]

Ah, I believe I've found a good example in the tests.

s3fs/s3fs/tests/test_s3fs.py

Lines 1857 to 1866 in f26f379

	def test_get_directories(s3, tmpdir):
	s3.touch(test_bucket_name + "/dir/dirkey/key0")
	s3.touch(test_bucket_name + "/dir/dirkey/key1")
	s3.touch(test_bucket_name + "/dir/dirkey")
	s3.touch(test_bucket_name + "/dir/dir/key")
	d = str(tmpdir)
	s3.get(test_bucket_name + "/dir", d, recursive=True)
	assert {"dirkey", "dir"} == set(os.listdir(d))
	assert ["key"] == os.listdir(os.path.join(d, "dir"))
	assert {"key0", "key1"} == set(os.listdir(os.path.join(d, "dirkey")))

[martindurant]

We don't explicitly have a rsync-like method right now. fsspec/filesystem_spec#1074 discusses this - it would be an excellent new feature.