It looks like s3fs has issues with S3 and the latest pyfilesystem2? Maybe it's the prefix?
>>> from fs_s3fs import S3FS >>> fs = S3FS('my-bucket', aws_access_key_id="XXX", aws_secret_access_key="YYY") >>> fs.tree() └── 89cf0ccb-a492-4495-9022-e53dc2ed1461
└── error (resource '/89cf0ccb-a492-4495-9022-e53dc2ed1461' not found)
>>> import boto3
>>> s3 = boto3.resource('s3', aws_access_key_id="XXX", aws_secret_access_key="YYY") >>> my_bucket = s3.Bucket('my-bucket')
>>> list(my_bucket.objects.all()) [s3.ObjectSummary(bucket_name='my-bucket' key='89cf0ccb-a492-4495-9022-e53dc2ed1461/about.md'),
s3.ObjectSummary(bucket_name='my-bucket', key='89cf0ccb-a492-4495-9022-e53dc2ed1461/data.h5ad'),
s3.ObjectSummary(bucket_name='my-bucket', key='89cf0ccb-a492-4495-9022-e53dc2ed1461/markers.csv')]
It looks like s3fs has issues with S3 and the latest pyfilesystem2? Maybe it's the prefix?