Summary/Reported Issue
When attempting to run a drop table command in a S3 source using MinIO as the object storage, the data files are deleted but the folders that correspond to the table does not get deleted as expected.
Relevant Versions
Dremio 25.0.x, other versions may be affected
Troubleshooting Steps
- Create a bucket with versioning enabled, then create a table in that bucket.
- Insert some dummy data into the table so that data files are generated.
- Drop the table and check MinIO, you should see that the data files are gone but the folders remain.
- Create a new bucket with versioning disabled and try the reproduction steps again (create, insert, drop).
- The unversioned bucket should not have the same issue and the folder should also be gone.
Cause
This appears to be an artifact of versioning specifically in MinIO.
Steps to Resolve
Disable versioning in your MinIO bucket.
Next Steps
N/A
Additional Resources
AWS S3 versioning works as expected, it is not affected by this issue.