Anything larger than 10 million files in one bucket is fine, but the web GUI just displays a message saying, "Use the command line." There are a few things you can still do in the Web GUI above 10 million files, like if the bucket fits within a 10 TByte snapshot (for example, if the bucket is 11 million files, but only 9 TBytes total when you add all their sizes up). It is the biggest "hard limit" of 10 million files. The Web UI was originally designed for customers to interact with right at the beginning, and to do a few basic things. It was an outlier, the next largest number of files in one bucket was only 3.4 billion and there are several more customers in that range. On December 31st, 2021 the largest number of files in one bucket in Backblaze B2 contained 9,139,321,193 files. There are some limitations to be aware of in the web UI, and some design thoughts to think through in advance.Įach year on December 31st, I record some statistics internally at Backblaze. The number of files won't affect "stability". How many files a single bucket can take in B2 before becoming unstable If anyone has had experiences with even larger buckets than 4 million files, I would be keen to hear your experience!ĭisclaimer: I work at Backblaze so you should keep me honest. Though this was just an accidental test and not part of our designed usage, it made me wonder how many files in a single bucket is too many for some of the B2 functionality to become degraded. In my experience the web UI and S3 clients were getting some odd results when dealing with 2 to 4 million files in large scale operations running on the bucket simultaneously, with some clients receiving empty file lists and list commands timing out. I understand from the docks that in the design of B2 files in buckets are all identified individually and folders are just files which happen to have paths in the name, so segregating by folders and such is not possible as a means to break up a bucket that has lots of files. I'm interested to know if anyone had any pointers or experience in terms of how many files a single bucket can take in B2 before becoming unstable.
0 kommentar(er)
