NAS for large amounts of files.

NAS for large amounts of files.

an interesting question for You, probably even worth a YouTube video. I can barely find any information about it.

I am in need to consolidate 15 years of my digital life. I literally have a box of harddrives – ide, sata, ssd, CD’s and even floppy disks that I have used in my computers over the years. To be sure I have ALL the files from disks, even deleted ones, I use some data recovery programs. As a result, I have recoveries from each disk, including windows stuff that I will need to sort out later. That all comes with not much space, but millions of files. For instance, one backup from one disk: 235 GB (553 773 files, 72 602 folders).

Currently I have about 11 TB of data and ~20 millions of files. My goal is to gather everything into one place and start sorting data out (remove duplicates etc.) I estimate that everything could be around 40TB+. The problem would not be disk space, but AMOUNT OF FILES.

According to my poor (IMHO) research, NONE of Synology devices suit my needs (if looking for max supported file count). I was hoping that maybe there is some ready to use NAS that supports truckload of files, preferrably with ZFS support. I am considering building NAS from some old server myself, however, due to lack of skills with ZFS, I would prefer to avoid to play with my precious files. 😀

You might have misunderstood the file limit. Synology will not limit you regards to a number of the files you store. The only limits you will see is in Dropbox-like apps like Cloud Station and Drive. These apps have to syncronise a folder between your computer and a NAS. This is resource consuming tasks if we are talking about 1million files to syncronise. Rest assured that you can easily store all your data on a Synology NAS.

Something like DS1618+ will be a great future proof data storage solution with a possibility to upgrade to a 10GbE network later.

Cloud Station Server

Maximum Number of Hosted Files (btrfs) 1,000,000

Synology Drive

Recommended Number of Hosted Files 1,000,000 (applies to files indexed or hosted by Synology Drive. For file access through other standard protocols, refer to the File Services section above)

Find regulary updated NAS offers here
Of course I would prefer you choose AMAZON UK AMAZON USA to buy your perfect solution, however, if you would rather buy locally, please use the links used above to take you to your local Amazon store and help support this free advice service with ad revenue. More ways of supporting the blog are described HERE  

Home: https://www.backblaze.com/cloud-backup.html#af9rgr Business: https://www.backblaze.com/business-backup.html#af9rgr Comparison with other service providers: https://www.backblaze.com/best-online-backup-service.html#af9rgr  

If you like this service, please consider supporting us.
We use affiliate links on the blog allowing NAScompares information and advice service to be free of charge to you. Anything you purchase on the day you click on our links will generate a small commission which is used to run the website. Here is a link for Amazon and B&H. You can also get me a ☕ Ko-fi or old school Paypal. Thanks! To find out more about how to support this advice service check HERE   If you need to fix or configure a NAS, check Fiver   Have you thought about helping others with your knowledge? Find Instructions Here  

☕ WE LOVE COFFEE ☕

Or support us by using our affiliate links on Amazon UK and Amazon US
     

locked content ko-fi subscribe

DISCUSS with others your opinion about this subject.
ASK questions to NAS community
SHARE more details what you have found on this subject
CONTRIBUTE with your own article or review. Click HERE
IMPROVE this niche ecosystem, let us know what to change/fix on this site
EARN KO-FI Share your knowledge with others and get paid for it! Click HERE

ASK YOUR QUESTIONS HERE!