network share indexing speed

Discussion related to "Everything" 1.5 Alpha.
Post Reply
everythinguser21
Posts: 2
Joined: Wed Aug 14, 2024 9:18 pm

network share indexing speed

Post by everythinguser21 »

Just want to check to see if my index speed are within the normal range.
I just tried to index our network share by folders, running portable 64bit version with standard user privileges. There are 12 network folders and all up everything picked up about 30,000,000 files and 45TB of storage. However, index took about 4 days to finish. Is that normal? Any way to speed up the process?
void
Developer
Posts: 16753
Joined: Fri Oct 16, 2009 11:31 pm

Re: network share indexing speed

Post by void »

It will depend on:
  • Your NAS hardware/OS
  • Network speed
  • Disk IO (other writes/reads)


Everything should index your remote network shares at about 3 minutes per 1 million files.

On my old hardware, after a restart of the server, I am seeing less than 3 minutes per 1 million files with constant writes over 10GB ethernet.
Everything network bandwidth is about 4MB/s
Everything network usage is about 700MB per 1million files


Any way to speed up the process?
Check if your NAS is rate limiting SMB.

Please try Everything 1.5
Setup each network folder as multi-threaded (Tools -> Options -> Folders -> For each folder: Select a folder -> Right click -> Advanced -> Threads -> Multiple threads)
-Everything 1.5 will then read all 12 network folders at the same time.

Please try the Everything Server.
Setup the Everything Server as close as possible to your NAS. (ideally on your NAS)
everythinguser21
Posts: 2
Joined: Wed Aug 14, 2024 9:18 pm

Re: network share indexing speed

Post by everythinguser21 »

Sorry forgot to add, this was done on 1.5.0.1383a.x64. I'll try with the new settings.

I'm running index on the user side, so don't have access to the backend of the fileserver.
Post Reply