Indexing properties

Discussion related to "Everything" 1.5 Alpha.
Post Reply
harryray2
Posts: 1104
Joined: Sat Oct 15, 2016 9:56 am

Indexing properties

Post by harryray2 »

Apologies for coming back to this subject yet again.

I have two instances of Everything, the instance of Everything I use every so often has seven properties enabled. My regular daily Everything has properties disabled.

Each time I update to the latest version, the instance with properties enabled the properties are indexed from scratch. This takes an awfully long time each time.
NotNull
Posts: 5461
Joined: Wed May 24, 2017 9:22 pm

Re: Indexing properties

Post by NotNull »

Same question as in this recent similar thread:
What is the last rebuild reason reported under Tools -> Debug -> Statistics -> Build -> Last Rebuild Reason?


Topic moved to the Everything 1.5 Alpha forum. Please post there next time.
void
Developer
Posts: 16756
Joined: Fri Oct 16, 2009 11:31 pm

Re: Indexing properties

Post by void »

Does this issue occur in 1314a or later?
This version should reuse indexed property values.

What is the Last Rebuild Reason and Last Build Date under Tools -> Debug -> Statistics?

The database format has changed a few times with recent versions.
A database format change requires a full reindex.
Once Everything 1.5 is in beta the database format is unlikely to change.
harryray2
Posts: 1104
Joined: Sat Oct 15, 2016 9:56 am

Re: Indexing properties

Post by harryray2 »

Thanks, I've updated to 1314.

I can't be a 100% certain yet as I've allowed the properties to re-index this time after a couple of days as opposed to a much longer period between updating last time, but although still relatively slow, this does seem to be considerably faster.
Originally it was taking in excess of 3 hours to re-index.

I haven't changed my exclude list for a while but hopefully that will be faster as well.

The reason is 'Out of date index is available'
void
Developer
Posts: 16756
Joined: Fri Oct 16, 2009 11:31 pm

Re: Indexing properties

Post by void »

The reason is 'Out of date index is available'
This usually occurs when the USN Journal ID changes on an NTFS volume.
This can occur when there is many changes made to your NTFS volume.

Is there a particular drive that keeps getting reindexed? (for example: C: or D:?)

For volumes where you make a large number of changes, consider increasing the USN Journal size:
  • In Everything, from the Tools menu, click Options.
  • Click the NTFS tab on the left.
  • Select your NTFS volume where you making file system changes often.
  • Change the Maximum size to: 131072
  • (If the current maximum size is larger, please leave the larger value)


Use your Index -> Index Journal to monitor file system changes.
harryray2
Posts: 1104
Joined: Sat Oct 15, 2016 9:56 am

Re: Indexing properties

Post by harryray2 »

Thanks, I'll give it a try.

There isn't what one would call an excessive amount of changes, but I don't use the instance that has properties enabled on very often. Sometimes a gap of a couple of weeks or more between usage.
There are obviously quite a few changes in that period.

My main instance of Everything gets used every day, dozens of times a day, and properties aren't enabled so I can't do a like for like comparison.

What I'm now doing is starting up the second instance every day for a few minutes.
I'll be able to tell if it has made a difference next time I update Everything and properties re-index.
void
Developer
Posts: 16756
Joined: Fri Oct 16, 2009 11:31 pm

Re: Indexing properties

Post by void »

Yes, sounds like an USN Journal entry is deleted because Everything is run infrequently.
Everything will reindex your NTFS volume from scratch.

Previous versions would also reindex your properties.

1314a should no longer reindex your properties.

Please let me know if you find 1314a reindexing your properties.


Increasing the Maximum USN Journal Size might also be a good idea if you are running Everything infrequently.
This will prevent the reindex you are seeing.
harryray2
Posts: 1104
Joined: Sat Oct 15, 2016 9:56 am

Re: Indexing properties

Post by harryray2 »

Thanks, is that the maximum size in the indexes or NTFS section?
void
Developer
Posts: 16756
Joined: Fri Oct 16, 2009 11:31 pm

Re: Indexing properties

Post by void »

Tools -> Options -> NTFS:



For volumes where you make a large number of changes, consider increasing the USN Journal size:
  • Check Enable USN Journal.
  • Change the Maximum size to: 131072
  • Leave Allocation delta as the default.
harryray2
Posts: 1104
Joined: Sat Oct 15, 2016 9:56 am

Re: Indexing properties

Post by harryray2 »

I've changed the maximum size and installed the latest version....Huge improvement, thanks.
harryray2
Posts: 1104
Joined: Sat Oct 15, 2016 9:56 am

Re: Indexing properties

Post by harryray2 »

I see that adjusting the size on one instance affects all the instances...Presumably, there's no way round that?
horst.epp
Posts: 1447
Joined: Fri Apr 04, 2014 3:24 pm

Re: Indexing properties

Post by horst.epp »

harryray2 wrote: Mon Jun 06, 2022 3:12 pm I see that adjusting the size on one instance affects all the instances...Presumably, there's no way round that?
There is only one USN journal.
Post Reply