is there a way to expedite a search with many input keywords with |

If you are experiencing problems with "Everything", post here for assistance.
Post Reply
Tom.Zhang
Posts: 34
Joined: Wed Jun 03, 2015 8:51 am

is there a way to expedite a search with many input keywords with |

Post by Tom.Zhang »

hello,

I have more than 100 million files in everything server, actually they are logs from manufacturing test data, every file name contains serial number of products tested. if I am going to search some serial numbers' test data, let's say 10 thousand. normally I use below keywords: SN1|SN2|SN3...... It takes quite some time if serial numbers more than 300 (1-2minutes for 300 keywords). If keywords are more than 500, everything will stuck there for long time, it is quite painful if I need to search 10 thousand, need to code to spit input serial numbers to batch and search them one batch by one batch and finally combine them together.
Is there a way better than concate these keywords with | only?

thanks!
void
Developer
Posts: 16841
Joined: Fri Oct 16, 2009 11:31 pm

Re: is there a way to expedite a search with many input keywords with |

Post by void »

regex: may offer better performance here.

Please try:

regex:"SN1|SN2|SN3|..."

You'll still need to use | to separate names.



Can you tell us a little more about the filename format, do the filenames start with the serial number? end with the serial number? have some specific prefix?

For example:

startwith:<SN1|SN2|SN3|...>



Please make sure match path is unchecked under the Search menu.
Searching the full path for 100 million+ files with a large | list will hurt performance.

Please try using match case and match diacritics for improved performance:

case:diacritics:<SN1|SN2|SN3|...>



You can paste multi-line text into the Everything search box.
Each line is separated with: |
This might help with entering your search.
(requires Everything 1.5)



There's also file list slots, but these will not help performance unless you are matching the full filename.
Tom.Zhang
Posts: 34
Joined: Wed Jun 03, 2015 8:51 am

Re: is there a way to expedite a search with many input keywords with |

Post by Tom.Zhang »

Thanks.

These files' names start with SN. for example:
W0PAL27_Final2_TraceView_20210310_172757_DUTORDERED_CHAN0.txt
this is a real file name.

W0PAL27 is the SN.
Final2 is my test station, it is known and fixed for my search.
TraceView is the fixed string.
the rest are test time stamp and other info.

seems i can use startwith?
void
Developer
Posts: 16841
Joined: Fri Oct 16, 2009 11:31 pm

Re: is there a way to expedite a search with many input keywords with |

Post by void »

For Everything 1.4, please try:

case:diacritics:startwith:SN1|case:diacritics:startwith:SN2|case:diacritics:startwith:SN3|...

-or-

case:regex:"^(SN1|SN2|SN3|...)"



With Everything 1.5, please try:

case:diacritics:startwith:<SN1|SN2|SN3|...>
Tom.Zhang
Posts: 34
Joined: Wed Jun 03, 2015 8:51 am

Re: is there a way to expedite a search with many input keywords with |

Post by Tom.Zhang »

Thanks!
now I can get 1000 SNs in 30s (10k files, full path and recent modified date time) and 16k SNs (160k files) in 6.5 minutes.
It is huge improvement than before!
therube
Posts: 4985
Joined: Thu Sep 03, 2009 6:48 pm

Re: is there a way to expedite a search with many input keywords with |

Post by therube »

And what, "case:diacritics:startwith:", while not needed, per se, are filters, so end up lessening what needs to be done, & with such a huge number of files, it makes a difference?
Post Reply