Everything stuck when I try to enter the regex and other problem

Found a bug in "Everything"? report it here
Post Reply
Debugger
Posts: 630
Joined: Thu Jan 26, 2017 11:56 am

Everything stuck when I try to enter the regex and other problem

Post by Debugger »

Everything stuck when I try to enter the regex
Non-Stop Scans multiple disks.
Automatically refreshes and again scans disks, then again in 15 minutes and again 15 minutes and so every time.
How to disable the "Update list"
Probably caused by 1,200,000 deleted files in Explorer with a super-small size (2KB)

2017-02-19 10:32:55.034: updated fd for linkcollector1469 in 0.000001 seconds

https://s17.postimg.org/j41q4og7j/Scree ... _28_AM.gif

Image
Image
Top
void
Developer
Posts: 16680
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything stuck when I try to enter the regex and other problem

Post by void »

Everything stuck when I try to enter the regex
Everything would be busy updating its database.
File deletion is usually very quick, with little CPU usage from Everything. deleting 1,000,000 files would require significant CPU usage.
15 minutes seems excessive, so there may be an issue here, however, I am going to assume this 15 minutes is actually a rebuild because the USN Journal is out of date.
Non-Stop Scans multiple disks.
Automatically refreshes and again scans disks, then again in 15 minutes and again 15 minutes and so every time.
Your USN Journals are being filled too quickly.
The USN Journal records changes to NTFS volumes.
Normally the USN Journal size is only 32MB, which is very roughly about 30,000 changes.

If you are often deleting 1,000,000+ files, please consider increasing your USN Journal size:
  • In Everything, from the Tools menu, click Options
  • Click the NTFS tab.
  • Select the disk you are often deleting millions of files from.
  • Change maximum size to atleast: 33554432 KB
    Note: this will require 32GB of free space on your NTFS volume.

How to disable the "Update list"
To pause index updating:
  • In Everything, type in the following search and press ENTER:
    /monitor_pause
To resume index updating:
  • In Everything, type in the following search and press ENTER:
    /monitor_resume
Top
Debugger
Posts: 630
Joined: Thu Jan 26, 2017 11:56 am

Re: Everything stuck when I try to enter the regex and other problem

Post by Debugger »

USN Journal
C:\Extends\$UsnJrnl:$J:$DATA

Total Size: 20 GB (all disk)
Everything
43 mln 3HDD (20-30 minutes scanning)
100 mln 5HDD (1+ hours scanning)



------------------------------

App Use 5GB 43 mln files 3HDD (3 minutes scanning) ULTRAFAST Kingston DDR3 1600 MHz
App Use 12GB 100 mln files 5HDD (6 minutes scanning) ULTRAFAST Kingston DDR3 1600 MHz
consumes less RAM and CPU Delete 10 mln files 25% CPU
NonNameTool:
6.05.2016
I added locks to avoid data structures to be updated while in use.
So there is this lock while deleting the files, because it uses the data, and this locks the thread that updating the data in realtime. this may cause data to accumulate in memory and cause large RAM usage.
How long will it take to index my files?
"Everything" only indexes file and folder names and generally takes a few seconds to build its database.
A fresh install of Windows 10 (about 70,000 files) will take about 1 second to index.
1,000,000 files will take about 1 minute.


NonNameTool more fast 32 second (HDD) = 10 ml
Top
void
Developer
Posts: 16680
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything stuck when I try to enter the regex and other problem

Post by void »

Please post your Everything profiling information so we can see what is happening:
  • In Everything, type in the following search and press ENTER:
    /debug
  • In Everything, from the Tools menu, click Options.
  • Click the Indexes tab.
  • Click Force rebuild.
  • What is displayed in the debug console? (To copy all the text in the console, right click the console title bar and from the Edit submenu, click Select All, press Enter)
  • Paste the log here, or send to support@voidtools.com
Top
Debugger
Posts: 630
Joined: Thu Jan 26, 2017 11:56 am

Re: Everything stuck when I try to enter the regex and other problem

Post by Debugger »

Updating database ...
Updates tens of millions of files.
It takes so much time that the damage to waste time on such a slow start!

C:\Everything-1.4.1.842b.x64\Everything.exe /debug
Log records 100.000.000 names, so no privacy.

Code: Select all

updated fd for perfh019.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for 0009 in 0.000000 seconds
remove subfolders and files from 0009
create thread
create thread
create thread
create thread
parent backup count 0
create thread
create thread
create thread
create thread
removed 0 subfolders and 0 files from 0009 in 0.185576 seconds
updated fd for WmiApRpl in 0.000000 seconds
updated fd for 0015 in 0.000001 seconds
remove subfolders and files from 0015
create thread
create thread
create thread
create thread
parent backup count 0
create thread
create thread
create thread
create thread
removed 0 subfolders and 0 files from 0015 in 0.177141 seconds
updated fd for WmiApRpl in 0.000001 seconds
updated fd for WmiApRpl in 0.000001 seconds
remove subfolders and files from WmiApRpl
create thread
create thread
create thread
create thread
parent backup count 0
create thread
create thread
create thread
create thread
MSG: 00000000000c0894 0113 000000000000002d 0000000000000000
removed 0 subfolders and 0 files from WmiApRpl in 0.177613 seconds
updated fd for inf in 0.000000 seconds
updated fd for inf in 0.000000 seconds
updated fd for WmiApRpl in 0.000001 seconds
updated fd for WmiApRpl in 0.000000 seconds
updated fd for WmiApRpl.h in 0.000001 seconds
updated fd for WmiApRpl in 0.000001 seconds
updated fd for WmiApRpl.h in 0.000001 seconds
updated fd for WmiApRpl in 0.000001 seconds
updated fd for WmiApRpl in 0.000000 seconds
updated fd for WmiApRpl.h in 0.000000 seconds
updated fd for WmiApRpl in 0.000000 seconds
updated fd for WmiApRpl in 0.000000 seconds
updated fd for WmiApRpl.h in 0.000001 seconds
updated fd for WmiApRpl in 0.000000 seconds
updated fd for WmiApRpl in 0.000001 seconds
updated fd for 0015 in 0.000001 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for WmiApRpl.ini in 0.000001 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for WmiApRpl.ini in 0.000000 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for WmiApRpl.ini in 0.000001 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for 0015 in 0.000001 seconds
updated fd for WmiApRpl.ini in 0.000000 seconds
updated fd for 0015 in 0.000000 seconds
updated fd for WmiApRpl in 0.000000 seconds
updated fd for 0009 in 0.000001 seconds
updated fd for 0009 in 0.000001 seconds
updated fd for WmiApRpl.ini in 0.000000 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for WmiApRpl.ini in 0.000001 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for WmiApRpl.ini in 0.000000 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for WmiApRpl.ini in 0.000001 seconds
updated fd for 0009 in 0.000000 seconds
updated fd for System32 in 0.000001 seconds
updated fd for System32 in 0.000000 seconds
updated fd for PerfStringBackup.TMP in 0.000001 seconds
updated fd for System32 in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for PerfStringBackup.TMP in 0.000000 seconds
updated fd for System32 in 0.000001 seconds
updated fd for PerfStringBackup.INI in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for PerfStringBackup.INI in 0.000001 seconds
updated fd for System32 in 0.000000 seconds
updated fd for PerfStringBackup.INI in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for PerfStringBackup.INI in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for PerfStringBackup.INI in 0.000001 seconds
updated fd for System32 in 0.000001 seconds
updated fd for System32 in 0.000001 seconds
updated fd for perfc009.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfc009.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfc009.dat in 0.000000 seconds
updated fd for System32 in 0.000001 seconds
updated fd for perfh009.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfh009.dat in 0.000001 seconds
updated fd for System32 in 0.000001 seconds
updated fd for perfh009.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfc015.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfc015.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfc015.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfh015.dat in 0.000001 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfh015.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfh015.dat in 0.000000 seconds
updated fd for System32 in 0.000001 seconds
updated fd for perfc019.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfc019.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfc019.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfh019.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfh019.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for perfh019.dat in 0.000000 seconds
updated fd for System32 in 0.000000 seconds
updated fd for CaptureCore_v7.stat in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for nvdrsdb1.bin in 0.000000 seconds
updated fd for Drs in 0.000000 seconds
updated fd for nvdrsdb1.bin in 0.000000 seconds
updated fd for Drs in 0.000000 seconds
updated fd for nvdrsdb1.bin in 0.000000 seconds
updated fd for Drs in 0.000000 seconds
updated fd for nvdrssel.bin in 0.000001 seconds
updated fd for Drs in 0.000000 seconds
updated fd for nvdrssel.bin in 0.000000 seconds
updated fd for Drs in 0.000000 seconds
updated fd for AudioDriver.log in 0.000000 seconds
updated fd for NvVAD in 0.000000 seconds
updated fd for AudioDriver.log in 0.000000 seconds
updated fd for NvVAD in 0.000000 seconds
updated fd for CaptureCore.log in 0.000001 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000001 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000001 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000001 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for Videos in 0.000000 seconds
remove subfolders and files from Tdbswd56spcap
create thread
create thread
create thread
create thread
parent backup count 0
create thread
create thread
create thread
create thread
removed 0 subfolders and 0 files from Tdbswd56spcap in 0.173743 seconds
updated fd for Videos in 0.000001 seconds
updated fd for Temp in 0.000000 seconds
remove subfolders and files from Tdbswd56spcap
create thread
create thread
create thread
create thread
parent backup count 0
create thread
create thread
create thread
create thread
MSG: 00000000000c0894 0113 000000000000002d 0000000000000000
removed 0 subfolders and 0 files from Tdbswd56spcap in 0.193949 seconds
updated fd for Temp in 0.000000 seconds
updated fd for CaptureCore.log in 0.000001 seconds
updated fd for ShadowPlay in 0.000001 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000001 seconds
updated fd for ShadowPlay in 0.000001 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000001 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000001 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000001 seconds
updated fd for ShadowPlay in 0.000001 seconds
updated fd for CaptureCore.log in 0.000001 seconds
updated fd for ShadowPlay in 0.000001 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000001 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore.log in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for CaptureCore_v7.stat in 0.000000 seconds
updated fd for ShadowPlay in 0.000000 seconds
updated fd for ShadowPlayUsage.xml in 0.000000 seconds
updated fd for NvBackend in 0.000000 seconds
updated fd for ShadowPlayUsage.xml in 0.000001 seconds
updated fd for NvBackend in 0.000000 seconds
updated fd for ShadowPlayUsage.xml in 0.000000 seconds
updated fd for NvBackend in 0.000000 seconds
updated fd for journalBS.jour.dat in 0.000000 seconds
updated fd for NvBackend in 0.000000 seconds
updated fd for GAUS.data in 0.000000 seconds
updated fd for NvBackend in 0.000001 seconds
updated fd for GAUS.data in 0.000000 seconds
updated fd for NvBackend in 0.000000 seconds
updated fd for GAUS.data in 0.000000 seconds
updated fd for NvBackend in 0.000001 seconds
updated fd for TarConStat.dat in 0.000000 seconds
updated fd for NvBackend in 0.000000 seconds
updated fd for NvBackend in 0.000001 seconds
updated fd for 00009c7b in 0.000001 seconds
remove subfolders and files from 00009c7b
create thread
create thread
create thread
create thread
parent backup count 0
create thread
create thread
create thread
create thread
removed 0 subfolders and 0 files from 00009c7b in 0.172638 seconds
updated fd for Packages in 0.000000 seconds
updated fd for Packages in 0.000000 seconds
updated fd for 00009ce6 in 0.000000 seconds
updated fd for Temp in 0.000001 seconds
updated fd for Temp in 0.000000 seconds
updated fd for TMPBA524A5A556EE4ED in 0.000001 seconds
updated fd for Temp in 0.000001 seconds
updated fd for Temp in 0.000000 seconds
updated fd for Temp in 0.000000 seconds
updated fd for Temp in 0.000001 seconds
updated fd for update.bin in 0.000001 seconds
updated fd for drs in 0.000001 seconds
updated fd for update.bin in 0.000001 seconds
updated fd for drs in 0.000001 seconds
updated fd for drs in 0.000001 seconds
updated fd for update.bin in 0.000001 seconds
updated fd for drs in 0.000001 seconds
updated fd for drs in 0.000000 seconds
updated fd for update.bin in 0.000000 seconds
updated fd for drs in 0.000000 seconds
updated fd for Temp in 0.000000 seconds
updated fd for Temp in 0.000000 seconds
updated fd for Temp in 0.000001 seconds
updated fd for Temp in 0.000000 seconds
updated fd for nsr6D82.tmp in 0.000000 seconds
updated fd for nsr6D82.tmp in 0.000000 seconds
updated fd for System.dll in 0.000001 seconds
updated fd for nsr6D82.tmp in 0.000001 seconds
updated fd for nsr6D82.tmp in 0.000000 seconds
updated fd for System.dll in 0.000001 seconds
updated fd for nsr6D82.tmp in 0.000001 seconds
updated fd for Temp in 0.000000 seconds
updated fd for Temp in 0.000001 seconds
updated fd for Temp in 0.000000 seconds
updated fd for TMP5E6D53FFDE7A4816 in 0.000001 seconds
updated fd for Temp in 0.000000 seconds
updated fd for nsr6D82.tmp in 0.000000 seconds
updated fd for Temp in 0.000001 seconds
remove subfolders and files from nsr6D82.tmp
create thread
create thread
create thread
create thread
parent backup count 0
create thread

Code: Select all

eason CLOSE DELETE (80000200), filename x_9209bfc7.jpg
USN DELETE CLOSE x_de9e33e0.jpg
USN_RECORD 190533408, FLAGS 00002020, PARENT FRN 0001000000212ad4, FRN 0001000000212b03, r
eason CLOSE DELETE (80000200), filename x_de9e33e0.jpg
USN DELETE CLOSE x_a3b19bfa.jpg
USN_RECORD 190533496, FLAGS 00002020, PARENT FRN 00010000002056da, FRN 00010000002056f5, r
eason CLOSE DELETE (80000200), filename x_a3b19bfa.jpg
USN DELETE CLOSE x_e0fee225.jpg
USN_RECORD 190533632, FLAGS 00002020, PARENT FRN 00010000001ef4b6, FRN 00010000001ef4fc, r
eason CLOSE DELETE (80000200), filename x_e0fee225.jpg
USN DELETE CLOSE x_2f3b074d.jpg
USN_RECORD 190533720, FLAGS 00002020, PARENT FRN 00010000001eab9a, FRN 00010000001eabca, r
eason CLOSE DELETE (80000200), filename x_2f3b074d.jpg
USN DELETE CLOSE x_796d3519.jpg
USN_RECORD 190533808, FLAGS 00002020, PARENT FRN 00010000001fb8cc, FRN 00010000001fb8ec, r
eason CLOSE DELETE (80000200), filename x_796d3519.jpg
USN DELETE CLOSE x_a7e546bc.jpg
USN_RECORD 190533896, FLAGS 00002020, PARENT FRN 00010000001eb37a, FRN 00010000001eb389, r
eason CLOSE DELETE (80000200), filename x_a7e546bc.jpg
USN DELETE CLOSE x_65e2c96b.jpg
USN_RECORD 190533984, FLAGS 00002020, PARENT FRN 0001000000246007, FRN 0001000000246023, r
eason CLOSE DELETE (80000200), filename x_65e2c96b.jpg
USN DELETE CLOSE x_f915b78e.jpg
USN_RECORD 190534072, FLAGS 00002020, PARENT FRN 000100000024c4e6, FRN 000100000024c502, r
eason CLOSE DELETE (80000200), filename x_f915b78e.jpg
USN DELETE CLOSE x_0bb60ce1.jpg
USN_RECORD 190534160, FLAGS 00002020, PARENT FRN 00010000001fffb9, FRN 00010000001fffe0, r
eason CLOSE DELETE (80000200), filename x_0bb60ce1.jpg
USN DELETE CLOSE x_d8819c2b.jpg
USN_RECORD 190534248, FLAGS 00002020, PARENT FRN 000100000026189a, FRN 00010000002618c5, r
eason CLOSE DELETE (80000200), filename x_d8819c2b.jpg
USN DELETE CLOSE x_218dbafc.jpg
USN_RECORD 190534336, FLAGS 00002020, PARENT FRN 000100000023c5e2, FRN 000100000023c601, r
eason CLOSE DELETE (80000200), filename x_218dbafc.jpg
USN DELETE CLOSE x_bff1423d.jpg
USN_RECORD 190534424, FLAGS 00002020, PARENT FRN 000100000022bb68, FRN 000100000022bc2b, r
eason CLOSE DELETE (80000200), filename x_bff1423d.jpg
USN DELETE CLOSE x_8b9cfe44.jpg
USN_RECORD 190534512, FLAGS 00002020, PARENT FRN 00010000001d57dd, FRN 00010000001d580f, r
eason CLOSE DELETE (80000200), filename x_8b9cfe44.jpg
USN DELETE CLOSE x_d0ecf438.jpg
USN_RECORD 190534600, FLAGS 00002020, PARENT FRN 00010000002066bd, FRN 00010000002066ed, r
eason CLOSE DELETE (80000200), filename x_d0ecf438.jpg
USN DELETE CLOSE x_4ed58a35.jpg
USN_RECORD 190534688, FLAGS 00002020, PARENT FRN 0001000000272a2c, FRN 0001000000272a53, r
eason CLOSE DELETE (80000200), filename x_4ed58a35.jpg
USN DELETE CLOSE x_99813755.jpg
USN_RECORD 190534776, FLAGS 00002020, PARENT FRN 00010000001ea083, FRN 00010000001ea11f, r
eason CLOSE DELETE (80000200), filename x_99813755.jpg
updated O: in 0.055019 seconds
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
waited 62
EVENT: 0000000140047e20 00000000002f5130
create thread
monitor wakeup timer 33
WAIT 33, 21 waits
_db_monitor_ntfs_process_usn_records_thread_proc
EVENT: 0000000140043150 00000000002f5130
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
updated fd for 104233781_0 in 0.000066 seconds
EVENT: 0000000140050820 0000000000312040
EVENT: 00000001400147f0 00000000002f5130
updated fd for 139410872_0 in 0.000002 seconds
updated fd for 139710942_0 in 0.000003 seconds
updated fd for 126994871_0 in 0.000002 seconds
updated fd for 139710942_0 in 0.000002 seconds
updated fd for 53768376_0 in 0.000003 seconds
updated fd for 137131155_0 in 0.000002 seconds
updated fd for 133680262_0 in 0.000002 seconds
waited 47
updated fd for 120306229_0 in 0.000002 seconds
monitor wakeup timer 657
WAIT 657, 22 waits
updated fd for 117418112_0 in 0.000002 seconds
updated fd for 128687492_0 in 0.000003 seconds
updated fd for 117866320_0 in 0.000002 seconds
updated fd for 65043929_0 in 0.000002 seconds
MSG: 00000000000c0894 0113 000000000000002d 0000000000000000
updated fd for 69142549_0 in 0.000001 seconds
updated fd for 132102414_0 in 0.000002 seconds
updated fd for 84553190_0 in 0.000002 seconds
updated fd for 58464015_0 in 0.000002 seconds
updated fd for 43674669_0 in 0.000002 seconds
updated fd for 102153267_0 in 0.000002 seconds
updated fd for 133879641_0 in 0.000002 seconds
updated fd for 96640727_0 in 0.000001 seconds
updated fd for 116748652_0 in 0.000002 seconds
processed usn records in 0.383777 seconds
processed ntfs usn records in 0.387058 seconds
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
EVENT: 00000001400193a0 00000000002f5130
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.001204 seconds
check for folder updates
EVENT: 0000000140059750 0000000000312040
when ready 11 000000000000002d 0000000000000000
EVENT: 0000000140050820 0000000000312040
new results
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
MSG: 00000000000508ac 0402 0000000000000000 0000000000000000
MSG: 00000000000c0894 000f 0000000000000000 0000000000000000
MSG: 00000000000c0894 0113 000000000000002d 0000000000000000
waited 670
monitor wakeup timer 1000
WAIT 1000, 22 waits
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
EVENT: 000000014004b010 00000000002f5130
_db_monitor_ntfs_update_event_proc 0
start _db_monitor_ntfs_update_thread_proc
create thread
update index O:
USN DELETE CLOSE x_1e6a2af2.jpg
USN_RECORD 190534864, FLAGS 00002020, PARENT FRN 000100000023c004, FRN 000100000023c026, r
eason CLOSE DELETE (80000200), filename x_1e6a2af2.jpg
USN DELETE CLOSE x_aa879aa5.jpg
USN_RECORD 190534952, FLAGS 00002020, PARENT FRN 00010000002432ca, FRN 00010000002432d2, r
eason CLOSE DELETE (80000200), filename x_aa879aa5.jpg
USN DELETE CLOSE x_9ca8eab7.jpg
USN_RECORD 190535040, FLAGS 00002020, PARENT FRN 0001000000267a8f, FRN 0001000000267aae, r
eason CLOSE DELETE (80000200), filename x_9ca8eab7.jpg
USN DELETE CLOSE x_6ced53c2.jpg
USN_RECORD 190535128, FLAGS 00002020, PARENT FRN 000100000023504e, FRN 000100000023508d, r
eason CLOSE DELETE (80000200), filename x_6ced53c2.jpg
USN DELETE CLOSE x_9ceccc1f.jpg
USN_RECORD 190535216, FLAGS 00002020, PARENT FRN 0001000000200633, FRN 00010000002006fe, r
eason CLOSE DELETE (80000200), filename x_9ceccc1f.jpg
USN DELETE CLOSE x_78b338a7.jpg
USN_RECORD 190535304, FLAGS 00002020, PARENT FRN 0001000000206647, FRN 000100000020665d, r
eason CLOSE DELETE (80000200), filename x_78b338a7.jpg
USN DELETE CLOSE x_cf4891e5.jpg
USN_RECORD 190535392, FLAGS 00002020, PARENT FRN 0001000000263720, FRN 000100000026378b, r
eason CLOSE DELETE (80000200), filename x_cf4891e5.jpg
USN DELETE CLOSE x_b7f932fd.jpg
USN_RECORD 190535480, FLAGS 00002020, PARENT FRN 0001000000240cd3, FRN 0001000000240cd8, r
eason CLOSE DELETE (80000200), filename x_b7f932fd.jpg
USN DELETE CLOSE x_760eac7a.jpg
USN_RECORD 190535568, FLAGS 00002020, PARENT FRN 0001000000269a39, FRN 0001000000269a50, r
eason CLOSE DELETE (80000200), filename x_760eac7a.jpg
USN DELETE CLOSE x_c27e0c06.jpg
USN_RECORD 190535656, FLAGS 00002020, PARENT FRN 00010000001e9064, FRN 00010000001e909e, r
eason CLOSE DELETE (80000200), filename x_c27e0c06.jpg
USN DELETE CLOSE x_dde4c8e5.jpg
USN_RECORD 190535744, FLAGS 00002020, PARENT FRN 0001000000267f1c, FRN 0001000000267f38, r
eason CLOSE DELETE (80000200), filename x_dde4c8e5.jpg
USN DELETE CLOSE x_ffbacbb8.jpg
USN_RECORD 190535832, FLAGS 00002020, PARENT FRN 00010000001eee9f, FRN 00010000001eeea7, r
eason CLOSE DELETE (80000200), filename x_ffbacbb8.jpg
USN DELETE CLOSE x_996d201d.jpg
USN_RECORD 190535920, FLAGS 00002020, PARENT FRN 000100000024b213, FRN 000100000024b21c, r
eason CLOSE DELETE (80000200), filename x_996d201d.jpg
USN DELETE CLOSE x_35f1ef74.jpg
USN_RECORD 190536008, FLAGS 00002020, PARENT FRN 00010000001d3cf7, FRN 00010000001d3d12, r
eason CLOSE DELETE (80000200), filename x_35f1ef74.jpg
USN DELETE CLOSE x_693d97a6.jpg
USN_RECORD 190536096, FLAGS 00002020, PARENT FRN 00010000001fed82, FRN 00010000001fed8c, r
eason CLOSE DELETE (80000200), filename x_693d97a6.jpg
USN DELETE CLOSE x_76a03573.jpg
USN_RECORD 190536184, FLAGS 00002020, PARENT FRN 00010000001f3432, FRN 00010000001f3445, r
eason CLOSE DELETE (80000200), filename x_76a03573.jpg
USN DELETE CLOSE x_ce32c341.jpg
USN_RECORD 190536272, FLAGS 00002020, PARENT FRN 0001000000273eb5, FRN 0001000000273ecb, r
eason CLOSE DELETE (80000200), filename x_ce32c341.jpg
USN DELETE CLOSE x_d18cb4b7.jpg
USN_RECORD 190536360, FLAGS 00002020, PARENT FRN 00010000002557ca, FRN 00010000002558fa, r
eason CLOSE DELETE (80000200), filename x_d18cb4b7.jpg
USN DELETE CLOSE x_26cad41e.jpg
USN_RECORD 190536448, FLAGS 00002020, PARENT FRN 00010000002453ad, FRN 00010000002453cd, r
eason CLOSE DELETE (80000200), filename x_26cad41e.jpg
USN DELETE CLOSE x_c3bae1c4.jpg
USN_RECORD 190536536, FLAGS 00002020, PARENT FRN 000100000023529b, FRN 00010000002352d0, r
eason CLOSE DELETE (80000200), filename x_c3bae1c4.jpg
updated O: in 0.175721 seconds
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
waited 188
EVENT: 0000000140047e20 00000000002f5130
monitor wakeup timer 812
WAIT 812, 22 waits
create thread
EVENT: 0000000140043150 00000000002f5130
_db_monitor_ntfs_process_usn_records_thread_proc
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
updated fd for 58280882_0 in 0.000067 seconds
EVENT: 0000000140050820 0000000000312040
EVENT: 00000001400147f0 00000000002f5130
updated fd for 63190167_0 in 0.000001 seconds
updated fd for 88893359_0 in 0.000001 seconds
updated fd for 53532899_0 in 0.000002 seconds
updated fd for 132218598_0 in 0.000003 seconds
updated fd for 133872933_0 in 0.000002 seconds
updated fd for 85813081_0 in 0.000002 seconds
updated fd for 62130982_0 in 0.000002 seconds
updated fd for 90514149_0 in 0.000001 seconds
updated fd for 115966820_0 in 0.000002 seconds
updated fd for 89234596_0 in 0.000002 seconds
updated fd for 119956927_0 in 0.000002 seconds
updated fd for 68372597_0 in 0.000002 seconds
updated fd for 101135294_0 in 0.000003 seconds
updated fd for 131774225_0 in 0.000003 seconds
updated fd for 122864572_0 in 0.000002 seconds
updated fd for 97367185_0 in 0.000002 seconds
updated fd for 75494324_0 in 0.000003 seconds
updated fd for 64605680_0 in 0.000001 seconds
updated fd for 53654225_0 in 0.000002 seconds
processed usn records in 0.094929 seconds
processed ntfs usn records in 0.097428 seconds
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
EVENT: 00000001400193a0 00000000002f5130
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000728 seconds
check for folder updates
EVENT: 0000000140059750 0000000000312040
EVENT: 0000000140050820 0000000000312040
new results
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
MSG: 00000000000508ac 0402 0000000000000000 0000000000000000
MSG: 00000000000c0894 000f 0000000000000000 0000000000000000
MSG: 00000000000c0894 0113 000000000000002d 0000000000000000
MSG: 00000000000c0894 0113 000000000000002d 0000000000000000
waited 826
monitor wakeup timer 1000
WAIT 1000, 22 waits
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
EVENT: 000000014004b010 00000000002f5130
_db_monitor_ntfs_update_event_proc 0
start _db_monitor_ntfs_update_thread_proc
create thread
update index O:
USN DELETE CLOSE x_d6763dd3.jpg
USN_RECORD 190536624, FLAGS 00002020, PARENT FRN 000100000021aacd, FRN 000100000021aae5, r
eason CLOSE DELETE (80000200), filename x_d6763dd3.jpg
USN DELETE CLOSE x_cd33b559.jpg
USN_RECORD 190536712, FLAGS 00002020, PARENT FRN 00010000002577bb, FRN 00010000002577ed, r
eason CLOSE DELETE (80000200), filename x_cd33b559.jpg
USN DELETE CLOSE x_186535a3.jpg
USN_RECORD 190536800, FLAGS 00002020, PARENT FRN 00010000001e4acb, FRN 00010000001e4add, r
eason CLOSE DELETE (80000200), filename x_186535a3.jpg
USN DELETE CLOSE x_81c9c112.jpg
USN_RECORD 190536888, FLAGS 00002020, PARENT FRN 00010000001d8f37, FRN 00010000001d8f6d, r
eason CLOSE DELETE (80000200), filename x_81c9c112.jpg
USN DELETE CLOSE x_6ff381d6.jpg
USN_RECORD 190536976, FLAGS 00002020, PARENT FRN 000100000020430b, FRN 0001000000204320, r
eason CLOSE DELETE (80000200), filename x_6ff381d6.jpg
USN DELETE CLOSE x_95aec83d.jpg
USN_RECORD 190537064, FLAGS 00002020, PARENT FRN 000100000020ba9d, FRN 000100000020bac6, r
eason CLOSE DELETE (80000200), filename x_95aec83d.jpg
USN DELETE CLOSE x_0cb0eac7.jpg
USN_RECORD 190537152, FLAGS 00002020, PARENT FRN 00010000002633f9, FRN 0001000000263414, r
eason CLOSE DELETE (80000200), filename x_0cb0eac7.jpg
USN DELETE CLOSE x_aeb7483c.jpg
USN_RECORD 190537240, FLAGS 00002020, PARENT FRN 0001000000253f8a, FRN 0001000000253fe2, r
eason CLOSE DELETE (80000200), filename x_aeb7483c.jpg
USN DELETE CLOSE x_bd8e0029.jpg
USN_RECORD 190537328, FLAGS 00002020, PARENT FRN 000100000026e18a, FRN 000100000026e194, r
eason CLOSE DELETE (80000200), filename x_bd8e0029.jpg
USN DELETE CLOSE x_3431934e.jpg
USN_RECORD 190537416, FLAGS 00002020, PARENT FRN 0001000000245acb, FRN 0001000000245ae7, r
eason CLOSE DELETE (80000200), filename x_3431934e.jpg
USN DELETE CLOSE x_e46db3ad.jpg
USN_RECORD 190537504, FLAGS 00002020, PARENT FRN 0001000000215e42, FRN 0001000000215e47, r
eason CLOSE DELETE (80000200), filename x_e46db3ad.jpg
USN DELETE CLOSE x_a09b3e58.jpg
USN_RECORD 190537592, FLAGS 00002020, PARENT FRN 000100000026bbaa, FRN 000100000026bc32, r
eason CLOSE DELETE (80000200), filename x_a09b3e58.jpg
updated O: in 0.036083 seconds
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
EVENT: 0000000140047e20 00000000002f5130
create thread
EVENT: 0000000140043150 00000000002f5130
waited 47
_db_monitor_ntfs_process_usn_records_thread_proc
monitor wakeup timer 781
WAIT 781, 22 waits
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
updated fd for 139190967_0 in 0.000065 seconds
EVENT: 0000000140050820 0000000000312040
EVENT: 00000001400147f0 00000000002f5130
updated fd for 76790770_0 in 0.000002 seconds
updated fd for 112485833_0 in 0.000002 seconds
updated fd for 104132288_0 in 0.000002 seconds
updated fd for 133352727_0 in 0.000001 seconds
updated fd for 135325750_0 in 0.000001 seconds
updated fd for 85680448_0 in 0.000002 seconds
MSG: 00000000000c0894 0113 000000000000002d 0000000000000000
updated fd for 74399163_0 in 0.000002 seconds
updated fd for 94621724_0 in 0.000001 seconds
updated fd for 64744215_0 in 0.000002 seconds
updated fd for 137880499_0 in 0.000003 seconds
updated fd for 92417479_0 in 0.000001 seconds
processed usn records in 0.057781 seconds
processed ntfs usn records in 0.236471 seconds
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
EVENT: 00000001400193a0 00000000002f5130
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000696 seconds
check for folder updates
EVENT: 0000000140059750 0000000000312040
when ready 11 000000000000002d 0000000000000000
EVENT: 0000000140050820 0000000000312040
new results
MSG: 00000000000608b2 1401 0000000000000000 0000000000000000
MSG: 00000000000508ac 0402 0000000000000000 0000000000000000
MSG: 00000000000c0894 000f 0000000000000000 0000000000000000
Top
void
Developer
Posts: 16680
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything stuck when I try to enter the regex and other problem

Post by void »

Thanks for the debug info.

From my tests:
Everything took 24 minutes to index 100,700,000 files.
Using 6.0 GB Ram.

This will vary greatly between different computers.

The main limitation was hard drive IO, Everything would cap at ~100MB/second reading the MFT (96GB).
There was little CPU during this time.
This indexing part took 20 minutes (over two drives: 15 mins + 5mins).

The initial name sort uses 100% CPU and took 4 minutes.

I'll look into improving the indexing performance where I can in a future release, reading multiple volumes at the same time would be a good start.
Updating database ...
Updates tens of millions of files.
Please disable monitoring on NTFS volumes:
  • In Everything, from the Tools menu, click Options.
  • Click the NTFS tab.
  • For each NTFS volume:
    • Uncheck Monitor changes.
  • Click OK.
Top
Debugger
Posts: 630
Joined: Thu Jan 26, 2017 11:56 am

Re: Everything stuck when I try to enter the regex and other problem

Post by Debugger »

Please disable monitoring on NTFS volumes:
In Everything, from the Tools menu, click Options.
Click the NTFS tab.
For each NTFS volume:
Uncheck Monitor changes.
Click OK.
Now it is showing instantly :D


The main limitation was hard drive IO, Everything would cap at ~100MB/second reading the MFT (96GB).
There was little CPU during this time.
This indexing part took 20 minutes (over two drives: 15 mins + 5mins).
another tool
Reading
Average SSD 700 MB/s (1 threads)
Average 450MB/s HDD (4 threads)
Less than 35 seconds (idle computer) 10,1 mln HDD WD RED
350 second = 5.83 minutes 100 mln files
1-3 second = 1 mln files


Changing all option caused hang GUI.
i have to kill the process.

Image
Top
Post Reply

Return to “Bug report”