Out of memory error

General discussion related to "Everything".
Post Reply
Tom.Zhang
Posts: 34
Joined: Wed Jun 03, 2015 8:51 am

Out of memory error

Post by Tom.Zhang »

I have a server with more than 100 million files (most of text), when re-create index db, it failed at create multi threads with an err "out of memory".
The server has 48 logical processors and the ini configuration:max_threads is 48, the memory of the server is 128G, normally 20G was occupied if everything is not startup.
I tried to change the max_threads to 35 incidentally, eveything can startup without error, but when more and more files in, when re-create index db, the "out of memory" error poped up again, now i decreased the max_threads to 20, it is ok.
should i provide the trace or is it a known issue with huge file quanties?
btw, is there a limitation if taking no account of hardware?

Thanks!
Tom.Zhang
Posts: 34
Joined: Wed Jun 03, 2015 8:51 am

Re: Out of memory error

Post by Tom.Zhang »

here is the trace:

Everything
Version 1.4.0.713b (x64)
Windows NT 6.2
Processors 48
IsAdmin 1
AppData 0
Service 0
WM_ACTIVATE 0000000000000000 0000000000000000, lastfocus 0000000000360022, curre
nt focus 0000000000360022
found extended MFT file record 00000000009afe60 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 104325780620
extended MFT sequence_number 136
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 00000000009afe61 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 114673500764
extended MFT sequence_number 136
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 00000000009afe62 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 129506710388
extended MFT sequence_number 136
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 424
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 00000000009afe63 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 125780509442
extended MFT sequence_number 136
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 00000000009afe64 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 129420854211
extended MFT sequence_number 136
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 440
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
data run array count 0
left over count 48
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 129420854224
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 64
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 30458677768
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 46530732015
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 64760892464
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 113314506120
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 920
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 00000080
MFT record_length 856
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
MFT allocated_length 0
MFT file_size 0
MFT highest_vcn 11370455
MFT lowest_vcn 5634160
MFT mapping_pairs_offset 64
MFT compression_unit_size 0
MFT total_allocated 3426996277127678787
MFT valid_data_length 0
remaining MFT Entries 31527232
data run offset 64
-----------
TypeCode ffffffff
data run array count 1
found data run with vcn 5634160
ignore internal extended fragmented file record 0009000000000009
400 Bad Request
data run array count 0
left over count 32
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 83485658911
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 93925224710
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 104325780620
MFT sequence_number 136
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 114673500764
MFT sequence_number 136
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 129506710388
MFT sequence_number 136
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 424
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 00000080
MFT record_length 360
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
MFT allocated_length 0
MFT file_size 0
MFT highest_vcn 13515967
MFT lowest_vcn 11370456
MFT mapping_pairs_offset 64
MFT compression_unit_size 0
MFT total_allocated 706398850348752195
MFT valid_data_length 0
remaining MFT Entries 8582048
data run offset 64
-----------
TypeCode ffffffff
data run array count 1
found data run with vcn 11370456
data run array count 0
left over count 32
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 125780509442
MFT sequence_number 136
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 129420854211
MFT sequence_number 136
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 440
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 376
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
processed 54063872 / 54063872 file records
base_fragmented_record_count 310
138.944307 seconds
convert parent frn to parent pointers: 0.000803 seconds
Indexing \\?\Volume{f01aa68d-53d2-48e6-a894-71ce79600246}, E:,
open volume \\?\Volume{f01aa68d-53d2-48e6-a894-71ce79600246}
opened 612 0.000732
sector size 512
mft_lcn 786432
serial_number 5334182131424972821
bytes_per_cluster 4096
bytes_per_file_record 1024
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 131439652609
MFT sequence_number 1
MFT name_count 1
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 936
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 8
TypeCode 00000010
MFT record_length 96
MFT flags 0
MFT name_length 0
MFT name_offset 24
MFT form flags 0
MFT attribute_id 0
-----------
TypeCode 00000020
MFT record_length 600
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 0
MFT attribute_id 7
-----------
TypeCode 00000030
MFT record_length 104
MFT flags 0
MFT name_length 0
MFT name_offset 24
MFT form flags 0
MFT attribute_id 3
-----------
TypeCode 00000080
MFT record_length 72
MFT flags 0
MFT name_length 0
MFT name_offset 64
MFT form flags 1
MFT attribute_id 6
MFT allocated_length 69595824128
MFT file_size 69595824128
MFT highest_vcn 3
MFT lowest_vcn 0
MFT mapping_pairs_offset 64
MFT compression_unit_size 0
MFT total_allocated 18446462650272449585
MFT valid_data_length 69595824128
remaining MFT Entries 67964672
data run offset 64
-----------
TypeCode ffffffff
data run array count 1
found data run with vcn 0
data run array count 0
left over count 16
found extended MFT file record 000000000000000f base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 41171335968
extended MFT sequence_number 15
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 920
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 41171335968
MFT sequence_number 15
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 920
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 00000080
MFT record_length 856
MFT flags 0
MFT name_length 0
MFT name_offset 64
MFT form flags 1
MFT attribute_id 0
MFT allocated_length 14266925056
MFT file_size 14266662912
MFT highest_vcn 5787858
MFT lowest_vcn 4
MFT mapping_pairs_offset 64
MFT compression_unit_size 0
MFT total_allocated 3678315012847975475
MFT valid_data_length 14266662912
remaining MFT Entries 67964656
data run offset 64
-----------
TypeCode ffffffff
data run array count 1
found data run with vcn 4
found extended MFT file record 0000000000000010 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 131436521100
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000000000011 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 21594293797
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000000000012 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 32081162485
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000000000013 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 42604213812
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000000000014 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 82208908499
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 920
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000000000015 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 53035336641
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000000000016 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 63371154208
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
ignore name attr for internal ntfs folder 000000000000000b
ignore name attr for internal ntfs folder 000000000000000b
ignore name attr for internal ntfs folder 000000000000000b
ignore name attr for internal ntfs folder 000000000000000b
ignore name attr for internal ntfs folder 000000000000000b
found extended MFT file record 0000000000e74ae5 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 131440083063
extended MFT sequence_number 4
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 880
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
data run array count 0
left over count 60
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 131436521100
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 64
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 21594293797
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 32081162485
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 42604213812
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 82208908499
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 920
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 00000080
MFT record_length 856
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
MFT allocated_length 0
MFT file_size 0
MFT highest_vcn 11523820
MFT lowest_vcn 5787859
MFT mapping_pairs_offset 64
MFT compression_unit_size 0
MFT total_allocated 1169957260471308867
MFT valid_data_length 0
remaining MFT Entries 44813236
data run offset 64
-----------
TypeCode ffffffff
data run array count 1
found data run with vcn 5787859
found extended MFT file record 0000000001c60001 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 73961452740
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000001c60002 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 84159192055
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
data run array count 0
left over count 40
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 53035336641
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 63371154208
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 131440083063
MFT sequence_number 4
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 880
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 00000080
MFT record_length 816
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
MFT allocated_length 0
MFT file_size 0
MFT highest_vcn 16991295
MFT lowest_vcn 11523821
MFT mapping_pairs_offset 64
MFT compression_unit_size 0
MFT total_allocated 1897679751553225283
MFT valid_data_length 0
remaining MFT Entries 21869388
data run offset 64
-----------
TypeCode ffffffff
data run array count 1
found data run with vcn 11523821
found extended MFT file record 0000000002c15b01 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 95097511579
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000002c15b02 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 105282028836
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000002c15b03 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 115483875639
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 1016
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
found extended MFT file record 0000000002c15b04 base 0001000000000000
extended MFT type FILE
extended MFT USA Offset 48
extended MFT USA Count 3
extended MFT lsn 131436521086
extended MFT sequence_number 1
extended MFT name_count 0
extended MFT attribute_offset 56
extended MFT flags 1
extended MFT bytes_in_use 504
extended MFT bytes_allocated 1024
extended MFT base_frn 0
extended MFT next_attribute_number 1
GET /
CreateFileW(): GetLastError(): 3: Failed to open file C:\Program Files\Everythin
g\HTTP Server\
send path
200 OK
WM_ACTIVATE 0000000000000001 0000000000000000, lastfocus 0000000000360022, curre
nt focus 0000000000000000
WM_ACTIVATE 0000000000000000 0000000000000000, lastfocus 0000000000360022, curre
nt focus 0000000000360022
more data than file record run 64 > 12
more data than file record run 64 > 0
more data than file record run 64 > 0
more data than file record run 64 > 0
more data than file record run 64 > 0
more data than file record run 64 > 0
more data than file record run 64 > 0
more data than file record run 64 > 0
data run array count 0
left over count 12
more data than file record run 12 > 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 73961452740
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 84159192055
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 95097511579
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 105282028836
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 115483875639
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 1016
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 952
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
process extended MFT file record
MFT type FILE
MFT USA Offset 48
MFT USA Count 3
MFT lsn 131436521086
MFT sequence_number 1
MFT name_count 0
MFT attribute_offset 56
MFT flags 1
MFT bytes_in_use 504
MFT bytes_allocated 1024
MFT base_frn 0
MFT next_attribute_number 1
TypeCode 000000b0
MFT record_length 440
MFT flags 0
MFT name_length 0
MFT name_offset 0
MFT form flags 1
MFT attribute_id 0
-----------
TypeCode ffffffff
data run array count 0
left over count 0
processed 67964672 / 67964672 file records
base_fragmented_record_count 337
147.997062 seconds
convert parent frn to parent pointers: 0.000904 seconds
removed 19 orphaned files in 2.659994 seconds
removed 6 orphaned folders in 0.001327 seconds
folder name os_qsort: 0.119440 seconds
multithreaded sort: items 100836154, ideal threads 1539, actual threads 24
new thread (1)
new thread (2)
new thread (3)
new thread (4)
new thread (5)
new thread (6)
new thread (7)
new thread (8)
new thread (9)
new thread (10)
new thread (11)
new thread (12)
new thread (13)
new thread (14)
new thread (15)
new thread (16)
new thread (17)
new thread (18)
new thread (19)
new thread (20)
new thread (21)
new thread (22)
new thread (23)
.\src\mem.c(566): mem_alloc(): Fatal error: out of memory ffffffffacab8bc8
new thread (24)
Tom.Zhang
Posts: 34
Joined: Wed Jun 03, 2015 8:51 am

Re: Out of memory error

Post by Tom.Zhang »

Thanks!

It works now with max_threads=0.
Tom.Zhang
Posts: 34
Joined: Wed Jun 03, 2015 8:51 am

Re: Out of memory error

Post by Tom.Zhang »

If i add one filter : *$Recycle.bin as talked in below url, this out of memory error will occur again:

http://www.voidtools.com/forum/viewtopi ... cle#p13460
Tom.Zhang
Posts: 34
Joined: Wed Jun 03, 2015 8:51 am

Re: Out of memory error

Post by Tom.Zhang »

tried 5 times, 3 OK but the last 2 times failed with the same error.
Post Reply