Find dups in one folder against the rest of the PC

[JTCGiants56]

Hello, If I run

Code: Select all

sizedupe: W:

for example, it will show all the files in W: that are dupes with anything on the PC, but it won't show the other matching dupe of this duplicate if it's not on W:. Is there to way to compare duplicates of one folder, against the rest of the PC and have both dupe couples show in the results? Thank you

[NotNull]

Unfortunately, that's not possible with Everything, but ...

... take a look at this thread.

[JTCGiants56]

Ok thanks

[void]

I'm thinking of ways to do this, would something like sizedupewithpath:<path> be useful? eg:
sizedupewithpath:w:

This would list size duplicates where at least one of the duplicates has w: in the path.

[JTCGiants56]

I'm thinking of ways to do this, would something like sizedupewithpath:<path> be useful? eg:
sizedupewithpath:w:

This would list size duplicates where at least one of the duplicates has w: in the path.

Yes, that would be perfect. Is this a new feature you would implement or a current one? I'm currently getting no results. Thanks!

[void]

I need to add it, I've got it on my TODO list.

[JTCGiants56]

I need to add it, I've got it on my TODO list.

Sounds good.

[therube]

Is "withpath:<path>" actually rather easy to do?

If not then why not just have the ability to have sizedupe work against currently enabled filters, search?
IOW, just like in the OP: sizedupe: w:.

Or,

sizedupe: ext:jpg w:
sizedupe: ext:jpg w: "jethro tull"

Now all of that works already, except that currently sizedupe: is global in scope.

Maybe something like sizedupefilter: where it would first do sizedupe: then iterate through the list of filtered files, displaying only those files meeting the current filters, search settings.

(IOW, just automating the export to .efu, then opening of same.)

[void]

Is "withpath:<path>" actually rather easy to do?

I thought about this too, it's possible.
Since only one duplicate function can be used effectively, this additional function could limit where the duplicates are searched for any existing dupe function.
In code, sizedupe: and sizedupe: withpath:<path> would be two completely different code paths for finding duplicates and I would like to reflect that in the search function name.

If not then why not just have the ability to have sizedupe work against currently enabled filters, search?
IOW, just like in the OP: sizedupe: w:.

OP wants to find and list duplicates everywhere, where only one of the duplicate needs to be in w:

sizedupe: w:
would list results only on the w: drive. Unfortunately, hiding size duplicates on other drives.
whereas:
sizedupewithpath:w:
would list all size duplicates where one of the duplicates is on the w: drive.

OP could search for sizedupe: and sort by path, and just go through all the w: results. Unfortunately, results would not be sorted by size.
Using sizedupe: works best when sorting by size.

Since the search
sizedupe: w:
is not too helpful, perhaps Everything could apply this withpath: option automatically.

Maybe something like sizedupefilter: where it would first do sizedupe: then iterate through the list of filtered files, displaying only those files meeting the current filters, search settings.

This would be pretty much how Everything works now.
To do the opposite would be useful, apply a filter and then search for sizedupe: on those results.
This is also on my TODO list, and will be some sort of view option. eg: View -> Show only duplicate names/size and View -> Show only unique names/size

[JTCGiants56]

Hello @void. I wanted to inquire if any of the above mentioned dupe functionality has been implemented yet (even if just in the nightlies). Thanks.

[zeus04]

Hello @void. I wanted to inquire if any of the above mentioned dupe functionality has been implemented yet (even if just in the nightlies). Thanks.

Are there nightly builds available anywhere?(!)

[void]

I've added an optional Size Duplicated column for the next major version of Everything.

When sorting by this column, duplicated sizes are listed first (largest to smallest).
You'll be able to search for anything and sort instantly with this column to find name/size duplicates for the current results.

I don't have release for testing yet, sorry.
There's still a bit more to do before an alpha release.

Current Everything 1.4. nightlies can be found here (mostly bug fixes at this stage):
https://www.voidtools.com/forum/viewtopic.php?t=5718

[jimspoon]

I don't see sizedupewithpath: in the already implemented list or the TODO list, is it still on the way, or something like it? It seems like it would be very useful.

[void]

Please try the Everything 1.5 alpha.

Search for:
w:

Right click the Size column and click Find Size Duplicates....



Finding duplicates

[jimspoon]

Please try the Everything 1.5 alpha.

Search for:
w:

Right click the Size column and click Find Size Duplicates....



Finding duplicates

Thank you, I experimented with that. Find Size Duplicates doesn't seem to find size duplicates of files that don't meet the other search criteria (e.g. "w:") - is there a way to find the duplicated w: files, together with their size duplicates on other drives, and no other files?

[void]

Please try the following:

• Leave the search blank.
• Right click the Size column header and click Find Size Duplicates.
• From the Edit menu, click Select All.
• Press Ctrl + Shift + C to copy all selected filenames to the clipboard.
• Type in the following search:
  filelist1:
• Hold down Ctrl and left click the filelist1: text in the search box.
• Press Ctrl + V to paste the duplicated filenames.
• Click OK.
• Change the search to:
  filelist1: w:

-or-

• Right click the Size column header and click Find Size Duplicates.
• Sort by Path to list all your w: results together.

[jimspoon]

I'd like to be able to see a list of duplicate files, limited to the files in a particular path (e.g. onedrive\downloads) together with their duplicates, whereever the duplicates are located. Sorted by file size so that the files and their duplicates will appear next to each other. I've tried the methods you've suggested above, but they don't accomplish this. Void, it sounds like the sizedupewithpath: modifier that you suggested in your 4/7/2019 post in this thread would do the trick. I hope this will be on your todo list!

[raccoon]

Why don't find your dupes, then sort all files by Path so you can multi-select all the files from the bad path, then sort by Size so you can see them side-by-side again with their duplicates from the other location.

[jimspoon]

Why don't find your dupes, then sort all files by Path so you can multi-select all the files from the bad path, then sort by Size so you can see them side-by-side again with their duplicates from the other location.

My problem is that I have so many files indexed that my total number of duplicates is very large. So browsing through my long list of duplicate files sorted by file size would be very inefficient. It would help if I could jump through the sorted results list with an F3 search for a string in the path, and then just keep repeating that search. I think I'll suggest that.

[meteorquake]

In my experience finding duplicate files in general is at times a non-trivial task and when in bulk best done with a program specialised for it that will do content checks. A content check gives extra assurance as no one likes to delete files blindly and covers for situations where one of the files has been corrupted, since the content won't match even if the file information does.
Checking the results/actions manually of a simple situation isn't so bad.
Commonly size-modified (using the underlying filesystem values) is an easy one to start with unless files are on or have travelled across file systems such as a memory stick or zip in which case a TS leeway has to be given.
Issues arise with packages that preset the modified date on their installation files and happen to have the same size as then fundamentally different files will match but they're not going to be files you've made yourself if you're doing a targetted match.
Matching files where one has been modified is a bit more complex but if you know in advance this is going to get needed you can make the original copies preserving the creation TS and they can be matched on creation TS rather than modified TS. If creation TS isn't usable many of them can be provisionally matched on having the same name or name part (for example my photos get named to TS but some get titles added).
Which leads to a scoring system according to whether size-modified or name match (or creation TS if that's used for tracking), or actually a matching strategy sequence where you have a list of strategies that are tried in turn and as items are found they are removed from the candidate pile to search in.
All matched ones ideally should be content-checked but if they're on different devices mutually offline to each other (such as two removable drives, or a computer in a different place) after compiling the candidates MD5 can be compiled by making the devices online.
Additional problems arise because you can have a file in two places represented different things. For example if I have a photo that has two different plants in, I will have the photo in two different folders representing the different plants. Although digitally the same photo, it's actually not, as one is an example of one plant, and the other an example of another. In a building project for example this can happen if a photo is taken of a building area, and it can be put in several places, one representing the project, another a particular material used, and although digitally the same semantically they are different and you don't want them cleaned up but kept as several.
You then can have different strategies regarding what actions to take because actually deletion isn't the only strategy - you may want to match them (eg size-modified) and make the names the same, create a list as the action, and so on.
Not that Everything will want to do all this, but it's more a brief outline of the problem as I've encountered it and Everything could take a small subset of it.
d

[void]

Please try the following:

• In Everything 1.5, type in the following search:
  file: size:>1mb
  where 1mb is the smallest size of interest.
• Right click the Size column header and click Find Size Duplicates.
• Click the Path column header to sort by path.
• Select only files in your desired path (eg: W:)
  ---There will be a lot of files so this will take a little bit to find the first and last file on W:
• From the File menu, click Export....
• Change Save as type: to CSV Comma Separated Values (*.csv)
• Check Export selection only.
• Choose a filename and click Save.
• Open the CSV file in Excel.
• Delete ALL columns except the Size column.
• Delete the Header row.
  ---you should now be left with a single column containing all the file sizes on W: where there is a duplicated file any where in the index.
• Create a new column before the size column.
• Set all the values in the new column to:
  size:
  ---You should now have two columns, for example:
  
• In Excel, From the File menu, click Save.
• Save as CSV (Comma delimited) (*.csv)
• Choose a new filename and click Save.
• Open this new CSV file in Notepad.
• In Notepad, from the Edit menu, click Replace.
• Change Find what to: ,
• Change Replace with to:
  (leave empty)
• Click Replace All
  The text should now look like:

  Code: Select all

  size:30786
  size:62488
  size:62346
  size:43441
  size:63073
  size:87256
  size:66946
  size:91788
  size:29358
  size:22884
  size:12911
  size:86030
  size:32764
  size:33249
  size:86573
  size:74245
  size:4466
  size:94101
  size:34861
  size:4486
  size:21028
  size:76660
  size:68173
  size:30134
  size:55362
  size:7101
  size:89454
  size:59486
  size:47337
  size:22822
  size:75019
  size:34046
  

• Select all the text (Ctrl + A)
• Copy the Selected text (Ctrl + C)
• Paste the text into the Everything search box (Ctrl + V)
  ---Your search box should be set to a really long list of size searches, for example:

  Code: Select all

  <size:30786>|<size:62488>|<size:62346>|<size:43441>|<size:63073>|<size:87256>|<size:66946>|<size:91788>|<size:29358>|<size:22884>|<size:12911>|<size:86030>|<size:32764>|<size:33249>|<size:86573>|<size:74245>|<size:4466>|<size:94101>|<size:34861>|<size:4486>|<size:21028>|<size:76660>|<size:68173>|<size:30134>|<size:55362>|<size:7101>|<size:89454>|<size:59486>|<size:47337>|<size:22822>|<size:75019>|<size:34046>

  ---The search box may appear empty if there are thousands of files. -The search will still function correctly.

I will look into ways to make this easier.

[jimspoon]

Thank you David that is a great solution, and I really appreciate you taking the time to outline those steps. It's great that we can paste many lines containing search terms and Everything will group each line and construct an OR search of those groups. I can imagine many possible uses for this technique, not just the use I was inquiring about.

[jimspoon]

Thank you Meteorquake, you have outlined important considerations when one is weeding out duplicate files. You are right that a content comparison is the safest route and dedicated duplicate search tools are often the best. The advantage of Everything, of course, is its blazing speed. The dedicated tools can take a very long time to recurse through all the directories that need to be searched. (Wouldn't programs that do such global recursions benefit by integrating Everything for this purpose?)

Often I will have a catch-all directory of files and I wonder, have I already copied these files elsewhere, perhaps with new, more descriptive names? And so I want to find such files in my catch-all directory and perhaps delete them, if I don't need to "refile" them again in another location. In this case, I'm not looking to find all duplicate files wherever they may be, I'm really just wanting to prune my "catch-all" folders which are temporary holding spaces for incoming or working files.

Speaking of dedicated tools, it seems that most of them do not have the capability I have been inquiring about, i.e. the ability to limit the duplicate search to compare the files in one directory/subtree to files in locations *elsewhere* on one's storage pool. They will allow you to specify locations to be searched, but then they will compare each file in those locations to every other file in those same locations. The results list ends up being much bigger than what you were looking for, and then you have to browse through the list to find the duplicates that were in the directory/subtree you were looking to prune.

Other duplicate searchers may have the same ability but so far the only one I have found is CloneSpy. In CloneSpy you can specify two different pools of directories to be searched and limit CloneSpy comparing the files in one pool to the files in the other pool. The Help file for the Search mode explains:
"Compare Pool 1 to Pool2: CloneSpy will compare the files that belong to a drive or folder in Pool 1 to the files that belong to a drive or folder in Pool 2. The files in Pool 1 will not be checked against each other, just as the files in Pool 2 will not be checked against each other. This option is handy if you have already checked your system for duplicates, but subsequently add a folder of new files. You can insert the new folder in Pool 1, and all the other folders you want to check in Pool 2."

This is a good solution but then again the speed cannot compare to Everything.

[raccoon]

DupeGuru has you select paths to search at start. You can flag each path as either Normal (search within and without; as you described), or Reference (don't bother finding dupes within self, files within Reference paths are protected from deletion), or Exclude (don't scan the contents of this path).

This program is fine as long as you don't search more than 10's of thousands of files. It uses poorly written recursion and makes no attempt at caching file hashes for refining searches. It doesn't have a refinement to search_for_outside_dupes_only so it may not suit your needs.

I haven't tried other software lately though and there are a lot of options people have mentioned on this forum.

[jimspoon]

I will look into ways to make this easier.

Perhaps this could be done using the existing "Search for Size" option which appears when we right-click the Size column header. Selecting this option could add an OR search of the selected items' values in the Size column.

[void]

Currently, you can select a bunch of files, right click the selection while the cursor is in the size column and click Copy Size to Clipboard.

This will copy the size of each selected file on a new line to the clipboard.

Then it is just a matter of prefixing each line with size:


Maybe this could be implemented similarly to file list slots.
For example:
Copy the filenames of interest to the clipboard with Ctrl + Shift + C
Type in the following search:
sizefilelist1:
Ctrl + click the sizefilelist1: text.
Paste your filenames and click OK.
This would search for files matching a size of any of the files in the file list slot 1.

[jimspoon]

That would be very useful!

[therube]

Both AllDup & Duplicate Cleaner are full featured programs.

Both allow you to do things like:
compare files from all source folders
compare only files within the same source folder
compare only files between different source folders
compare only files within the same source and sub folders

Both deal with directory trees (a limitation - compared to Everything).
Most all duplicate finders deal with directory trees (a limitation).
AllDup is free. Duplicate Cleaner is pay (but older version had both free, more limited, & pay versions).

Neither are as fast as Everything.

Always good, IMO, to intermix different tools.
So Everything, & a duplicate file finder, & a file manager (often with duplicate finding abilities & directory comparison abilities itself), & a hasher... & use the sets of tools that are most appropriate based on what you are looking for & where the particular files may be found; i.e., haphazardly everywhere, or in specific directories or trees.

Depending on what your looking for, like if dealing with video, where it helps to visually see things, mpv.net is rather excellent at dealing with huge file lists. And Everything is great at finding huge file lists. So you can find files with Everything, & drag them all into mpv.net - sorted in whatever order you want (based on the sort in Everything), & very quickly run through (play) huge sets of files (visually) looking for dup'd or related entities.


Doing such things, you'll end up with a healthier, brighter, cleaner tomorrow. Oops. Earth Day is over, isn't it .

[void]

Everything 1.5.0.1315a adds sizefilelist0: - sizefilelist9:

Hold down CTRL and click the sizefilelist0: - sizefilelist9: text in the search box to add or remove files from the file list.

Example Usage:

• Select the desired files.
• Copy the filenames to the clipboard. (Ctrl + Shift + C in Everything)
• Set the search to:
  sizefilelist1:
• Ctrl+left-click the sizefilelist1: text in the search box and paste the filenames.
• Click OK.
  ---The results will now contain files with the same size from the original selection---

To hide the original filenames, search for:
sizefilelist1: !filelist1:

sizefilelistx: will also work with folder sizes.

[jimspoon]

Thanks! I tried out a sizefilelist1: search and it works perfectly.

[therube]

Care to run this by me...

- Select files in a specific location
One location? Multiple locations? One file? Multiple files?

- Copy the filenames to the clipboard
OK. Clipboard shows the file names.

- Set the search to: sizefilelist1:
Fine. Box opens.

- Ctrl+left-click the sizefilelist1: text in the search box and paste the filenames.
Fine. Name(s) are posted into the box.

- Click OK.
---The results will now contain files with the same size from the original selection
And with that... what am I supposed to see?


OK, that's weird (in more then one way).
I selected (a) zero-byte file, & this time, I did get results (of zero-byte files).
AND (in more then one way), I had 1 file display (a .ms file, as it was) <> 0-bytes.

And then I went back & no longer saw it listed?
(And then, I crashed, heh.)
.

Everything1315.7z

(166.17 KiB) Downloaded 888 times

.

I'm thinking if you paste a name (only), rather then path+name (you crash).
(Nope. Got to be more to it then just that.)
.

NoScript 1315 crashing using sizefilelist function.png (20.72 KiB) Viewed 25371 times

.
.
My file list - created via Salamander, Make File List: $(Drive)$(Path)$(FileName)$(CRLF)
(Thought I'd try that rather then using Everything itself.)

Code: Select all

C:\LIB\Nirsoft\windeflogview_10 (nirsoft).zip
C:\LIB\Nirsoft\winprefetchview_137-x64 (nirsoft).zip
C:\LIB\Nirsoft\winprefetchview_137 (nirsoft).zip
C:\LIB\Nirsoft\hashmyfiles_242-x64 (nirsoft).zip
C:\LIB\Nirsoft\hashmyfiles_242 (nirsoft).zip
C:\LIB\Nirsoft\usbdrivelog_102 (nirsoft, Win10+).zip
C:\LIB\Nirsoft\networkopenedfiles_145-x64 (nirsoft).zip
C:\LIB\Nirsoft\networkopenedfiles_145 (nirsoft).zip
C:\LIB\Nirsoft\pinginfoview_220 (nirsoft).zip
C:\LIB\Nirsoft\propertysystemview_118-x64 (nirsoft).zip
C:\LIB\Nirsoft\propertysystemview_118 (nirsoft).zip
C:\LIB\Nirsoft\csvfileview_254-x64 (nirsoft).zip
C:\LIB\Nirsoft\csvfileview_254 (nirsoft).zip
C:\LIB\Nirsoft\wifihistoryview_161 (nirsoft).zip
C:\LIB\Nirsoft\managewirelessnetworks_101 (nirsoft).zip
C:\LIB\Nirsoft\wifiinfoview_271 (nirsoft W7+).zip
C:\LIB\Nirsoft\mzcacheview_205 (nirsoft, mozilla cache view).zip
C:\LIB\Nirsoft\advancedrun_140 (nirsoft, for 32-bit processes).zip
C:\LIB\Nirsoft\advancedrun_140-x64 (nirsoft, x64 for 64-bit processes).zip
C:\LIB\Nirsoft\dnsdataview_161 (nirsoft).zip
C:\LIB\Nirsoft\winlogonview_141 (nirsoft).zip
C:\LIB\Nirsoft\turnedontimesview_146 (nirsoft).zip
C:\LIB\Nirsoft\fileactivitywatch_165 (nirsoft).zip
C:\LIB\Nirsoft\fileactivitywatch_165-x64 (nirsoft).zip
C:\LIB\Nirsoft\handlecountersview_115 (nirsoft).zip
C:\LIB\Nirsoft\handlecountersview_115-x64 (nirsoft).zip
C:\LIB\Nirsoft\processtcpsummary_115-x64 (nirsoft).zip
C:\LIB\Nirsoft\processtcpsummary_115 (nirsoft).zip
C:\LIB\Nirsoft\dnsquerysniffer_185 (nirsoft).zip
C:\LIB\Nirsoft\dnsquerysniffer_185-x64 (nirsoft).zip
C:\LIB\Nirsoft\whoistd_245 (nirsoft).zip
C:\LIB\Nirsoft\livetcpudpwatch_140 (nirsoft).zip
C:\LIB\Nirsoft\livetcpudpwatch_140-x64 (nirsoft).zip
C:\LIB\Nirsoft\networktrafficview_241-x64 (nirsoft).zip
C:\LIB\Nirsoft\networktrafficview_241 (nirsoft).zip
C:\LIB\Nirsoft\produkey_197 (nirsoft).zip
C:\LIB\Nirsoft\produkey_197-x64 (nirsoft).zip
C:\LIB\Nirsoft\mailpv_192 (nirsoft).zip
C:\LIB\Nirsoft\devmanview_175-x64 (nirsoft).zip
C:\LIB\Nirsoft\devmanview_175 (nirsoft).zip
C:\LIB\Nirsoft\usbdeview_302-x64 (nirsoft).zip
C:\LIB\Nirsoft\usbdeview_302 (nirsoft).zip
C:\LIB\Nirsoft\videocacheview_307-x64 (nirsoft).zip
C:\LIB\Nirsoft\videocacheview_307 (nirsoft).zip
C:\LIB\Nirsoft\fulleventlogview_162-x64 (nirsoft, Win7+).zip
C:\LIB\Nirsoft\fulleventlogview_162 (nirsoft, Win7+).zip
C:\LIB\Nirsoft\uninstallview_142-x64 (nirsoft).zip
C:\LIB\Nirsoft\uninstallview_142 (nirsoft).zip
C:\LIB\Nirsoft\registrychangesview_128-x64 (nirsoft).zip
C:\LIB\Nirsoft\registrychangesview_128 (nirsoft).zip
C:\LIB\Nirsoft\taskschedulerview_168-x64 (nirsoft, win7+).zip
C:\LIB\Nirsoft\taskschedulerview_168 (nirsoft, win7+).zip
C:\LIB\Nirsoft\fileaccesserrorview_126-x64 (nirsoft).zip
C:\LIB\Nirsoft\fileaccesserrorview_126 (nirsoft).zip
C:\LIB\Nirsoft\soundvolumeview_223 (nirsoft).zip
C:\LIB\Nirsoft\soundvolumeview_223-x64 (nirsoft).zip
C:\LIB\Nirsoft\mobilefilesearch_138 (nirsoft).zip
C:\LIB\Nirsoft\mobilefilesearch_138-x64 (nirsoft).zip
C:\LIB\Nirsoft\imagecacheviewer_125 (nirsoft).zip
C:\LIB\Nirsoft\webbrowserbookmarksview_10 (nirsoft).zip
C:\LIB\Nirsoft\searchmyfiles_311 (nirsoft).zip
C:\LIB\Nirsoft\searchmyfiles_311-x64 (nirsoft).zip
C:\LIB\Nirsoft\webbrowserpassview_211 (nirsoft, wbpv28821@).zip
C:\LIB\Nirsoft\netpass_155-x64 (nirsoft).zip
C:\LIB\Nirsoft\netpass_155 (nirsoft).zip
C:\LIB\Nirsoft\passwordfox_170 (nirsoft, nspsfx403!).zip
C:\LIB\Nirsoft\passwordfox_170-x64 (nirsoft, need 64 for 64 FF, nspsfx403!).zip
C:\LIB\Nirsoft\wirelesskeyview_222 (nirsoft, WKey4567#).zip
C:\LIB\Nirsoft\wirelesskeyview_222-x64 (nirsoft, WKey4567#).zip
C:\LIB\Nirsoft\appcompatibilityview_106-x64 (nirsoft).zip
C:\LIB\Nirsoft\appcompatibilityview_106 (nirsoft).zip
C:\LIB\Nirsoft\tcplogview_135-x64 (nirsoft).zip
C:\LIB\Nirsoft\tcplogview_135 (nirsoft).zip
C:\LIB\Nirsoft\winupdatesview_115-x64 (nirsoft).zip
C:\LIB\Nirsoft\winupdatesview_115 (nirsoft).zip
C:\LIB\Nirsoft\ipinfooffline_160 (nirsoft).zip
C:\LIB\Nirsoft\wnetwatcher_225 (nirsoft, wirelessnetworkwatcher).zip
C:\LIB\Nirsoft\quicksetdns_131 (nirsoft).zip
C:\LIB\Nirsoft\guipropview_115-x64 (nirsoft).zip
C:\LIB\Nirsoft\guipropview_115 (nirsoft).zip
C:\LIB\Nirsoft\bulkfilechanger_172 (nirsoft).zip
C:\LIB\Nirsoft\bulkfilechanger_172-x64 (nirsoft).zip
C:\LIB\Nirsoft\dialupass261 (nirsoft, nsdlps3861@).zip
C:\LIB\Nirsoft\netrouteview_135 (nirsoft).zip
C:\LIB\Nirsoft\networkconnectlog_113 (nirsoft).zip
C:\LIB\Nirsoft\shadowcopyview_115-x64 (Win7+, needed on x64).zip
C:\LIB\Nirsoft\shadowcopyview_115 (Win7+).zip
C:\LIB\Nirsoft\previousfilesrecovery_110 (nirsoft).zip
C:\LIB\Nirsoft\previousfilesrecovery_110-x64 (nirsoft).zip
C:\LIB\Nirsoft\driverview_150-x64 (nirsoft).zip
C:\LIB\Nirsoft\driverview_150 (nirsoft).zip
C:\LIB\Nirsoft\regscanner_260-x64 (nirsoft).zip
C:\LIB\Nirsoft\regscanner_260 (nirsoft).zip
C:\LIB\Nirsoft\folderchangesview_232 (nirsoft).zip
C:\LIB\Nirsoft\shellbagsview_130 (nirsoft).zip
C:\LIB\Nirsoft\filetypesman_195-x64 (nirsoft).zip
C:\LIB\Nirsoft\filetypesman_195 (nirsoft).zip
C:\LIB\Nirsoft\runfromprocess_106 (nirsoft).zip
C:\LIB\Nirsoft\monitorinfoview_122 (nirsoft).zip
C:\LIB\Nirsoft\networkinterfacesview_121 (nirsoft).zip
C:\LIB\Nirsoft\networkinterfacesview_121-x64 (nirsoft).zip
C:\LIB\Nirsoft\installedappview_101 (nirsoft, Win10).zip
C:\LIB\Nirsoft\installedappview_101-x64 (nirsoft).zip
C:\LIB\Nirsoft\offlineregistryfinder_111 (nirsoft).zip
C:\LIB\Nirsoft\offlineregistryfinder_111-x64 (nirsoft).zip
C:\LIB\Nirsoft\ipnetinfo_195 (nirsoft).zip
C:\LIB\Nirsoft\networkcounterswatch_102 (nirsoft, Win7+).zip
C:\LIB\Nirsoft\browsinghistoryview_236 (nirsoft).zip
C:\LIB\Nirsoft\browseraddonsview_121 (nirsoft).zip
C:\LIB\Nirsoft\appreadwritecounter_125 (nirsoft).zip
C:\LIB\Nirsoft\appnetworkcounter_135 (nirsoft).zip
C:\LIB\Nirsoft\mzcv_158-x64 (nirsoft, mozilla cookies view).zip
C:\LIB\Nirsoft\mzcv_158 (nirsoft, mozilla cookies view).zip
C:\LIB\Nirsoft\driveletterview_150-x64 (nirsoft).zip
C:\LIB\Nirsoft\driveletterview_150 (nirsoft).zip
C:\LIB\Nirsoft\usblogview_126 (nirsoft).zip
C:\LIB\Nirsoft\countrytraceroute_131 (nirsoft).zip
C:\LIB\Nirsoft\routerpassview_188 (nirsoft).zip
C:\LIB\Nirsoft\multimonitortool_196 (nirsoft).zip
C:\LIB\Nirsoft\multimonitortool_196-x64 (nirsoft).zip
C:\LIB\Nirsoft\wakemeonlan_185-x64 (nirsoft).zip
C:\LIB\Nirsoft\wakemeonlan_185 (nirsoft).zip
C:\LIB\Nirsoft\sysexp_177 (nirsoft).zip
C:\LIB\Nirsoft\sysexp_177-x64 (nirsoft).zip
C:\LIB\Nirsoft\nircmd_286 (nirsoft).zip
C:\LIB\Nirsoft\nircmd_286-x64 (nirsoft).zip
C:\LIB\Nirsoft\lastactivityview_135 (nirsoft).zip
C:\LIB\Nirsoft\domainhostingview_182 (nirsoft).zip
C:\LIB\Nirsoft\alternatestreamview_156 (nirsoft).zip
C:\LIB\Nirsoft\alternatestreamview_156-x64 (nirsoft).zip
C:\LIB\Nirsoft\cports_260 (nirsoft).zip
C:\LIB\Nirsoft\shexview_201 (nirsoft).zip
C:\LIB\Nirsoft\shexview_201-x64 (nirsoft).zip
C:\LIB\Nirsoft\foldertimeupdate_155-x64 (nirsoft).zip
C:\LIB\Nirsoft\foldertimeupdate_155 (nirsoft).zip
C:\LIB\Nirsoft\offlineregistryview_103 (nirsoft).zip
C:\LIB\Nirsoft\offlineregistryview_103-x64 (nirsoft).zip
C:\LIB\Nirsoft\shmnview_141 (nirsoft).zip
C:\LIB\Nirsoft\shmnview_141-x64 (nirsoft).zip
C:\LIB\Nirsoft\regfileexport_111 (nirsoft).zip
C:\LIB\Nirsoft\runasdate_137 (nirsoft).zip
C:\LIB\Nirsoft\runasdate_137-x64 (nirsoft, need for x64 apps).zip
C:\LIB\Nirsoft\whoiscl_190 (nirsoft).zip
C:\LIB\Nirsoft\installedpackagesview_105 (nirsoft).zip
C:\LIB\Nirsoft\installedpackagesview_105-x64 (nirsoft).zip
C:\LIB\Nirsoft\appaudioconfig_110 (nirsoft).zip
C:\LIB\Nirsoft\appcrashview_135 (nirsoft, no XP).zip
C:\LIB\Nirsoft\ofview_186 (nirsoft).zip
C:\LIB\Nirsoft\ofview_186-x64 (nirsoft, x64 required on x64).zip
C:\LIB\Nirsoft\httpnetworksniffer_163 (nirsoft).zip
C:\LIB\Nirsoft\httpnetworksniffer_163-x64 (nirsoft).zip
C:\LIB\Nirsoft\smsniff_229 (nirsoft).zip
C:\LIB\Nirsoft\smsniff_229-x64 (nirsoft).zip
C:\LIB\Nirsoft\processthreadsview_129 (nirsoft).zip
C:\LIB\Nirsoft\processthreadsview_129 (nirsoft, for x64 apps).zip
C:\LIB\Nirsoft\mozillahistoryview_165 (nirsoft).zip
C:\LIB\Nirsoft\mozillahistoryview_165-x64 (nirsoft).zip
C:\LIB\Nirsoft\keyboardstateview_10 (nirsoft).zip
C:\LIB\Nirsoft\jumplistsview_116 (nirsoft).zip
C:\LIB\Nirsoft\rtmpdumphelper_122 (nirsoft).zip
C:\LIB\Nirsoft\rtmpdumphelper_122-x64 (nirsoft, need for FF x64).zip
C:\LIB\Nirsoft\serviwin_171 (nirsoft).zip
C:\LIB\Nirsoft\serviwin_171-x64 (nirsoft).zip
C:\LIB\Nirsoft\opensavefilesview_115 (nirsoft).zip
C:\LIB\Nirsoft\opensavefilesview_115-x64 (nirsoft).zip
C:\LIB\Nirsoft\wirelessnetview_175 (nirsoft).zip
C:\LIB\Nirsoft\encryptedregview_103 (nirsoft).zip
C:\LIB\Nirsoft\encryptedregview_103-x64 (nirsoft).zip
C:\LIB\Nirsoft\websitesniffer_151.zip
C:\LIB\Nirsoft\websitesniffer_151-x64 (nirsoft).zip
C:\LIB\Nirsoft\wul_133 (nirsoft, depricated).zip
C:\LIB\Nirsoft\clipboardic_115 (nirsoft).zip
C:\LIB\Nirsoft\ntfslinksview_130 (Win7+).zip
C:\LIB\Nirsoft\ntfslinksview_130-x64 (nirsoft).zip
C:\LIB\Nirsoft\insideclipboard_115 (nirsoft).zip
C:\LIB\Nirsoft\myuninst_177 (nirsoft, obsolete, use uninstallview).zip
C:\LIB\Nirsoft\recentfilesview_133 (nirsoft).zip
C:\LIB\Nirsoft\diskcountersview_127 (nirsoft).zip
C:\LIB\Nirsoft\myeventviewer_225 (nirsoft).zip
C:\LIB\Nirsoft\whosip_118 (nirsoft).zip
C:\LIB\Nirsoft\dllexp_166 (nirsoft).zip
C:\LIB\Nirsoft\dllexp_166-x64 (nirsoft).zip
C:\LIB\Nirsoft\bluetoothlogview_112 (nirsoft).zip
C:\LIB\Nirsoft\netbscanner_111 (nirsoft).zip
C:\LIB\Nirsoft\wincrashreport_125 (nirsoft).zip
C:\LIB\Nirsoft\lsasecretsview_125 (nirsoft).zip
C:\LIB\Nirsoft\lsasecretsview_125-x64 (nirsoft).zip
C:\LIB\Nirsoft\simpleprogramdebugger_105 (nirsoft).zip
C:\LIB\Nirsoft\disksmartview_121 (nirsoft).zip
C:\LIB\Nirsoft\executedprogramslist_111 (nirsoft).zip
C:\LIB\Nirsoft\specialfoldersview_126 (nirsoft).zip
C:\LIB\Nirsoft\specialfoldersview_126-x64 (nirsoft).zip
C:\LIB\Nirsoft\regdllview_160 (nirsoft).zip
C:\LIB\Nirsoft\regdllview_160-x64 (nirsoft).zip
C:\LIB\Nirsoft\mozillacacheview_169 (nirsoft).zip
C:\LIB\Nirsoft\mmcsnapinsview_10 (nirsoft).zip
C:\LIB\Nirsoft\officeins_120 (nirsoft).zip
C:\LIB\Nirsoft\officeins_120-x64 (nirsoft).zip
C:\LIB\Nirsoft\securitysoftview_10 (nirsoft).zip
C:\LIB\Nirsoft\bulletspassview_132 (nirsoft, 32-bit apps).zip
C:\LIB\Nirsoft\bulletspassview_132-x64 (nirsoft,x64 64-bit apps).zip
C:\LIB\Nirsoft\whatishang_127 (nirsoft).zip
C:\LIB\Nirsoft\whatishang_127-x64 (nirsoft, for frozen x64 apps).zip
C:\LIB\Nirsoft\bluescreenview_155 (nirsoft).zip
C:\LIB\Nirsoft\processactivityview_116 (nirsoft).zip
C:\LIB\Nirsoft\processactivityview_116-x64 (nirsoft, for x64 apps).zip
C:\LIB\Nirsoft\socketsniff_111 (can only see x86 apps).zip
C:\LIB\Nirsoft\regfromapp_133 (nirsoft).zip
C:\LIB\Nirsoft\regfromapp_133-x64 (nirsoft, for x64 apps).zip
C:\LIB\Nirsoft\fastresolver_126 (nirsoft).zip
C:\LIB\Nirsoft\lsasecretsdump_121 (nirsoft).zip
C:\LIB\Nirsoft\lsasecretsdump_121-x64 (nirsoft).zip
C:\LIB\Nirsoft\sniffpass_113 (nirsoft).zip
C:\LIB\Nirsoft\sniffpass_113-x64 (nirsoft).zip
C:\LIB\Nirsoft\volumouse_203-x64 (nirsoft, needed for x64).zip
C:\LIB\Nirsoft\volumouse_203 (nirsoft).zip
C:\LIB\Nirsoft\iecv_177 (nirsoft).zip
C:\LIB\Nirsoft\flashcookiesview_115 (nirsoft).zip
C:\LIB\Nirsoft\resourcesextract_118 (nirsoft).zip
C:\LIB\Nirsoft\resourcesextract_118-x64 (nirsoft).zip
C:\LIB\Nirsoft\netresview_127 (nirsoft).zip
C:\LIB\Nirsoft\faview_132 (nirsoft).zip
C:\LIB\Nirsoft\eventlogsourcesview_10 (nirsoft).zip
C:\LIB\Nirsoft\installedcodec_130 (nirsoft).zip
C:\LIB\Nirsoft\installedcodec_130-x64 (nirsoft).zip
C:\LIB\Nirsoft\shellmenunew_102 (nirsoft).zip
C:\LIB\Nirsoft\whatinstartup_135 (nirsoft).zip
C:\LIB\Nirsoft\whatinstartup_135-x64 (nirsoft).zip
C:\LIB\Nirsoft\downtester_130 (nirsoft).zip
C:\LIB\Nirsoft\esedatabaseview_106 (nirsoft).zip
C:\LIB\Nirsoft\bluetoothview_166 (nirsoft).zip
C:\LIB\Nirsoft\shman_110 (nirsoft).zip
C:\LIB\Nirsoft\altstreamdump_105 (nirsoft).zip
C:\LIB\Nirsoft\iehv_170 (nirsoft).zip
C:\LIB\Nirsoft\winfontsview_110 (nirsoft).zip
C:\LIB\Nirsoft\webvideocap_141 (nirsoft).zip
C:\LIB\Nirsoft\customexplorertoolbar_105 (nirsoft, no XP).zip
C:\LIB\Nirsoft\iecacheview_145 (nirsoft).zip
C:\LIB\Nirsoft\urlstringgrabber_111 (nirsoft).zip
C:\LIB\Nirsoft\siteshoter_142 (nirsoft).zip
C:\LIB\Nirsoft\wirelesskeydump_10 (nirsoft).zip
C:\LIB\Nirsoft\userassistview_102 (nirsoft).zip
C:\LIB\Nirsoft\iconsext_147 (nirsoft).zip
C:\LIB\Nirsoft\seqdownload_126 (nirsoft).zip
C:\LIB\Nirsoft\cleanafterme_137 (nirsoft).zip
C:\LIB\Nirsoft\dotnetresourcesextract_101 (nirsoft).zip
C:\LIB\Nirsoft\searchfilterview_10 (nirsoft).zip
C:\LIB\Nirsoft\muicacheview_101 (nirsoft).zip
C:\LIB\Nirsoft\openwithview_111 (nirsoft).zip
C:\LIB\Nirsoft\urlprotocolview_115 (nirsoft).zip
C:\LIB\Nirsoft\htmlastext_111 (nirsoft).zip
C:\LIB\Nirsoft\awatch_105 (nirsoft).zip
C:\LIB\Nirsoft\cprocess_113 (nirsoft).zip
C:\LIB\Nirsoft\htmldocedit_102 (nirsoft).zip
C:\LIB\Nirsoft\gacview_111 (nirsoft).zip
C:\LIB\Nirsoft\axhelper_112 (nirsoft).zip
C:\LIB\Nirsoft\iepv_107 (nirsoft).zip
C:\LIB\Nirsoft\mimeview_110 (nirsoft).zip
C:\LIB\Nirsoft\mylastsearch_10 (nirsoft).zip
C:\LIB\Nirsoft\mspass_115 (nirsoft).zip
C:\LIB\Nirsoft\iedesignmode_10 (nirsoft).zip
C:\LIB\Nirsoft\pspv_163 (nirsoft).zip
C:\LIB\Nirsoft\injecteddll_10 (nirsoft).zip
C:\LIB\Nirsoft\mweather_150 (nirsoft).zip
C:\LIB\Nirsoft\astlog_102 (nirsoft)^depr-bulletspassview.zip
C:\LIB\Nirsoft\winexp_130 (nirsoft).zip
C:\LIB\Nirsoft\jrview_10 (nirsoft).zip
C:\LIB\Nirsoft\strun_122 (nirsoft).zip
C:\LIB\Nirsoft\asterie_103 (nirsoft-depricated^).zip
C:\LIB\Nirsoft\iecompo_10 (nirsoft).zip
C:\LIB\Nirsoft\jsae_110 (nirsoft).zip
C:\LIB\Nirsoft\netscapass_203 (nirsoft).zip
C:\LIB\Nirsoft\win9xpv_11 (nirsoft).zip
C:\LIB\Nirsoft\tflash210 (nirsoft).zip
C:\LIB\Nirsoft\acm_10 (nirsoft).zip
C:\LIB\Nirsoft\exeinfo_101 (nirsoft).zip
C:\LIB\Nirsoft\atnow_11 (nirsoft).zip
C:\LIB\Nirsoft\wmc_10 (nirsoft).zip
C:\LIB\Nirsoft\tagsrep_10 (nirsoft).zip
C:\LIB\Nirsoft\mmview_110 (nirsoft-depricated).zip
C:\LIB\Nirsoft\asterwin120 (nirsoft-depricated).zip

---


My desktop shortcut points to a batch file:

Code: Select all

start "" .\everything.exe -instance 15

If I look now at the Everything process, it shows just that.
But other times... (I'll have to come back to that...).

[void]

The basic idea of sizefilelist: is to search for files with a matching size from the files in the specified file list.

- Select files in a specific location
One location? Multiple locations? One file? Multiple files?

Any location, multiple locations, a single file or muliple files.
Basically select the desired files of interest where you are trying to find other files with the same size.

---The results will now contain files with the same size from the original selection
And with that... what am I supposed to see?

This basically gives you guide to possibly duplicated files.
However, unlike dupe:size this gives you duplicates that match only your specified files.

An example is to find all the possibly duplicated files on the E: drive that are the same on the D: drive:

• In Everything, search for:
  file: d: size:>1mb
• Select all results.
• Press Ctrl + Shift + C
• Change the search to:
  sizefilelist1: e:
• Ctrl + left-click the sizefilelist1: text
• Press Ctrl + V
• Click OK.
  ---Everything will now list files on the E: drive that are possibly duplicated from the D: drive.

Previously you would have to create awkward file lists or size lists from Excel.

The following search will also list the d: drive
sizefilelist1: e:|d: sort:size

OK, that's weird (in more then one way).
I selected (a) zero-byte file, & this time, I did get results (of zero-byte files).
AND (in more then one way), I had 1 file display (a .ms file, as it was) <> 0-bytes.

Yes, zero-sized files are annoying.
It works best when files in your sizefilelist: have a size.
Consider including the following in your search before copying filenames to the clipboard:
size:>0
-or-
size:

And then I went back & no longer saw it listed?
(And then, I crashed, heh.)

Thanks for the crash report.

Looks like Everything is out of memory.
Large file lists can consume a lot of RAM.
Everything will also need roughly 8 bytes for each files in the file list during the search.

Also Everything was unable to allocate 800 bytes of ram.
Small allocations that fail like this will cause Everything to exit with the dialog shown.
It's likely you have exceeded (or are very close to) the memory limits with the x86 version of Everything.
Only 2GB is available to the x86 version of Everything, even if you have more system RAM.
How much memory is Everything using?

There might be a memory leak here.
Although, I haven't found it yet..

There's a bug with the x86 version, I am working on a fix..

[jimspoon]

After retrieving the list of possible duplicate files using sizefilelist1:, the list can be very large, and it will be very helpful to be able hop through the list using F3 (Find Next) to find files in the directory of interest - because the list will have to be sorted by size to see files against their possible duplicates, and when sorted by size, the files in the directory of interest may be very far apart. I know Find Next is on the TODO list, I just wanted to note how beneficial it will be. It will really speed up going through the possible duplicate list.

[void]

Everything 1.5.0.1316a fixes a crash when searching for sizefilelist1: or filelist1: on x86.