Remove Duplicate Files

Duplicate File Detective

Wednesday, November 25, 2009

Calculating File Hashes (Checksums) in Duplicate File Detective v3

Today I'd like to briefly illustrate some of the improvements made to the file hash calculator tool in Duplicate File Detective v3.0.

First, and perhaps most importantly, the file hash calculator has been re-designed to allow for the generation of multiple file hash types for multiple file paths - all in a single pass.

file hash / checksum generation with Duplicate File Detective v3As you can see in the adjacent screen shot, it is now possible to generate CRC32, ADLER32, MD5, SHA1, SHA256, and SHA512 file checksums with only a single read of each target file.

The output of the file hash / checksum operations has also been re-engineered to display results in a hierarchical (tree like) fashion. For each file hashed, a series of child nodes show the hash value for each type (e.g. CRC32, MD5, etc.) selected in the area above.

It is also possible to copy file hash results to the Windows clipboard, in which case they are "flattened" into a series of plain-text lines.

Here's a quick sample of what the hash results shown above look like on the Windows clipboard (folder names and hash values are truncated for easier viewing in this limited space):

C:\MoveTest\Sample Pictures\Lighthouse.jpg (CRC32): A3A2B75C
C:\MoveTest\Sample Pictures\Lighthouse.jpg (MD5): 8969288F4245120E7C3870287CCE...
C:\MoveTest\Sample Pictures\Lighthouse.jpg (Adler32): A6EA1A41
C:\MoveTest\Sample Pictures\Lighthouse.jpg (SHA1): 1B4605B0E20CECCF91AA278D10E...
C:\MoveTest\Sample Pictures\Lighthouse.jpg (SHA256): FF86372CE43519D675B8D8D29...
C:\MoveTest\Sample Pictures\Lighthouse.jpg (SHA512): 9BDD0C215A9BE94F6F677F8AD...
C:\MoveTest\Sample Pictures\Hydrangeas.jpg (CRC32): 03632F46
C:\MoveTest\Sample Pictures\Hydrangeas.jpg (MD5): BDF3BF1DA3405725BE763540D66...
[...]


The actual file hash / checksum generation process is extremely fast and efficient, and can also be canceled if needed.

Finally, it is also now possible to right-click any number of selected files within the main Duplicate File Detective result report and elect to generate hash values for them. This combination makes it very easy to generate and compare hash values of arbitrary strength (e.g. bit length) as needed.