Dupinator 1.0 Python script

SPONSORED LINKS

    Specification

  • Version: 1.0
  • File size: 0 KB
  • File name: index_txt
  • Last update:
  • Platform: Windows / Linux / Mac OS / BSD / Solaris
  • Language: Python
  • Price:Other Free / Open So
  • Company: Bill Bumgarner (View more)

Dupinator 1.0 script description:



Dupinator 1.0 is a Python script for File Management scripts design by Bill Bumgarner. It runs on following operating system: Windows / Linux / Mac OS / BSD / Solaris.
Dupinator script will find and delete all duplicate files within a folder or several folders.

Publisher review:
Dupinator script will find and delete all duplicate files within a folder or several folders. Point this script at a folder or several folders and it will find and delete all duplicate files within the folders, leaving behind the first file found of any set of duplicates. It is designed to handle hundreds of thousands of files of any size at a time and to do so quickly.It was written to eliminate duplicates across several photo libraries that had been shared between users. As the script was a one-off to solve a very particular problem, there are no options nor is it refactoring into any kind of modules or reusable functions. The script uses a multipass approach to finding duplicate files. First, it walks all of the directories pass in and groups all files by size. In the next pass, the script walks each set of files of the same size and checksums the first 1024 bytes. Finally, the script walks each set of files that are the same size with the same hash of the first 1024 bytes and checksums each file in its entirety.The very last step is to walk each set of files of the same length/hash and delete all but the first file in the set.It ran against a 3.5 gigabyte set of files composed of about 120,000 files, of which there were about 50,000 duplicates, most of which were over 1 megabyte. The total run took about 2 minutes on a 1.33ghz G4 powerbook. Fast enough for me and fast enough without actually optimizing anything beyond the obvious.
Operating system:
Windows / Linux / Mac OS / BSD / Solaris

Related script downloads:

Latest script and internet news

IE 10 for Windows 8, comes with Adobe Flash support

IE 10 for Windows 8, comes with Adobe Flash support

After criticism received at Metro version of Internet Explorer 10 , initially offered no support for Adobe Flash technology, Microsoft has taken measures to correct this problem by working directly with Adobe to integrate the necessary components into the

Posted on: 25 May 2012 10:36 by A. Brown

Windows 8: boot to fast to furious

Windows 8: boot to fast to furious

Last year began to circulate on the Internet videos where Windows 8 systems boot in 7 seconds. Unfortunately, from this performance derives some problems.

Posted on: 25 May 2012 07:28 by A. Brown

Apple prepares iPhone 5 and iOS 6

Apple prepares iPhone 5 and iOS 6

New information coming from some sources close to Apple confirming that the Cupertino giant is testing two different models of iPhone, called internal iPhone5, 1 and iPhone 5.2. Apparently, both devices have a screen of 3.95 inches and a resolution of 113

Posted on: 24 May 2012 08:36 by A. Brown

Windows 8 estimates: 500 million users in 2013

Windows 8 estimates: 500 million users in 2013

Microsoft expects to launch a new wave of optimism with Windows 8. In a recent statement, Steve Ballmer, chief executive at Microsoft, estimates that Windows 8 will reach a total of about 500 million users by the end of 2013.

Posted on: 24 May 2012 08:25 by A. Brown

SPREAD THE WORD

User Rating

Dupinator
Rating: 0.0 out of 5
Based on 0 ratings. 0 user reviews.

  • Currently 0.00 out of 5
  • 1
  • 2
  • 3
  • 4
  • 5