Display/Remove duplicate bookmarks or empty folders

Latest Version

Version

7.2

Update

August 15, 2022

Size

74.14KiB

Developer

Bookmark Dupes Extension

# bookmarkdupes

(C) Martin Väth ,

This project is under the GNU Public License 2.0.

A WebExtension which can display/remove duplicate bookmarks or empty folders.

After installing bookmarkdupes, the usage is rather simple:

To open bookmarkdupes, click the extension symbol (duplicate stars) or
use the link in the options page of the extension.
**Do not enable “Expert Mode”** (unless you fully understand the consequences,
see separate section).
Then select what you want to display:

1. Bookmark duplicates
2. Empty folders
3. Non-duplicate bookmarks

After this, you will be offered the list of bookmarks with checkboxes;
in case 1 the numbers indicate the order in which matching bookmarks
were added according to the internally stored date.
There are also buttons to select/unselect convenient sets of checkboxes.

Finally, there are buttons to remove the selected bookmarks.

**Be aware that removing bookmarks is irreversible!**
*It is recommended to make backups of your bookmarks first!*

Currently, there is no working version of the extension available for android
(see section **Known Bugs**).

## Important

When you reorganized/added/removed bookmarks, make sure to update the
displayed list (by pressing the corresponding button) before removing
bookmarks!

## Permissions

The extension requires the following permissions for these reasons:

1. “bookmarks” to read/modify bookmarks
2. “storage” to store/restore the customized rules in expert mode.
Unfortunately, “storage” is not one of the optional permissions which might
be required only if that feature is actually requested by the user.

## Expert Mode

When selecting the checkbox for expert mode, details can be configured to
ignore certain bookmarks when calculating the list or under which cases
bookmarks are considered to be dupes of each other.

In non-expert mode, two bookmarks are considered to be duplicates of each
other if their URL coincides.
In expert mode there are custom rules by which the URL which is actually
used for comparison is to be modified. The details are as follows.

For every bookmark the rules are applied in the given order.
There are 2 types of rules: Filter rules and URL modification rules
(there are also disabled rules which are only listed but have no effect).

For both types of rules 4 regular expressions can be specified which are used
to determine if the rule applies: If the corresponding regular expression is
nonempty, the corresponding condition must be satisfied or the rule will not
apply. (In the case of filter rules, at least one of these 4 regular
expressions must be nonempty or that filter rules will not apply either.)

The 4 regular expressions refer to the bookmark's name or url, respectively,
and the regular expressions must either match or not match, respectively.

- The term “regular expression” refers to a javascript type regular expression.
- The bookmark's name refers to the full bookmark path as it appears in the
browser with folder names separated by the null character.
For instance, if you have in “Bookmark Menu” a folder “Collection”
which contains your bookmark \"Example\", the bookmark's name becomes
`Bookmark Menu\\0Collection\\0Example` (where `\\0` denotes the null character
which can be matched by the regular expression with `\\0` or `\\x00`).
- The bookmark's URL refers to the bookmark URL after possible modifications
by previous modifier rules.

If a filter rule applies, the corresponding bookmark is ignored, i.e.,
it will not be considered as a duplicate and will neither appear in the
list of empty folders nor of all bookmarks.

If a URL modification rule applies, a text replacement will occur:
All parts matching a specified regular expression are substituted by a
replacement text (which might be empty).
The rules for this correspond to the javascript String.prototype.replace
function with the global modifier.

In particular, the replacement text can contain symbols like
`$&` or `$1` to refer to the whole matched text or to the
match of the first brace in the regular expression, respectively.

The following 5 replacement texts have a special meaning which goes beyond
the standard javascript replacement rules.

Note that this special meaning is only active if this is the full replacement
text. In other words, to get the special meaning, the replacement text must not
contain anything else than these 4-6 characters.
(This does not really restrict the functionality, because one can combine
several rules to work around that limitation if necessary.)

1. `\\L$&` is the match in lower case.
2. `\\U$&` is the match in upper case.
3. `$URL` is the url before any other rules have been applied.
4. `$NAME` is the bookmark's full name/path with folders separated by the
null character, e.g. “Bookmark Menu\\0Collection\\0Example”
5. `$TITLE` is the bookmark's title without the path; for instance, for the
bookmark name “Bookmark Menu | Collection | Example” it is “Example”.

## Examples for special tasks which can be done in Expert Mode

### Task

1. Consider two bookmarks as duplicate if their URL differs only in `https:` vs. `http:` at the beginnning.

2. Consider two bookmarks as duplicate if their URL matches up to the first `?` symbol, i.e. only their additional information differs.

3. Do not consider any bookmark from any folder named ``Mr. Dupe`` as a duplicate.

4. Add all bookmarks to the list of duplicates, whether duplicate or not.

5. Add all bookmarks from the folder `Bookmark Menu | Remove` to the list of duplicates (no matter whether they actually are duplicates).

6. Consider two bookmarks as duplicate if they have the same name (instead of the same URL).

7. Consider two bookmarks as duplicate if they reside in the same folder.

### How to do the above tasks in Expert Mode

1. Use the replacement rule: “Replace URL matches” `^http:` “by” `^https:`

Explanation: By replacing everywhere the URL beginnning with `http:`
by `https:`, it does not matter whether the actual URL started with `http:`
or `https:`. Of course, we could have exchanged the roles of `http`
and `https` in our rule.

2. Use the replacement rule: “Replace URL matches” `\\?.*` “by” ` ` (empty string)

Explanation: Simply omit the ? symbol and all other symbols following it
in all URLs.

3. Use the filter rule: “Name matches” `\\0Mr\\. Dupe\\0` or `\\0Mr[.] Dupe\\0`

Explanation: If a bookmark is in a folder named “Mr. Dupe”, its full name (path) will contain the text “\\0Mr. Dupe\\0”; so match that text. Since the “.” symbol has a special meaning for regular expressions, we have to quote it. This can be done by either `\\.` or by looking for a character class `[…]` which contains only the single symbol `.`.

4. Use the replacement rule: “Replace URL matches” `.+` “by” `constant`

Explanation: Pretend that every bookmark has the URL `constant` by replacing all characters (`.+`) of the original URL by that text.

5. Use the replacement rule: “Name Matches” `^Bookmark Menu\\0Remove\\0` “Replace URL matches” `.+` “by” `constant`

As in 4, but only for bookmarks whose full name starts with the matching path.
This works only if the folder contains at least 2 bookmarks (because otherwise `constant` is not a duplicate URL). Of course, one might use an actually duplicate URL instead of `constant` to work around this limitation.

6. Use the replacement rule: “Replace URL matches” `.+` “by” `$TITLE`

Explanation: Replace all bookmark URLs by the corresponding bookmark title when looking for dupes.

7. Use the replacement rule “Replace URL matches” `.+` “by” `$NAME` followed by a further replacement rule “Replace URL matches” `[^\\0]*$` “by” ` ` (empty string)

Explanation: First replace the URL by its full name path, and then omit the last component of this path by cutting of the longest sequence of non-`\\0`-symbols at the end.

## Contributors

(in alphabetical order)

- Essam Ambr aka (JaMaYcKa) (Arabic translation)
- Henaro aka Ironwool (Russian and Ukrainian translation; redesign icon in svg; provide favicon)
- Sopor (Swedish translation)
- Juan Salvador Aleixandre Talens (Spanish translation)
- YFdyh000 (Simplified Chinese translation)

Source Manifest.json

{"update_url": "https://clients2.google.com/service/update2/crx", "name": "__MSG_extensionName__", "short_name": "bookmarkdupes", "description": "__MSG_extensionDescription__", "author": "Martin V\u00e4th", "version": "7.2", "manifest_version": 3, "default_locale": "en", "permissions": [ "bookmarks", "storage" ], "background": { "service_worker": "background.js" }, "action": { "default_icon": { "16": "data/icons/16.png", "32": "data/icons/32.png", "48": "data/icons/48.png", "128": "data/icons/128.png" }, "browser_style": true }, "options_ui": { "page": "data/options/index.html" }, "icons": { "16": "data/icons/16.png", "32": "data/icons/32.png", "48": "data/icons/48.png", "128": "data/icons/128.png" }}

Download CRX(74.14KiB)

Similar Extensions

Bookmarks clean up Extension · Productivity 10,000+ 600 ★ 861KiB

Bookmarks Checker - Remove broken links Extension · Productivity 10,000+ 200 ★ 797KiB

SuperSorter Extension · Productivity 10,000+ 1338 ★ 430KiB

Duplicate bookmarks remover Extension · Accessibility 10,000+ 15 ★ 453KiB

Bookmark Manager - Save Tab for Later Extension · Productivity 10,000+ 11 ★ 4.44MiB

Bookmark Manager per Domain and Page Extension · Productivity 10,000+ 11 ★ 13.83KiB

Smart Bookmark Manager Extension · Accessibility 10,000+ 35 ★ 91.59KiB

Bookmarks Commander Extension · Productivity 10,000+ 58 ★ 98.41KiB

Clean Bookmark Extension · Productivity 10,000+ 5 ★ 1.26MiB

FBS II : Fast Bookmark Scanner II Extension · Productivity 10,000+ 822 ★ 82.39KiB

online / offline Bookmark Manager Extension · Productivity 10,000+ 40 ★ 533KiB

Bookmarks Table Extension · Productivity 10,000+ 26 ★ 180KiB

Finder Bookmarks Extension · Productivity 10,000+ 39 ★ 89.45KiB

Duplicate Bookmarks Finder Extension · Productivity 10,000+ 7 ★ 291KiB

Bookmark beautifier Extension · Accessibility 10,000+ 19 ★ 625KiB

Bookmark Pro Extension · Productivity 10,000+ 23 ★ 1.99MiB

Bookmark Manager - favattic.com Extension · Productivity 10,000+ 13 ★ 192KiB

Bookmark Manager Plus Extension · Productivity 10,000+ 76 ★ 238KiB

Bookmark Manager and Viewer Extension · Productivity 10,000+ 103 ★ 311KiB

Recursive Bookmark Sorter Extension · Accessibility 10,000+ 161 ★ 74.73KiB

Bookmarks Organizer Extension · Productivity 10,000+ 55 ★ 41.23KiB

Starmarks Bookmark Manager Extension · Productivity 10,000+ 37 ★ 321KiB

Sprucemarks Extension · Productivity 10,000+ 414 ★ 509KiB

Bookmanize - Advanced bookmark manager Extension · Productivity 10,000+ 66 ★ 397KiB

User reviews

Hambone Designs (ID: 00000095c3f74121) Voted 5 ★ - Updated 11/01/2023 Does exactly what you think it should. Love this.

郭奇异 (ID: 000000d5a9013596) Voted 5 ★ - Updated 10/26/2023 you saves my life!

Helar Kallas (ID: 0000002867de81fa) Voted 5 ★ - Updated 10/24/2023 Thanks!!! Deleted 45K of duplicates from 20+ years with 0 effort. Tried several other tools but they were rather pointless, like having to select each bookmark manually?! :D

fruck wheeled (ID: 0000003e9634f2a4) Voted 5 ★ - Updated 10/11/2023 Allowed me to find and conveniently move NON duplicate bookmarks from several imported bookmark folders, fast easy awesome compared to the un-intuitive and low capability competition. Thanks.

Wesley Moy (ID: 00000085ba2f0d60) Voted 5 ★ - Updated 09/26/2023 Exactly what I needed. The extension provided all the options I needed to clean up my duplicates surprisingly quickly and with a clear understanding what I'm doing.

Get source code (.Zip)

Drop .crx file here or click
the button to choose the file

Bookmark Dupes