include
Skip to main content
Not for now

Detect duplicate tracks by name (or other means) in playlists and bulk remove

Rafael.
slavakraynov
+318
  • Rafael.
    Rafael.
  • udz
  • ReMa
  • slavakraynov
    slavakraynov
  • Ionix
  • markec600
  • walker
    walker
  • yaBoroda
  • zerospace
  • Bert
  • chrisxdxl
  • Shahar Shalev
  • fisayo
  • Nossus
  • Ananas
    Ananas
  • Leonhard.Bartsch
  • Radu Pal
  • vbtop
  • Thorn
  • rimlock
  • Diz
  • Iggy
  • PavePoeka
  • TYCHO
  • marvinlenard
  • ke9ine
  • shmishleniy
  • svartpelz
  • Xserber
  • DBerkers
  • CJ2151
  • Pasha Zavoiskikh
  • Mirokrijo
  • vmorozov
  • alejandrocm26
  • Mik
  • Luan Gazin
  • bigbadthor
  • nir.magenheim
  • Chitalu Andrew Kabalika
  • Jomppalandia
  • ConAcky
  • mika.driessen
  • David.G
  • Ady
  • Rustinpieces
  • sohail.shaukat
  • shamanbo
  • Dd33
  • nzuzee
  • Buzulis
  • huub.vanoort
  • Jesseee_
  • sommerfeldmarcus
  • Alex.Matheus
  • Zion Ovadia
  • rfqazri
  • Desl
  • A J
  • Scallywag
  • Vaznara
  • Marcos Souza
  • danielschoenell
  • Chris.Nelson
  • Tobinho
  • krz
  • elty
  • KennyMac
  • Phantomhobo
  • Erico B. P.
  • Jurgen.Zonnenberg
  • NicoBanega
  • Draugwe
  • Pdtrjck
  • Raynio
  • Liu Metivier
  • Sergey B.
  • Herman Daniel Langner
  • RBXII3
  • Oz-Texugo
  • Jack Vincent
  • lrobichon
  • Mitchell.McCracken
  • cloudyi
  • VitiumOriginis
  • Nuno Silveira
  • Ash C
  • Davi.Viana
  • Yelisei
  • jaysoncerbas
  • Afiq NO Sawan
  • jakesnake
  • Luffy Kuqo
  • LivinLaVidaLohan
  • bellido84
  • Zubr.Bydle
  • bruna.marques.96199
  • Aidan.Fallon
  • CaCO3
  • Thommy.Doombringer
  • Marcin Kaczmarek
  • Marcelo Neves Lopes
  • ramonhpr
  • Gdw
  • AutoMonkteur
  • Marvin S_kills
  • Kian Middo
  • DragoWing
  • Rob van Druenen
  • Lincoln D.
  • Steeve
  • WuWup
  • NickNight
  • granite11
  • Mazun
  • marko-style
  • Vladimir Georgiev
  • hazielhage
  • Dominik_Egert
  • Hinex
  • bincho
  • Herberson.Silva
    Herberson.Silva
  • Lacyel
  • Pruu e Piggy
  • harmvandenberg
  • Rolo1977
  • Cane
  • djeneta
  • greyrok
  • eriickds
  • XDavidT
  • Chrishoode
  • Kuschelwampe
  • Jeffrey Bouva
  • John.FreeLancer
  • djdazzyb
  • Belph
  • Rudi
    Rudi
  • beeage
  • CattyXO
  • Chris.Eilander
  • Dmitry L
  • Arthyxe
  • Stanislav_UA
  • freaktech
  • NVis
  • StephenJBaker
  • Rafael L
  • Rodrigo.Vernaschi
  • Marin V
  • Jacob.Mulder
  • Lloyd Hughes
  • Cupitor
  • PetroLviv
  • gusVLZ
  • DjBlood
  • Lune
  • Mihael
  • Lucas_m_Araujo
  • Alonso_05
  • Anna-Louis
    Anna-Louis
  • Mucorhinatiol
  • The_Io_Gamer
  • Valentino
  • Zakhar Martynov
  • jryy
  • argomis
  • neol
  • Stéfan.Jarrossay
  • snipergodboy
  • gms7
  • D0P4M1N
  • fabiorho
  • deivid18
  • adaptiveAxis321
  • Yevhen Vasyliev
  • orangStalin
  • Raif Coonjah
  • rufix
  • Gianno Stjeward
  • callero.lucas
  • Kamen Iliev
  • Omar Montaser
  • Eugene Kobiliatsky
  • Timo.Volkenrath.
  • BeboBanana
  • tednapier
  • Serhii.Romashkin
  • Monsobwe
  • James.Carter
  • stevenomes
  • htkblazer
  • Leonardo de Sousa Marques
  • Unopa Male
  • Sabrael
    Sabrael
  • sergisanztora
  • Coksi
  • MK1976
  • Carlos-Jay
  • rchaves77
  • WiMank
  • Angy Domínguez
  • Manuel Flegaric
  • K.Kayra Banak
  • Katy93
  • tjgavlick
  • Luis ahr
  • Cleber Tomaz
  • WAZZA1295
  • lukaafx.
    lukaafx.
  • Marpel68
  • CuRseD
  • Artoon
  • Philip Anderson
  • Rebel
  • Optimizer
  • MATHÉO.YANN
  • EPurpl3
  • J-Cro
  • Christi Satire
  • stijn cabuy
  • blendkrasniqi
  • mich19777
  • Mohammed sachit
    Mohammed sachit
  • george_deezer
  • maximus
  • kobulov
  • estevez
  • Russell26
  • Michal90
  • Gilad.Garon
  • amoshi
  • Erick Castro
  • chavezdaniel
  • nyje
  • DaBIGOne
  • OhDung
  • abrizk
  • mhzx
  • Jasim
  • Minimoon
    Minimoon
  • Adam_deezer
  • Thach Nguyen
  • jashan
  • Matheus Huberth
  • ArkLight
  • Amadi Jenyekah
  • Anatolio0320
  • Fmsh7
  • Ich Nicht
  • CRoss7747
    CRoss7747
  • MarRob
  • archaic_email
    archaic_email
  • Heldenstadt
  • Gerwin.Volkerink
  • tokyojupita
  • Moshpit Kosse
  • Ahmed Asc
  • Thegreatemas
  • KraqatoaTheKrab
    KraqatoaTheKrab
  • deezerman25689
  • LucasDondo
    LucasDondo
  • SaraJaleh
    SaraJaleh
  • Horsemanofthe_Apocalypse
  • Mister_Sterling
  • Diego.E
  • Cyberonaut
    Cyberonaut
  • Dj Flexo
  • Stijnl
  • alusher2
  • ItsNico
  • Zayn-T
    Zayn-T
  • BLKKKSKKKNHEAD
    BLKKKSKKKNHEAD
  • tytoalba25
  • kayWreckz
  • Matt_3050
    Matt_3050
  • mtbfan
  • waddon1
  • mournfulpigeon
    mournfulpigeon
  • Mate Sučić
  • eta06
  • JMRD
  • Drannex42
  • Richard Cooper
  • bromius.harbinger
  • Jay Deadhead
  • Jingah
  • Nemanja Mago
  • dead2thewind
  • Leala
  • Crystal Ross
  • Carlos17
  • Adam Ogiliev
  • Geomy
  • Cyrille
  • mitsiklas13
    mitsiklas13
  • Spookhouse
    Spookhouse
  • Matt Kerper
  • mateo.
  • Nestor21
  • TurnItUp
  • Jules Trouwen
  • nmd55
  • Jarod
  • radan
  • theyrights
  • cr57
  • Alexandre Douchin
    Alexandre Douchin
  • JuanDavid
  • elliott2525
  • Martinezfx
  • Lehaan.Jankee
  • MalamoFF
  • LeRubenor
  • Pedro Poma
  • steffenc92
  • PrinzOfAlex
  • monkeysmasher1
  • Jacob Mose Andersen
  • iamleetitus
  • pencilled_robin
    pencilled_robin
  • musicoftheworldunite
  • Bebouz

This idea stems from this thread.

It would be useful to be able to detect duplicate tracks in a playlist.

I know that if you try to add the exact same track, you will get a notification that the track already exists in the playlist but there are tons of the same tracks, either because they exist on different albums, or covers, remakes, remixes etc etc (see here for example).

So if it was possible to perhaps detect duplicates by track name and bulk remove, then that would be very useful for managing very large playlists (thousands of tracks) - hence why manually sorting alphabetically by track name and manually ticking the boxes to remove duplicates isn't a very efficient means.

14 replies

walker
Star Wo-Man
Forum|alt.badge.img+5
  • Star Wo-Man
  • 459 replies
  • September 23, 2019
You are right. Most part of library contains duplicated songs (sometimes more than twice). Sometimes artists launch an album with their best songs, other times they collaborate with other artists.
If you think about it, maybe Deezer doesn't really have more than 28 million songs, instead of >56 they say.

Rudi
Alien SuperStar
Forum|alt.badge.img+7
  • Alien SuperStar
  • 14342 replies
  • September 25, 2019
Hey @zigojacko

Very happy you created the idea and advertised it there, on the other topic. Thank you for your support.
Just to add: perhaps the app can pop a message to say "maybe you've got this track already". In any case, I'll pass your idea on 😉

  • Tiny Dancer
  • 4 replies
  • October 28, 2019

This would be extremely useful!!!! Please add this feature!


Forum|alt.badge.img+2
  • Lover
  • 52 replies
  • July 25, 2020

  • Tiny Dancer
  • 5 replies
  • October 21, 2020

An option in the player where you can see if you added that song to any of your playlist. You will see the name of those playlist in there.

 

I love making playlist. I have a playlist where I put songs that I enjoy and would like to save in an specific playlist. When I know in what playlist belongs, I erase that song from that temporal playlist, and put it in the right place. The problem is, sometimes I can't remember witch song I already saved, I don't have a great memory. I could put those songs with a favorite, but I would fill my favorite limit too quickly.

 

I think no other steaming service have this feature, it would be really useful and attractive to users.


Deezer could use a feature to detect identical tracks in your favourites, so users could avoid cluttering their favourites by adding the exact same track multiple times albeit from different sources (‘best of’ albums / playlists etc). At the moment, the only way is to sort favourites alphabetically and manually delete duplicates.


Rudi
Alien SuperStar
Forum|alt.badge.img+7
  • Alien SuperStar
  • 14342 replies
  • October 27, 2020

Hey @alansheahan97 

Thanks a lot for your support. Moved your comment here, please vote for the idea above :wink:

Hi @nemterest 

Moved your comment here too, these enhancements are looked into by the same teams and the good news is that they're looking for new features to add to playlists at the moment. Stay tuned and don't forget to vote above too. I've forwarded what you said :thumbsup_tone2:


Rudi
Alien SuperStar
Forum|alt.badge.img+7
  • Alien SuperStar
  • 14342 replies
  • February 10, 2021
Updated idea status In discussionNot for now

  • Tiny Dancer
  • 1 reply
  • February 22, 2021

I'm so glad this was raised. I have literally just joined Deezer having being with Spotify for over 4 years, I just cannot believe this feature isn't on the service, so far its let me download the exact same 3 songs onto a playlist, only difference...3 different albums, even the really old  versions of iTunes had this feature. I think I'll keep my Spotify going a while until I decide which is better, but to not have a simple feature like this...


Forum|alt.badge.img
  • Runaway Baby
  • 25 replies
  • April 8, 2021

Coming here from another thread and (mostly) pasting some thoughts I shared with @Rudi in private messages recently. Given the current status of this idea (“Not for now”), I have little hope to see anything done towards solving the problem anytime soon, but maybe the following will give someone some food for thoughts.

A proper automated system would detect duplicates many times faster than any human would be able to, so reporting problems on a case by case basis is a huge waste of time, both the users’ and the Deezer’s team, whose time would probably be better spent automating this thing.

While I don't know exactly what kind of metadata you keep about every song, the metadata that is visible in the user interface would be quite lacking for a recommender system. What I'd probably expect in a decent database based on my experiences with community-curated content is:

  • linking all exact duplicates of a song, and selecting a preferred copy for the purposes of recommendations (nothing wrong with having multiple copies if they were published multiple times, but if they’re exact copies, the recommender engine should know about it),
  • a list of strongly related songs (e.g. covers, remixes, jazz standards, live vs. studio vs. acoustic performance, etc., though storing the specific nature of a relation is probably not necessary—just stating the fact that two songs are similar would be enough); this list may refer to works outside of Deezer's catalogue where proper,
  • linking all easily identifiable artists to each work (probably at least the composer and all vocalists in addition to the band name, and a music director for works like soundtracks—that’d do for popular music; pretty sure criteria for classical music would be somewhat different),
  • maybe a list of related non-music works (e.g. a TV series or a game where the song was promoted), though that information can usually be derived from the album the song appeared in.

All of these information would be both useful to explore music (e.g. a user looking for songs with a specific vocalist or different renderings of a specific music theme), and to avoid boring recommendations (e.g. too many songs by a given composer within a single day). I’ve seen all of these working quite well for a community-curated internet streaming service, though at a smaller scale, where the engine had some nice tunable constraints, like “do not play the same song sooner than in 5 days, do not play any strongly related song sooner than in 2 days, do not play the same artist (not just “the same band”) sooner than in 6 hours, do not play more than three Touhou songs in a single hour (that one was extremely useful…)”, etc.

Given the scale of operation, Deezer is not really in position to fill in all that metadata without automation or coöperation with users that is much more streamlined than just a basic discussion forum.

The first and second bullets could be semi-automated using music similarity tooling (basic name matches will have more false positives and more false negatives). The third and fourth bullets could start from being managed by users as a form of a plain old web2.0 tag cloud, probably provided as an opt-in experimental feature to avoid it being visible to the more casual users, with the Deezer team stepping in to moderate/verify/publish them only when they amass.


Forum|alt.badge.img
  • Runaway Baby
  • 25 replies
  • April 8, 2021

I’ve been attacked by Kyu Sakamoto today again and again. Turns out, there’s *a lot* of duplicates:

I frankly wonder whether Deezer’s claim of so many millions of songs isn’t just false advertising falling under unfair competition laws.


  • Tiny Dancer
  • 1 reply
  • January 13, 2022

This is sooo much needed!


Bumping it up!

Just used Tune My Music to merge all the services I’ve used in the past, and now have to clean a sh*tload of duplicates, slightly different versions, and “unavailable in your country” songs in my Favorites, would be awesome to have a feature to at least speed up some parts of this process 


Yula
Moderator
Forum|alt.badge.img+10
  • Moderator
  • 3225 replies
  • February 7, 2022

Thank you @Lucas Otanari for letting us now!