google casting issue with syncing

When I cast on my google speaker it doesn’t stay updated on my app. I can skip songs through the google home app but on the Deezer app it starts playing different songs through my phone speaker if I try and change the song. It doesn’t stay synced as the music plays. Is there a way to fix this?