Yes, I did. Or rather, I thought I did. I only just noticed the stop command to the rc script didn't work, so the restart command didn't either... After killing it myself and starting it again it works!
Thank you very much for your help!
And to think I though it was a bug in deluge...