I have "solved" it by running a "On Torrent Complete" plugin.
This plugin triggers a shell script which does a force recheck with below command
/usr/bin/deluge-console "recheck $1"