Data missing after restarting Deluge

[MasterCATZ]

It is going off-topic but I will address your Deluge points.

I would really love a sfv creator plugin for downloads that do not have an sfv file I hate getting around to watching something later on and finding out the files been corrupted somewhere along the line

Unless the original movie file was corrupted there should be no reason that the torrent file should be.

this seems to be my only real problem atm , I am thinking it is FreeBSD related somehow

data just sems to disapear , I am assuming its because of caching that is going on along the way
if I close deluge data that was once complete is incomplete , so I am guessing data is not really getting written to disk when their blocks have been completed

if deluge IS really checking the data after a download is completed it is not picking up on it because its somehow reading from the cache yet later on when I go to access the file 20% seems to be missing ,

not to long ago I had a 5 part show downloaded parts 1 and 3 were 100% according to deluge but not showing in the folder while the incomplete parts 2 4 5 where showing
memory usage
32 gig RAM
4 gig inactive
12 gig kernel
4 gig application
1 gig Cache
4 gig Buffers

I had this problem once before with utorrent in windows system , once I turned on the option to force HDD disk writes it all cleard up

what is the clean way to shut down deluged any how
if I use the shutdown daemon option in the GUI I still get this issue ( and it even re downloads a huge list of files that IT has already Moved into a Completed Folder when it starts back up )

how ever this might be solved if I go to full allocation instead of compact allocation

but I have a few large 100+ gig torrent packs slloowwwly downloading atm so I actually do not have the HDD space to start doing this yet
( 500 gig Download SSD eventually going to be used for my zfs pre cache drive)

Completed Torrents get auto moved to a 8tb zfs Raidz array for sorting later on ( but I have also tested it moving to a folder on the same HDD with still this incomplete data happening )

going to change SSD to a few 500 gig striped HDD's Soon

( will be using the media players HDD's and just stream from network soon because I need to transcode all my 10 bit video clips to 8 bit for playback )

sorry for going completely OFF TOPIC

but back on topic I could not get this script to work assuming because it still needs Full Allocation files

[Cas]

When I said it was off-topic that was hint that you should create a new thread in support.

I am not sure about the data missing but it does sound like a caching issue, what version of libtorrent are you using?

The normal way to shutdown deluged is just, pkill deluged but if it there are issues in shutting down then it can fail to update the state file which would result in the re-downloading of moved torrents. You can verify this by enabling logging of deluged.

[MasterCATZ]

what would I be looking for in the debug ?
deluged --loglevel=debug

I am actually leaning towards because its not fully allocated files ( also thinking this is another thing I changed with utorrent so I guess so far only vuze has done this flawlessly for me ( Shame it got to bloated for me took almost an hr to start up I had that many completed torrents loaded in its list )

but that does not explain why its redownloading content it has already downloaded and moved to another location

how ever I might just end up going back to vuze soon , i need to find a way to stream all these damn 10 bit video clips I have been getting lately ( anime person )


another thing would be when you manually move files from the gui is their any way to show progress
would be nice if deluge did re check after the move
( actually just moved 2x torrents and it does not show in the debug ( but showed in the -u console )

ok

I just tried extracting another corrupted torrent , ark failed .. re ran force re check it downloaded a little more data .. tried extracting again .. I still have an incomplete file :@

[MasterCATZ]

3 times now i have force rechecked re downloaded exited and started deluged back up again

the data just is not being written to disk

I garantee if I come back in a few days time it will have finally written the completed data to disk ( and now it finally has after leaving it alone 12 hrs )
( switched to full allocation with sparse disabled now and will see if things clear up)

pm me and I will give you details for screen shots / log files

on another note I could not get peer injection to work using 2x diff clients on the same PC how ever I am unsure if its because the torrent files has DHT disabled flags set ?

was wanting to use qbittorrent to resume this particular file ( it also did the same thing over and over so wanted to start from scratch with full alocation )

I guess the client would be banable if it by-passed the flags for manually added peers as well ?

currently I want to do a global force recheck but the problem is they always auto re download the missing pieces so I still have no idea which ones to manually verify again via eternal program


another thing that is a little annoying is sometimes deluge will not move the files ( or update the new torrent location ) if they are already their ( ie I copied / already downloaded them to the place I am wanting to move them to ) moving via the GUI so I can keep them in the list I don't think their was an option to change torrent file location

I am currently away from the pc( @ THE IN LAWS ) remoting into it for something to do .. this is being a very slow process today




and now webgui crashed

Code: Select all

web.Server Traceback (most recent call last):

<type 'exceptions.KeyError'>: 'stats/stats.js'
/usr/local/lib/python2.7/site-packages/twisted/web/server.py, line 127 in process
125    try:
126      resrc = self.site.getResourceFor(self)
127      self.render(resrc)
128    except:
Self
site	
twisted.web.server.Site instance @ 0x80ad05248 <twisted.web.server.Site instance at 0x80ad05248>
Locals
resrc	
deluge.ui.web.server.TopLevel instance @ 0x80ace8d88 <deluge.ui.web.server.TopLevel instance at 0x80ace8d88>
self	
twisted.web.server.Request instance @ 0x80b5c3830 <GET / HTTP/1.1>
/usr/local/lib/python2.7/site-packages/twisted/web/server.py, line 147 in render
145    """
146    try:
147      body = resrc.render(self)
148    except UnsupportedMethod, e:
Locals
resrc	
deluge.ui.web.server.TopLevel instance @ 0x80ace8d88 <deluge.ui.web.server.TopLevel instance at 0x80ace8d88>
self	
twisted.web.server.Request instance @ 0x80b5c3830 <GET / HTTP/1.1>
Globals
UnsupportedMethod	<class 'twisted.web.error.UnsupportedMethod'>
/usr/local/lib/python2.7/site-packages/deluge-1.3.3-py2.7.egg/deluge/ui/web/server.py, line 570 in render
568      mode = None
569
570    scripts = component.get("Scripts").get_scripts(mode)
571    scripts.insert(0, "gettext.js")
Locals
mode	None
Globals
gettext	<module 'gettext' from '/usr/local/lib/python2.7/gettext.pyc'>
component	<module 'deluge.component' from '/usr/local/lib/python2.7/site-packages/deluge-1.3.3-py2.7.egg/deluge/component.pyc'>
/usr/local/lib/python2.7/site-packages/deluge-1.3.3-py2.7.egg/deluge/ui/web/server.py, line 375 in get_scripts
373
374    for path in _order:
375      filepath = _scripts[path]
376
Locals
path	'stats/stats.js'
_order	
List instance @ 0x80ace8dd0
'ext-base.js'
'ext-all.js'
'ext-extensions.js'
'deluge-all.js'
'stats/stats.js'
'label/label.js'
'scheduler/scheduler.js'
'pieces/pieces.js'
'stats/stats.js'
'label/label.js'
'scheduler/scheduler.js'
'pieces/pieces.js'
'stats/stats.js'
'label/label.js'
'scheduler/scheduler.js'
'pieces/pieces.js'
filepath	'/usr/local/lib/python2.7/site-packages/deluge-1.3.3-py2.7.egg/deluge/ui/web/js/deluge-all.js'
_scripts	
Dictionary instance @ 0x80b7fb160
'ext-extensions.js'	'/usr/local/lib/python2.7/site-packages/deluge-1.3.3-py2.7.egg/deluge/ui/web/js/ext-extensions.js'
'deluge-all.js'	'/usr/local/lib/python2.7/site-packages/deluge-1.3.3-py2.7.egg/deluge/ui/web/js/deluge-all.js'
'ext-base.js'	'/usr/local/lib/python2.7/site-packages/deluge-1.3.3-py2.7.egg/deluge/ui/web/js/ext-base.js'
'ext-all.js'	'/usr/local/lib/python2.7/site-packages/deluge-1.3.3-py2.7.egg/deluge/ui/web/js/ext-all.js'

<type 'exceptions.KeyError'>: 'stats/stats.js'

[lwr]

And I've find out other "missing after restarting" problem. Actually it has happened before, but just now found this relations.


If I exit deluge normally (by closing it manually) everything's fine. But if I shutdown system while deluge and other progrs are running, then on restart most of completed torrents appears in 0% state and need recheck to continue seeding\downloading.
Though in 1.3.4 version it's mutated: completed torrents are rechecking just in seconds, but for incomplete active downloads it takes long full recheck process.


Guess it's windows-only problem, but I didn't check it on ubuntu with large number of downloads.