[Plugin][Extractor] Extract successful, no extracted files can be found

[Geth]

Hi,

I'm running Deluge 1.3.12 (with Extractor 0.4) on my QNAP NAS (basically a 64bit Linux) as admin (it's the closest thing to root on this firmware). Move completed is enabled and working.

About the plugin: I'm aware of some old, but solved problems (dotted filenames, move completed downloads) and another reported, but not related one (part rar naming).

Now the problem:

Code: Select all

[DEBUG   ] 13:10:48 alertmanager:123 storage_moved_alert: some.torrent.blah moved storage to: /share/Download
[DEBUG   ] 13:10:48 alertmanager:123 save_resume_data_alert: some.torrent.blah resume data generated
[DEBUG   ] 13:10:48 torrentmanager:1043 on_alert_storage_moved
[DEBUG   ] 13:10:48 rpcserver:467 intevents: {0: ['PluginDisabledEvent', 'ConfigValueChangedEvent', 'PluginEnabledEvent', 'TorrentStateChangedEvent', 'TorrentRemovedEvent', 'TorrentAddedEvent']}
[WARNING ] 13:10:48 core:145 EXTRACTOR: Can't extract file with unknown file type: some.torrent.blah/some.file.sfv
[DEBUG   ] 13:10:48 core:175 EXTRACTOR: Extracting /share/Download/some.torrent.blah/some.file.rar with unrar x -o+ -y to /share/Download
[WARNING ] 13:10:48 core:145 EXTRACTOR: Can't extract file with unknown file type: some.torrent.blah/some.file.r12
...
[INFO    ] 13:10:48 core:168 EXTRACTOR: Extract successful: /share/Download/some.torrent.blah/some.file.rar (some id)

...and the extracted stuff is nowhere to be found.
It was a few hundred megabytes download, with dotted filenames, with several parts, and when I entered the unrar command manually, it worked.

Note: another download, single .zip file (with dotted filename) with unzip command, extracted automatically and there were no problems.
unrar, unzip both operational, checked them (also when they weren't installed correctly, the log stated that fact, and now the log is clear in that aspect).

The closest thing I could find is "Extractor not working in Windows 10", with ticket #2785, but in my case it's not Windows and not 7zip.

Hope it can shed some light.

[Cas]

It could be that they are related, we'll look into it.

[Cas]

Did you have move completed enabled for the torrent? Can you try without it?

[Geth]

I use move completed, yes (example in 1st post).

I've tried right now with move completed disabled, results are the same
~1 sec extraction, extracted file is nowhere to be found.

Code: Select all

[WARNING ] 13:58:57 core:145 EXTRACTOR: Can't extract file with unknown file type: blah.folder/blah.file.r00
[DEBUG   ] 13:58:57 core:175 EXTRACTOR: Extracting /share/Download/blah.folder/blah.file.rar with unrar x -o+ -y to /share/Download
[DEBUG   ] 13:58:57 torrentmanager:1086 on_alert_state_changed
[DEBUG   ] 13:58:57 torrent:384 set_state_based_on_ltstate: Seeding
[DEBUG   ] 13:58:57 torrent:385 session.is_paused: False
[DEBUG   ] 13:58:57 torrentmanager:1014 on_alert_tracker_announce
[INFO    ] 13:58:57 core:168 EXTRACTOR: Extract successful: /share/Download/blah.folder/blah.file.rar (be5c4f18ca403af20a7d6b1f15f7de66f2fea565)

[Cas]

Attached is an updated build that will output any errors from unrar, it might give more clues on what is actually happening.

[wilson]

I was directed to this updated version of Extractor and have installed it, unfortunately I'm getting the same results. Log says "Extract successful" but there is no file to be found. The updated version doesn't seem to have any additional insight in the logs as to what is happening.

Code: Select all

[DEBUG   ] 19:59:10 core:175 EXTRACTOR: Extracting /Volumes/Media SSD/Deluge/Secret.Lives.of.the.Super.Rich.S05E05.A.Subterranean.Mega-Mansion.and.The.200M.Joy.Ride.HDTV.x264-CRiMSON/secret.lives.of.the.super.rich.s05e05.a.subterranean.mega-mansion.and.the.200m.joy.ride.hdtv.x264-crimson.rar with unrar x -o+ -y to /Volumes/Media SSD/CompletedTVShows

[INFO    ] 19:59:10 core:168 EXTRACTOR: Extract successful: /Volumes/Media SSD/Deluge/Secret.Lives.of.the.Super.Rich.S05E05.A.Subterranean.Mega-Mansion.and.The.200M.Joy.Ride.HDTV.x264-CRiMSON/secret.lives.of.the.super.rich.s05e05.a.subterranean.mega-mansion.and.the.200m.joy.ride.hdtv.x264-crimson.rar (c140ec68b3376b76dc713eaab7ed4ae548f00429)

I appreciate your efforts.

[Cas]

That doesn't look like the newer version of plugin is being used.

[Geth]

I've also tried out the attached one:

Code: Select all

[DEBUG   ] 14:21:08 pluginmanagerbase:124 Found plugin: Extractor 0.5a0 at /share/CACHEDEV1_DATA/.qpkg/Entware-ng/lib/python2.7/site-packages/deluge/plugins/Extractor-0.5a0-py2.7.egg
...
[DEBUG   ] 14:24:07 torrentmanager:1043 on_alert_storage_moved
...
[DEBUG   ] 14:24:07 core:147 EXTRACTOR: Can't extract file with unknown file type: blah.torrent.folder/blah.compressed.r09
[DEBUG   ] 14:24:07 core:171 EXTRACTOR: Extracting /share/Download/blah.torrent.folder/blah.compressed.rar from 55ef745e80506e3723e24874ac1f3fedf3826d35 with unrar x -o+ -y to /share/Download
...
[INFO    ] 14:24:07 core:166 EXTRACTOR: Extract successful: /share/Download/blah.torrent.folder/blah.compressed.rar (55ef745e80506e3723e24874ac1f3fedf3826d35)

Unfortunately, I'm too not seeing anything additional compared to previous examples.

[Cas]

Running that exact unrar from terminal extracts fine?

[Geth]

Yep, substituting the word "to" with path from same log line:

Code: Select all

[~] # unrar x -o+ -y /share/Download/blah.torrent.folder/blah.compressed.rar /share/Download

UNRAR 5.31 freeware      Copyright (c) 1993-2016 Alexander Roshal

Extracting from /share/Download/blah.torrent.folder/blah.compressed.rar

Extracting  /share/Download/blah.xyz                9%
...
...         blah.xyz                               OK 
All OK

EDIT: Now that I'm looking at the source, what I've tested in command line is not exactly the same thing.
I've added the output path as the last argument, but plugin is passing it as "the path to run the subprocess in", and doesn't add it as argument...

EDIT2: Okay, that should not cause problems. Also, if passing empty environment has anything to do with it, it should mess up "unzip" too.

EDIT3:

Code: Select all

[~] # which unrar
/opt/bin/unrar
[~] # which unzip
/opt/bin/unzip
[~] # find / -name unzip
/share/CACHEDEV1_DATA/.qpkg/Entware-ng/bin/unzip
find: File system loop detected; ‘/share/CACHEDEV1_DATA/.qpkg/HD_Station/share/CACHEDEV1_DATA’ is part of the same file system loop as ‘/share/CACHEDEV1_DATA’.
/usr/local/sbin/unzip
/usr/bin/unzip
[~] # find / -name unrar
/share/CACHEDEV1_DATA/.qpkg/Entware-ng/bin/unrar
find: File system loop detected; ‘/share/CACHEDEV1_DATA/.qpkg/HD_Station/share/CACHEDEV1_DATA’ is part of the same file system loop as ‘/share/CACHEDEV1_DATA’.
/usr/local/sbin/unrar

Do you see the difference? Maybe passing empty environment breaks unrar, but does not break unzip (two are installed slightly differently).