Error while downloading files

[Luthing]

Hello all,

First, as a really pure french, excuse me for my bad english

I was running Transmission for one week 24h-24h without any issue ; not satisfied by the functionnalities proposed and the dirty WebUI, I decided to change to Deluge and I installed it from scratch on a Debian Jessie 8.6 up to date.


My network topology is built as follows :


__________________________________WAN
___________________________________^
___________________________________|
___________________________________|
DelugeDaemonSrv <----> DMZint <-------> FW <----------> LANint <-------> OpenMediaVault

I openned all rules in my FW and all my traffic from DelugeDaemonSrv is flagged as passed.



The DelugeDaemonSrv saves downloading files to a drive mounted on OpenMediaVault behind LAN subnet, and shared via NFS with all adequate user permissions.
I mounted 2 drives, one on a BTRFS fs and the other with EXT4 fs.


My problem is :

While I am downloading a new file, it stops to download after several seconds/minutes (random) and displays the following error:
"File status: input/output error"

I must resume download each 5 minutes to complete a download, that is very annoying.



These are log messages from deluge daemon :

/logs/delugedlog-debug.txt

Code: Select all

[DEBUG   ] 07:22:58 torrent:381 set_state_based_on_ltstate: Downloading
[DEBUG   ] 07:22:58 torrent:382 session.is_paused: False
[DEBUG   ] 07:22:58 alertmanager:123 save_resume_data_alert: Adobe After Effects CC 2017 x64 resume data generated
[DEBUG   ] 07:22:58 torrentmanager:1080 on_alert_save_resume_data
[DEBUG   ] 07:22:58 torrentmanager:747 Opening torrents fastresume file for load.
[DEBUG   ] 07:22:58 torrentmanager:788 Saving fastresume file: /var/lib/deluge/.config/deluge/state/torrents.fastresume
[DEBUG   ] 07:23:05 alertmanager:123 performance_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK-: performance warning: max outstanding disk writes reached
[DEBUG   ] 07:23:16 alertmanager:123 performance_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK-: performance warning: max outstanding disk writes reached
[DEBUG   ] 07:23:27 alertmanager:123 performance_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK-: performance warning: max outstanding disk writes reached
[DEBUG   ] 07:23:36 alertmanager:123 torrent_error_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- ERROR: Erreur d'entrée/sortie
[DEBUG   ] 07:23:36 alertmanager:123 tracker_announce_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- (http://t411.download/a1b186854288ad7c58f6120aa0ccfccc/announce) sending a$
[DEBUG   ] 07:23:36 alertmanager:123 file_error_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- file (/media/Data2/Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK-/Game.of.Thron$
[DEBUG   ] 07:23:36 alertmanager:123 torrent_error_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- ERROR: Erreur d'entrée/sortie
[DEBUG   ] 07:23:36 alertmanager:123 file_error_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- file (/media/Data2/Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK-/Game.of.Thron$
[DEBUG   ] 07:23:36 alertmanager:123 torrent_error_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- ERROR: Erreur d'entrée/sortie
[DEBUG   ] 07:23:36 alertmanager:123 file_error_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- file (/media/Data2/Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK-/Game.of.Thron$
[DEBUG   ] 07:23:36 alertmanager:123 torrent_error_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- ERROR: Erreur d'entrée/sortie
[DEBUG   ] 07:23:36 alertmanager:123 file_error_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK- file (/media/Data2/Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK-/Game.of.Thron$

And my download stops after several minutes...


I thought it was related to and harddrive/FS problem, but I tried with another drive, formatted with a different filesystem, and the problem is still there...
My NFS drives are mounted via /etc/fstab and my DelugeDaemonSrv. This is the config :

Code: Select all

#DATA2
10.33.100.1:/Data2      /media/Data2    nfs     soft,timeo=5,intr,rsize=8192,wsize=8192 0       0

#DATA3
10.33.100.1:/Data3      /media/Data3    nfs     soft,timeo=5,intr,rsize=8192,wsize=8192 0       0

And these are my cache settings in Deluge :

deluge-settings-20161109.jpg (33.11 KiB) Viewed 13944 times

I am a little bit confused now, and I don't see where the problem could result...
I hope you can help me resolving this issue, and I appreciate all of your replies.

Thank you

[shamael]

Bonjour Luthing et bienvenu.

What's your version of Deluge and libtorrent? To get the bind version of libtorrent you can type

Code: Select all

python -c "import libtorrent; print libtorrent.version"

[Luthing]

Merci de l'accueil!

Are you french or disapointed american by last night and you planned to move to France ? ahah

The output you asked :

Code: Select all

root@jamesford:/home/luthing# python -c "import libtorrent; print libtorrent.version"
0.16.18.0

Meanwhile, thanks for your reply

[shamael]

Belgian, but still disappointed :p

This is the actual Debian repo libtorrent version, so I guess the daemon version is from the same source and not the last one 1.3.13
The same kind of issue was reported for the libtorrent library in the past.

Do you have the possibility to try a D/l on the local server file system to validate it works without network storage?

I advise you anyway to update to Deluge 1.3.13 and libtorrent 1.0.9 (my setup) or 1.0.10 (tested by another member).
The wiki contains instruction to compile from source or PPA repo

[Luthing]

I updated my libtorrent version, I am now running the 1.0.10.0 version :

Code: Select all

root@jamesford:~$ python -c "import libtorrent; print libtorrent.version"
1.0.10.0

Although, I had a new error while I was downloading a file...

I still have some Warnings in the log file :

Code: Select all

[DEBUG   ] 15:21:05 torrentmanager:1080 on_alert_save_resume_data
[DEBUG   ] 15:21:05 torrentmanager:747 Opening torrents fastresume file for load.
[DEBUG   ] 15:21:05 torrentmanager:788 Saving fastresume file: /var/lib/deluge/.config/deluge/state/torrents.fastresume
[DEBUG   ] 15:21:06 alertmanager:123 save_resume_data_alert: Adobe Illustrator CC 2017 21.0 x64 resume data generated
[DEBUG   ] 15:21:06 alertmanager:123 performance_alert: Adobe After Effects CC 2017 x64: performance warning: max outstanding disk writes reached
[DEBUG   ] 15:21:06 torrentmanager:1080 on_alert_save_resume_data
[DEBUG   ] 15:21:13 torrentmanager:707 Saving torrent state file.
[DEBUG   ] 15:21:21 alertmanager:123 performance_alert: Game.of.Thrones.S06.BluRay.MULTI.x265-JOYSTICK-: performance warning: max outstanding disk writes reached
[DEBUG   ] 15:21:32 alertmanager:123 performance_alert: Bastille.Day.2016.French.mHD.720p.x264.AC3-JOKPIC: performance warning: max outstanding disk writes reached
[DEBUG   ] 15:21:42 alertmanager:123 performance_alert: Adobe After Effects CC 2017 x64: performance warning: max outstanding disk writes reached
[DEBUG   ] 15:21:52 alertmanager:123 performance_alert: Adobe After Effects CC 2017 x64: performance warning: max outstanding disk writes reached

I still also have huge picks of speed download : the speed swings between 1Mbps to 15 Mbps.

Do you have the possibility to try a D/l on the local server file system to validate it works without network storage?

Yes, my download finished without error, but I have the same Warnings in the log file :

[DEBUG ] 15:29:13 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:13 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding disk writes reached
[DEBUG ] 15:29:14 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:15 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:17 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:18 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:23 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding disk writes reached
[DEBUG ] 15:29:27 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:28 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:29 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:29 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:30 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:30 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:31 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:32 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:32 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:33 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:33 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding disk writes reached
[DEBUG ] 15:29:34 alertmanager:123 performance_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: performance warning: max outstanding piece requests reached
[DEBUG ] 15:29:41 alertmanager:123 state_changed_alert: 10 Cloverfield Lane (2016) MULTi [1080p] BluRay x264-PopHD: state changed to: finished

Do you have another idea ... :p ?

[shamael]

Deluge is the 1.3.13? not yet confirmed.

About the speed change, I guess there is enough seeders. Is the server a low power one? (ARM, cpu, ram, etc?)? The wait value in top may indicate it or better an iostat.

I face some issue in the current version when I restart my daemon, so not happily doing it and my log level is not the same as you (warning). Not sure I can change the log level on the fly (-L parameter)

no proxy configured? what's Deluge cache configuration (size)

[Luthing]

I downloaded it from debian repo so I think yes, but how can I check this?

It's a VM on ESXi 6, I already tried to add RAM/CPU, nothing new...

I changed the log level directly on the /etc/init.d/deluge-daemon script :

DAEMON1=/usr/bin/deluged
DAEMON1_ARGS="-d -L debug -l /media/Data2/Torrents/logs/delugedlog-debug.txt" # Consult `man deluged` for more options
DAEMON2=/usr/bin/deluge-web
DAEMON2_ARGS="-L debug -l /media/Data2/Torrents/logs/deluge-web-log-debug.txt" # Consult `man deluge-web` for more options

(EDIT : I followed this tutorial for installing deluge https://constantsandvariables.space/lin ... -1-jessie/ )

No proxy configured, and I changed the cache configuration to 8192 Kb size and 60 seconds (default)


So... I think I will reinstall Transmission from scratch... Unfortunately

[shamael]

check with

Code: Select all

deluge -v

CPU and RAM is not ans issue if your settings don't overload resources.

Code: Select all

Top

gives the overview and

Code: Select all

iostat -x 1

shows details about the wait value.

Are the vmtools installed?

No need to change in my opinion so far but it's up to you. Depending of the speed of your disk (and vmtools install) the cahce may influate the d/l speed. Can you reduce it to 2048 for test? With the 16KB blocs rule it means 32MB caching, reducing the pressure when write to disk occurs.

I'm running my setup on a RPI3, 8-9MB/s download speed constantly (100Mbits interface). So with a real server it should no hurt with last software version. The compilation instruction are in the wiki too

[Luthing]

Uh... It seems that libtorrent hasn't been updated for deluge :

Code: Select all

root@jamesford:~# deluge -v
deluge: 1.3.10
libtorrent: 0.16.18.0

And deluge isn't up to date, I tried to update it from source (http://dev.deluge-torrent.org/wiki/Installing/Source) but deluge package didn't installed.

I would like to have a proper deluge install, how can I install deluge 1.3.13 with libtorrent 1.0.10.0 correctly?


VMTools aren't installed, I am doing it now I keep you informed

I'm running my setup on a RPI3, 8-9MB/s download speed constantly (100Mbits interface). So with a real server it should no hurt with last software version. The compilation instruction are in the wiki too

Well you're running deluge to download filed and saved them on a local disk ? With my topology, I am a little bit worried for saving data on NFS mounted drive, this looks like a software issue like deluge isn't optimized for recording data on networking...

[shamael]

not binded, and maybe not supported by this Deluge version.

check the wiki, the compile from source is explained step by step for Deluge and Libtorrent.

Vmtools mandatory for the correct storage/NIC driver, can make a difference too.

I've read many post with such a setup and I don't think it's a problem. My setup is RPI+USB storage but I downloaded on network location too in my first setup w/o noticing anything weird. Underlying it would link a network problem more with libtorrent/network mount & buffer than on Deluge itself.