Overdownloading? (revisited)

[Badseed]

I have been using deluge for about 6 months now. I' m perfectly happy with its lightness, especially the way it tiptoes through the memory, and I appreciate the hard work you're putting into making it better.

I have noticed that it might be "overdownloading", i.e. the downloaded Mbytes in a first session are more than the Mbytes actually downloaded. This is an example of it:



It's not the encryption (tried with the encryption on and off, result is the same). I have a slight suspicion that this tends to get a little worse when I'm downloading from users with Transmission and BitComet clients, but that must not be the root for it. It hasn't got to do with a specific tracker either (happens on all of them). So, it's either something in my router/system settings, or in the client. However, I've benchmarked it against Bittorrent (the default version of Ubuntu) and that client doesn't miss bytes. From the tracker stats, I see that I am one of the very few with the same problem.

The "lost" bytes usually are 5-10% of the actual download (very rarely more). I only have UPnP and NAT-PMP enabled. Running it on Ubuntu 7.10 on a 64-bit AMD system.

Other posts mentioning this are:
http://forum.deluge-torrent.org/viewtop ... &sk=t&sd=a
http://forum.deluge-torrent.org/viewtop ... f=7&t=1056
http://forum.deluge-torrent.org/viewtopic.php?f=7&t=859
http://forum.deluge-torrent.org/viewtop ... 50c2#p5153

Now this isn't fatal, neither a tragedy (I intend to continue using Deluge). However, for users on private trackers, it might be kind of a problem (more on an administrative level rather than ratio-my ratio is totally fine). It would be cool if this could get fixed, or that there could be some insight into this. Thanks in advance.

[loki]

Is it due to a few hash fails every now and then?

[johnnyg]

markybob explains it here: http://forum.deluge-torrent.org/viewtop ... sd=a#p4125

[Badseed]

markybob explains it here: http://forum.deluge-torrent.org/viewtop ... sd=a#p4125

I had settled for that explanation (bad pieces) until I downloaded the same torrent both with Deluge and immediately afterwards with BT and found that one had "leaked" the usual 10%, while the other had downloaded exactly the torrent size. I can do the same test again, but I doubt whether it was a coincidence.

@loki: I don't think so, it happens on every torrent, regardless if it gets paused-resumed, regardless of tracker etc. I have the impression that "losses" tend to be more if the completion time is longer.

These lost bytes do go down on the tracker stats. Again, they haven't prevented me from keeping my ratio healthy, but I'll always be credited this 5-10% surplus on the download size.

[RachelFaithAnderson]

I would like to chime in on this as well.

I have been downloading off of my seedbox which is very fast. I have done almost 2TB in the last 3 days. And I have seen 100% of all the files I download exceed their size and thus HURT my ratio.

A 5GB file will download 6.4 GBs. And a 12GB file 14GB. It is about 1.5 GB more for every 5GB I download. Consistently. Without any change. On every file. Dozens of them. Both Version 7 and now 9.

I think it is this bug which caused vs 7 to be banned from HD bits and I am not comforted to see it still in vs 9.

Thanks for your attention!

[moz]

Im nearly 100% sure its not bad pieces. Im using the 0.6 and it happens with it too. Nearly always it downloads an extra 10%. Ive noticed it tends to get larger with the increasing number of peers youre connecting to, so i blamed it on overhead. But now im not so sure about that. I can tell you though its not bad pieces since it reports them when run from console, and i rarely see any. Ive whined about this here(with no response) http://forum.deluge-torrent.org/viewtop ... f=7&t=4065

[RidRed]

Have to agree that it can't just be coincidence that with Azureus or Utorrent I'd only ever get 0-2% discarded waste, yet with Deluge it's regularly 5-10% and sometimes as high as 25%. I've no idea how these things work, but did wonder if there was a problem with Deluge's communication with certain other clients?

Unfortunately it's meant that for now at least, I'll be stopping using Deluge, as my ratios on private trackers are starting to suffer.

One point I would make is that I'm on Windows XP, might this problem be platform specific?

[sluthead]

No it's not platform specific

http://forum.deluge-torrent.org/viewtop ... f=7&t=4705

I started a thread on it ages ago but it didn't get picked up on.

I've gone back to Azureus , Deluge is no longer trustworthy and the bugs have far outweighed the inconvenience.