So many fragmentation in my system

[reynolddjmax]

Hi ， everyone
My system Ubuntu 10.04
Disk 1T

This problems because I add so many large torrent in Deluge(4G~200G) , I used seedbox when I start 1 torrent,the upload speed keep good speed in 10MB/S . But when I start other torrent task Upload

speed reduced to 2~3MB/s. So I check out my server over and over again.Finally I use defrags to check my disk file,,


-----------------------------------------------------------------------
root@server:~# perl defragfs /home -f

Statistics for /home

Total Files: 2270
Total Fragmented Files: 681
Total Fragments: 1145879
Fragments per Fragmented File: 1682.64170337739

File Fragmentation Rate: 30 %
Avg File Fragments (1 is best): 505.792511013216

Most Fragmented Files(for details see /tmp/frags-result):

/home/deluge/download/.../00011.m2ts: 126458 extents found, perfection would be 1 extent
/home/deluge/download/.../00011.m2ts: 89699 extents found, perfection would be 1 extent
/home/deluge/download/.../00009.m2ts: 68062 extents found, perfection would be 1 extent
/home/deluge/download/.../00000.m2ts: 56355 extents found, perfection would be 1 extent
/home/deluge/download/.../00004.m2ts: 43150 extents found, perfection would be 1 extent
/home/deluge/download/.../00003.m2ts: 41412 extents found, perfection would be 1 extent
/home/deluge/download/.../00003.m2ts: 38857 extents found, perfection would be 1 extent
/home/deluge/download/..../00002.m2ts: 38502 extents found, perfection would be 1 extent
/home/deluge/download/..../00002.m2ts: 38499 extents found, perfection would be 1 extent
/home/deluge/download/.../Shakira.Live.from.Paris.2011.BluRay.1080p.DTS-HD.MA.5.1.Flac.x264-beAst.mkv: 37771 extents found, perfection would be 1 extent
/home/deluge/download/.../GK_D1/BDMV/STREAM/00004.m2ts: 35824 extents found, perfection would be 1 extent
/home/deluge/download/DragonTV.Qing.You.Ke.Yuan.20111213.HDTV.1080i.MPEG2-CHDTV.ts: 28955 extents found, perfection would be 1 extent
/home/deluge/download/.../BDMV/STREAM/00050.m2ts: 22577 extents found, perfection would be 1 extent
/home/deluge/download/.../00004.m2ts: 21962 extents found, perfection would be 1 extent
/home/deluge/download/.../STREAM/00032.m2ts: 21302 extents found, perfection would be 1 extent
/home/deluge/download/.../BDMV/STREAM/00005.m2ts: 18681 extents found, perfection would be 1 extent
/home/deluge/download/.../3???10.To.Yuma.2007.Blu-ray.x264-10bit.1080P.FLAC.Mysilu.mkv: 17884 extents found, perfection would be 1 extent
/home/deluge/download/..../STREAM/00003.m2ts: 16823 extents found, perfection would be 1 extent
/home/deluge/download/MIKUPA_TOKYO_MKPB1.iso: 12179 extents found, perfection would be 1 extent

.....and so on(681 files)
-------------------------------------------------------------------


So.. I think the reason is deluge make so many file fragmentation in my disk. It cause my upload speed reduce....

But how can I reduce file fragmentation? I used full Alloction in deluge, dose Compact Alloction can reduce fragmentation in my disk?

Or other way can solve my problem ?

I need the right answer

thx everyone

PS: I'm not good at English, Sorry

[thepace]

can you state deluge and libtorrent version and filesystem used?

[reynolddjmax]

root@server:~/.config/deluge# fdisk -l

Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0004934c

Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 96256 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2 13 262 1999872 83 Linux
Partition 2 does not end on cylinder boundary.
/dev/sda3 262 1069 6483968 82 Linux swap / Solaris
/dev/sda4 1069 121602 968179713 5 Extended
/dev/sda5 1069 1193 999424 83 Linux
/dev/sda6 1193 2412 9788416 83 Linux
/dev/sda7 2412 3631 9788416 83 Linux
/dev/sda8 3631 121602 947600384 83 Linux
root@server:~/.config/deluge# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda2 1.9G 232M 1.6G 13% /
none 4.0G 188K 4.0G 1% /dev
none 4.0G 0 4.0G 0% /dev/shm
none 4.0G 64K 4.0G 1% /var/run
none 4.0G 0 4.0G 0% /var/lock
none 4.0G 0 4.0G 0% /lib/init/rw
/dev/sda1 92M 24M 63M 28% /boot
/dev/sda8 890G 448G 397G 54% /home
/dev/sda6 9.2G 1.8G 7.0G 20% /usr
/dev/sda7 9.2G 739M 8.1G 9% /var

root@server:~/.config/deluge# cat /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 23
model name : Intel(R) Core(TM)2 Quad CPU Q8200 @ 2.33GHz
stepping : 10
cpu MHz : 2003.000
cache size : 2048 KB

root@server:~/.config/deluge# free
total used free shared buffers cached
Mem: 8227600 7977800 249800 0 127752 6989640
-/+ buffers/cache: 860408 7367192
Swap: 6483960 0 6483960





Deluge 1.3.3

I used scripe to install deluge
------------------------------------------------
#!/bin/bash

apt-get autoremove --purge mysql* -y
echo "deb http://ppa.launchpad.net/deluge-team/ppa/ubuntu jaunty main" >> /etc/apt/sources.list
echo "deb-src http://ppa.launchpad.net/deluge-team/ppa/ubuntu jaunty main" >> /etc/apt/sources.list
apt-get install python-software-properties --force-yes -y
add-apt-repository ppa:deluge-team/ppa
apt-get update -y
apt-get install vsftpd screen deluged deluge-web -y
deluged
screen -fa -d -m -S deluge-web deluge-web
sed -i '/exit 0/d' /etc/rc.local
sed -i '/deluge/d' /etc/rc.local
echo "deluged" >> /etc/rc.local
echo "screen -fa -d -m -S deluge-web deluge-web" >> /etc/rc.local
echo "exit 0" >> /etc/rc.local
-----------------------------------------------------------------

[reynolddjmax]

root@server:~# deluged --version
deluged: 1.3.3
libtorrent: 0.15.8.0

[lucskos]

Hi, I've had the same problem. There is a simple patch to force torrent full preallocation: http://forum.deluge-torrent.org/viewtopic.php?t=37349

Of course it will not defragment the already fragmented torrents but with full preallocation the kernel tries to allocate the new files in one chunk. So, defragment your volume and apply the patch to minimize further fragmentation.

[graysky]

What is your filesystem? Ext4? NTFS? XFS? Did I miss it?

[lucskos]

What is your filesystem? Ext4? NTFS? XFS? Did I miss it?

Ext4 on kernel 2.6.37.