So I uninstalled Deluge and GTK and tried installing the newest version of Deluge.
After I started Deluge 1.3.5 I noticed the skins where not working, this is not a big problem so I continued using it.
While downloading is working really well (I am getting the speeds advertised at my provider), uploading does not seem to work. I see its trying to connect to peers but it never starts uploading.
I used the same settings I used in Deluge 1.3.1 but it just does not seem to work. After this I went searching on the internet and found out it is a common problem people suggested downgrading to the 1.3.2 client. This I did and my skin started working again (yay

I read the FAQ and tried some different things mentioned but it won't help me with this problem.
Some extra information:
OS: Windows 7 x64 (SP1)
Python: 2.6
Plugins active: None while testing.
Libtorrent: version that comes with the installer of either 1.3.2 and 1.3.5
Both my incoming and outgoing port are the same and they can be reached from outside (checked this with the test button obviously).
Changing amount of maximum connections does not have any influence since it won't even reach 10 peers.
Half-open connections are set at 20.
Connection attempts per second are set at 20.
Encryption is on but not forced and is on either.
DHT is off since I use private trackers.
NAT-PMP and UPnP are off since I manually configure my router/pc.
Extra note during my futile attempts of getting 1.3.2 and 1.3.5 to work I even switched providers getting a faster modem but this all had no influence. Version 1.3.1 is happily working but the others ain't, the reason I want to get a newer version is because the old version sometimes drops my internet connection (only this pc).