My .torrents are messing up my download folder

[Iwi]

When I view my download folder at /home/username/downloads (something like that), I see a lot of .torrent files like this deluge_123456_torrent_name. I don't need these torrent files, and I would like them in another directory or just hidden.

My settings are as follows:

Store all downloads in: Downloads.
Store all torrent files in: torrentfiles.
Autoload all torrent files in: Torrent-files-only.

I use the latest non beta/RC Deluge in Ubuntu 8.04. I use the WebUI to add, and delete torrents. When I delete torrents through the webui (including the .torrent), the actual .torrent is not deleted most of the times. Therefore I have a really messy download folder because of a lot of .torrent files I don't need. It is also somewhat hard to delete them because since I can't type by the name to find the .torrent as the name starts with deluge_.

Why is this happening? How can I fix it?