[Plugin] FlexGet - RSS Solution (Deluge 1.1 and 1.2+)

[existsec]

Turns out there was a bug that would cause flexget to hang if you had more than one feed that downloaded a torrent on the same run. (with deluge 1.2) (Melior, existsec, and bjeanes' problem) This problem should be fixed now, let me know if I caused any others.

I saved a few torrents to test when you got the new build out. Looks good so far. Not seeing anything strange in --debug and the torrents appear to add just fine. Thanks for the quick work.

[thewanderer]

Hi,

I've installed FlexGet-1.0r963-py2.6.egg on a fresh install of Ubuntu Karmic and it looks it like installed successfully. However, when I run "flexget --test" on the sample script I get the following error:

"Configuration file 'config' doesn't have a initialized database.
Add --initdb parameter once to verify that you mean to start a new database.

If you're old user and didn't expect this, see bleeding edge news"

Adding --initdb to the top of the script returns this:

" -------------------------------------------------------------------------------
Malformed configuration file, common reasons:
-------------------------------------------------------------------------------

o Indentation error
o Missing : from end of the line
o Non ASCII characters (use UTF8)
o If text contains any of :[]{}% characters it must be single-quoted ('')

Reason: mapping values are not allowed here

Check configuration near line 1, column 5

Fault is almost always in this line or previous"

The Python version (by typing python -V) returns Python 2.6.4rc2

I'm not sure whether it's related but the instructions on http://flexget.com/wiki/InstallWizard/L ... nt/FlexGet say you can simply run easy_install ~/tmp/FlexGet-1.0r963-py2.5.egg but that failed with a permission problem. Using sudo easy_install....... ran through without issue tho.

I've tried a few of the other sample scripts knocking around but get the same error.

Does anyone have any ideas on what's up?

Many thanks in anticipation.

EDIT:
Here's the output from the easy_install if it helps...............

Code: Select all

sudo easy_install FlexGet-1.0r963-py2.6.egg



Processing FlexGet-1.0r963-py2.6.egg
creating /usr/local/lib/python2.6/dist-packages/FlexGet-1.0r963-py2.6.egg
Extracting FlexGet-1.0r963-py2.6.egg to /usr/local/lib/python2.6/dist-packages
Adding FlexGet 1.0r963 to easy-install.pth file
Installing flexget script to /usr/local/bin

Installed /usr/local/lib/python2.6/dist-packages/FlexGet-1.0r963-py2.6.egg
Processing dependencies for FlexGet==1.0r963
Searching for pynzb
Reading http://pypi.python.org/simple/pynzb/
Reading http://github.com/ericflo/pynzb/tree/master
Best match: pynzb 0.1.0
Downloading http://pypi.python.org/packages/source/p/pynzb/pynzb-0.1.0.tar.gz#md5=63c74a36348ac28aa99732dcb8be8c59
Processing pynzb-0.1.0.tar.gz
Running pynzb-0.1.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-5QZ1G6/pynzb-0.1.0/egg-dist-tmp-B0JzoT
Adding pynzb 0.1.0 to easy-install.pth file

Installed /usr/local/lib/python2.6/dist-packages/pynzb-0.1.0-py2.6.egg
Searching for PyRSS2Gen
Reading http://pypi.python.org/simple/PyRSS2Gen/
Reading http://www.dalkescientific.com/Python/PyRSS2Gen.html
Best match: PyRSS2Gen 1.0.0
Downloading http://www.dalkescientific.com/Python/PyRSS2Gen-1.0.0.tar.gz
Processing PyRSS2Gen-1.0.0.tar.gz
Running PyRSS2Gen-1.0.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-_TgMPk/PyRSS2Gen-1.0.0/egg-dist-tmp-PI0Cxf
zip_safe flag not set; analyzing archive contents...
Adding PyRSS2Gen 1.0.0 to easy-install.pth file

Installed /usr/local/lib/python2.6/dist-packages/PyRSS2Gen-1.0.0-py2.6.egg
Searching for pygooglechart
Reading http://pypi.python.org/simple/pygooglechart/
Reading http://pygooglechart.slowchop.com/
Best match: pygooglechart 0.2.1
Downloading http://pygooglechart.slowchop.com/files/download/pygooglechart-0.2.1.zip
Processing pygooglechart-0.2.1.zip
Running pygooglechart-0.2.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-3BK1Ub/pygooglechart-0.2.1/egg-dist-tmp-uq5CT2
zip_safe flag not set; analyzing archive contents...
Adding pygooglechart 0.2.1 to easy-install.pth file

Installed /usr/local/lib/python2.6/dist-packages/pygooglechart-0.2.1-py2.6.egg
Searching for html5lib>=0.11
Reading http://pypi.python.org/simple/html5lib/
Reading http://code.google.com/p/html5lib/
Best match: html5lib 0.11.1
Downloading http://html5lib.googlecode.com/files/html5lib-0.11.1.zip
Processing html5lib-0.11.1.zip
Running html5lib-0.11.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-k06iRN/html5lib-0.11.1/egg-dist-tmp-JjNODu
zip_safe flag not set; analyzing archive contents...
Adding html5lib 0.11.1 to easy-install.pth file

Installed /usr/local/lib/python2.6/dist-packages/html5lib-0.11.1-py2.6.egg
Searching for BeautifulSoup
Reading http://pypi.python.org/simple/BeautifulSoup/
Reading http://www.crummy.com/software/BeautifulSoup/
Reading http://www.crummy.com/software/BeautifulSoup/download/
Best match: BeautifulSoup 3.1.0.1
Downloading http://www.crummy.com/software/BeautifulSoup/download/BeautifulSoup-3.1.0.1.tar.gz
Processing BeautifulSoup-3.1.0.1.tar.gz
Running BeautifulSoup-3.1.0.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-MerbP1/BeautifulSoup-3.1.0.1/egg-dist-tmp-NY5AdI
zip_safe flag not set; analyzing archive contents...
/usr/lib/python2.6/dist-packages/setuptools/command/bdist_egg.py:422: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
  symbols = dict.fromkeys(iter_symbols(code))
Adding BeautifulSoup 3.1.0.1 to easy-install.pth file
Installing testall.sh script to /usr/local/bin
Installing to3.sh script to /usr/local/bin

Installed /usr/local/lib/python2.6/dist-packages/BeautifulSoup-3.1.0.1-py2.6.egg
Searching for PyYAML
Reading http://pypi.python.org/simple/PyYAML/
Reading http://pyyaml.org/wiki/PyYAML
Best match: PyYAML 3.09
Downloading http://pyyaml.org/download/pyyaml/PyYAML-3.09.zip
Processing PyYAML-3.09.zip
Running PyYAML-3.09/setup.py -q bdist_egg --dist-dir /tmp/easy_install-eEwKYg/PyYAML-3.09/egg-dist-tmp-yMmjdk
unable to execute gcc: No such file or directory

libyaml is not found or a compiler error: forcing --without-libyaml
(if libyaml is installed correctly, you may need to
 specify the option --include-dirs or uncomment and
 modify the parameter include_dirs in setup.cfg)
zip_safe flag not set; analyzing archive contents...
Adding PyYAML 3.09 to easy-install.pth file

Installed /usr/local/lib/python2.6/dist-packages/PyYAML-3.09-py2.6-linux-i686.egg
Searching for SQLAlchemy>0.5
Reading http://pypi.python.org/simple/SQLAlchemy/
Reading http://www.sqlalchemy.org
Best match: SQLAlchemy 0.5.6
Downloading http://pypi.python.org/packages/source/S/SQLAlchemy/SQLAlchemy-0.5.6.tar.gz#md5=65c6d2007969bf5d70307afc65687391
Processing SQLAlchemy-0.5.6.tar.gz
Running SQLAlchemy-0.5.6/setup.py -q bdist_egg --dist-dir /tmp/easy_install-SjBtPk/SQLAlchemy-0.5.6/egg-dist-tmp-kKlsky
no previously-included directories found matching 'doc/build/output'
zip_safe flag not set; analyzing archive contents...
sqlalchemy.databases.mysql: module MAY be using inspect.stack
sqlalchemy.test.orm: module MAY be using inspect.getframeinfo
sqlalchemy.test.orm: module MAY be using inspect.stack
Adding SQLAlchemy 0.5.6 to easy-install.pth file

Installed /usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.5.6-py2.6.egg
Searching for FeedParser
Reading http://pypi.python.org/simple/FeedParser/
Best match: feedparser 4.1
Downloading http://pypi.python.org/packages/source/F/FeedParser/feedparser-4.1.tar.gz#md5=573a8df4d4305b37107040654f52b826
Processing feedparser-4.1.tar.gz
Running feedparser-4.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-RT6F9c/feedparser-4.1/egg-dist-tmp-GdVE6T
zip_safe flag not set; analyzing archive contents...
Adding feedparser 4.1 to easy-install.pth file

Installed /usr/local/lib/python2.6/dist-packages/feedparser-4.1-py2.6.egg
Finished processing dependencies for FlexGet==1.0r963

And I'm using this script in my config.yml file

Code: Select all

feeds:
  tv-shows:
    rss: http://example.com/rss.xml
    series:
      - chuck
      - south park
    download: ~/torrents/

[gazpachoking]

@thewanderer: Hmm, it seems like it just doesn't like your config file... Not sure why that would be, it looks alright to me. See if anyone on #flexget at freenode can help.

[thewanderer]

@thewanderer: Hmm, it seems like it just doesn't like your config file... Not sure why that would be, it looks alright to me. See if anyone on #flexget at freenode can help.

Thanks for the reply.

I copy 'n' pasted the config file from the flexget documentation. All the other config files I've copy 'n' pasted yielded the same errors (even "real" ones supplied by users on other forums). I've also tried manually typing the commands in myself but still no joy.

I'll try over at freenode as suggested.

Thanks.

[thewanderer]

@thewanderer: Hmm, it seems like it just doesn't like your config file... Not sure why that would be, it looks alright to me. See if anyone on #flexget at freenode can help.

gazpachoking, thanks very much for the pointer. A very helpful chap called Melior on freenode helped me get to the bottom of the problem. I was using vim to create the config file. Deleted it and created another one using nano instead and it worked just fine.

No idea what vim was doing to the config file but I can live with not knowing

[hordak]

Since there is no development on FlexRSS for Deluge 1.2, I thought that I would give FlexGet a shot.

I am a Windows XP Pro V3 32 bit user.

1. Installed python-2.6.4.msi
2. Installed setuptools-0.6c11.win32-py2.6.exe
3. Installed pygobject-2.14.2-1.win32-py2.6.exe
4. Installed pyxdg-0.17.win32-py2.5.msi (Could not find a msi for py2.6 and not sure how to install pyxdg-0.18.tar.gz)
5. Installed FlexGet-1.0r1028-py2.6.egg

This is the error I get when I run the following:

[/code]C:\Python26\Scripts>flexget.exe -v
Traceback (most recent call last):
File "C:\Python26\Scripts\flexget-script.py", line 5, in <module>
from pkg_resources import load_entry_point
File "c:\python26\lib\site-packages\pkg_resources.py", line 2603, in <module
working_set.require(__requires__)
File "c:\python26\lib\site-packages\pkg_resources.py", line 666, in require
needed = self.resolve(parse_requirements(requirements))
File "c:\python26\lib\site-packages\pkg_resources.py", line 565, in resolve
raise DistributionNotFound(req) # XXX put more info here
pkg_resources.DistributionNotFound: pynzb[/code]

Any help would be appreciated.

[gazpachoking]

pkg_resources.DistributionNotFound: pynzb

I seem to recall an error like that when I accidentally downloaded the flexget python 2.5 egg. Is it possible you did that?

[hordak]

I was finally able to install this plugin in windows XP SP3 32 bit.

There are some significant differences with the procedure listed on the flexget webpage.

1. Install python-2.6.4.msi
2. Install setuptools-0.6c11.win32-py2.6.exe
3. Install pygobject-2.14.2-1.win32-py2.6.exe
4. Install FlexGet-1.0r1028-py2.6.egg
5. Install feedparser-4.1

I could not get config.yml to load from c:\documents and settings\hordak\.flexget\config.yml

To run this plugin: >>c:\program files\flexget\flexget\flexget.py -c c:\.flexget\config.yml

I still can not get flexget to recognize ascii, link, or deluge syntax in config.yml.

I also can not get it to download torrents. It will find the torrents, but I get errors like error 404 and Unable to figure proper filename / extension for <file>, using title.

It did not like output_deluge.py referenced on page 1, since it was looking for deluge.ui.client.

[gazpachoking]

I could not get config.yml to load from c:\documents and settings\hordak\.flexget\config.yml
To run this plugin: >>c:\program files\flexget\flexget\flexget.py -c c:\.flexget\config.yml

Not sure, picks mine up fine from there. I just run 'flexget'

I still can not get flexget to recognize ascii, link, or deluge syntax in config.yml.

Not sure what you mean, probably a configuration error, try reading the plugin docs, and checking out the examples in the cookbook.

I also can not get it to download torrents. It will find the torrents, but I get errors like error 404 and Unable to figure proper filename / extension for <file>, using title.

Sounds like an issue with your feed, or config. Post your config here, or in #flexget and see if somebody can help you work it out.

It did not like output_deluge.py referenced on page 1, since it was looking for deluge.ui.client.

I don't know what you mean by this, deluge plugin is included in flexget. The deluge installer for windows does not install deluge to your python site-packages, so you will have to copy it there manually for your python programs to be able to import it. You can copy the egg from the deluge install path to site-packages, or run easy_install on it to install it to the system.

[hordak]

Not sure what I have done at this point. I have tried a number of methods to get this resolved including going to Deluge 1.2.

I also tried to install Deluge as a plug as suggested.

config.yml

Code: Select all

feeds:
  thebox:
    rss: http://www.thebox.bz/rssdd.xml
    series:
      - the xtra factor
    deluge: yes

C:\Python26\Scripts>flexget -v
2009-12-16 20:22 CRITICAL deluge thebox Deluge module required.
2009-12-16 20:22 INFO feed thebox Aborting feed (plugin: del
uge)

Is there a link rewrite in FlexGet, like FlexRSS?

For this particular feed in FlexRSS, I had to link rewrite the < > character with <.*> in FlexRSS due to it not having a well formed XML.