B-RAD » WDTV Optware tips http://b-rad.cc bit of this, byte of that Sat, 03 Sep 2011 16:19:14 +0000 en hourly 1 http://wordpress.org/?v=3.2.1 WDTV Optware tips #5: wtorrent – webgui for rtorrent http://b-rad.cc/687/wdtv-optware-tips-wtorrent-webgui-for-rtorrent/ http://b-rad.cc/687/wdtv-optware-tips-wtorrent-webgui-for-rtorrent/#comments Thu, 09 Apr 2009 08:23:30 +0000 b-rad http://b-rad.cc/?p=687 W T O R R E N T
D
T
V

Yes, I’ve finally gotten around to part 3 of 3 in my rtorrent with wtorrent tutorial. Wtorrent is an excellent webui for rtorrent and after this tutorial you’ll be able to manage rtorrent from the web…forward a port and you can even connect to your wdtv from the internet to queue up torrents!

In order to take advantage of this tutorial you must either be running WDLXTV or Zoranders ext3-boot. You must also have my Optware for WDTV package installed, that stuff is covered elsewhere. I’ll be including every necessary step here, so you might be able to skip around if you already have some of this done.

This writeup presumes that you have already executed the steps from part 1 and part 2. If you haven’t done them yet, then get over and complete them first!


First ssh/telnet into your WDTV, then update your Optware feed and download the latest wtorrent.

$ ssh root@wdtv-01

BusyBox v1.10.0 (2009-02-15 05:09:42 CST) built-in shell (msh)
Enter 'help' for a list of built-in commands.

# ipkg update
Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//Packages.gz
Inflating http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//Packages.gz
Updated list of available packages in /opt/lib/ipkg/lists/wdtv
Successfully terminated.
#
# cd /tmp
#
# wget 'http://www.wtorrent-project.org/trac/changeset/latest/trunk/?old_path=%2F&format=zip' -O wtorrent-current.zip
--2009-04-08 07:11:41-- http://www.wtorrent-project.org/trac/changeset/latest/trunk/?old_path=%2F&format=zip
Resolving www.wtorrent-project.org... 38.103.173.70
Connecting to www.wtorrent-project.org|38.103.173.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 453058 (442K) [application/zip]
Saving to: `wtorrent-current.zip'

100%[======================================>] 453,058 771K/s in 0.6s

2009-04-08 07:11:43 (371 KB/s) - `wtorrent-current.zip' saved [453058/453058]

Now that we have the latest version, lets unzip it to our web server location and do a bit of file maintenance to get things in working order.

# unzip wtorrent-current.zip -d /opt/share/www/
inflating: trunk/wtorrent/torrents/.htaccess
inflating: trunk/wtorrent/cls/torrent.cls.php
inflating: trunk/wtorrent/cls/rtorrent.cls.php
...
...
...
inflating: trunk/wtorrent/wt/js/ajax.js
inflating: trunk/wtorrent/install.php
inflating: trunk/wtorrent/index.php
#
#
# cd /opt/share/www
# mv trunk/wtorrent/ .
# ls
index.php trunk wtorrent
# rmdir trunk/
# ls
index.php wtorrent
#
# mkdir wtorrent/tpl_c
#
# touch wtorrent/db/database.db
#
# cp wtorrent/conf/sample.user.conf.php wtorrent/conf/user.conf.php
#
# chmod -R 777 wtorrent
#

Whew, now that bit of (undocumented) house cleaning is taken care of we need to modify the configuration for rtorrent to enable the xmlrpc server.

# echo '# xmlrpc support for wtorrent
scgi_port = 127.0.0.1:5000' >> /opt/etc/rtorrent.conf

You’ll have to restart rtorrent after the line above. If you’re successfull your rtorrent should have a message like so:

# /opt/etc/init.d/S99rtorrent restart

NOTE:

I still haven't gotten around to patching S99rtorrent in Optware. For a temporary solution there is an S99rtorrent that will work for now, check the comment section of part 1of3 of this series.

*** rTorrent 0.8.2/0.12.4 - wdtv-01:1282 ***
[View: main]

( 7:25:43) Using 'select' based polling.
( 7:25:43) Ignoring ~/.rtorrent.rc.
( 7:25:43) XMLRPC initialized with 444 functions.
( 7:25:43) The SCGI socket is bound to a specific network device yet may still p
[Throttle 40/300 KB] [Rate 0.0/ 0.0 KB] [Port: 51780] [U 0/18] [D 0/70] [H

Note: I’ve done the minimal patching required to get rtorrents init.d script syntax error free, will patch Optware tomorrow if I have time ;)

Ok, we’re gettin closer. Now we just need to install one package I accidentally left off (sqlite2) the lighttpd tutorial and then enable the modules in php.ini.

# ipkg install sqlite2
Installing sqlite2 (2.8.17-2) to root...
Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//sqlite2_2.8.17-2_mipsel.ipk
Configuring sqlite2
Successfully terminated.

#
# echo 'extension=pdo.so
extension=pdo_sqlite.so' >> /opt/etc/php.ini

Now its time to enable and configure the SCGI server module in lighttpd. For good style I’ll place the config file in /opt/etc/lighttpd/conf.d/. All .conf files located in this directory are parsed each time lighttpd starts. This makes things a bit more modular.

To edit:

# nano /opt/etc/lighttpd/conf.d/11-mod_scgi.conf

inside 11-mod_scgi.conf add:

server.modules += ( "mod_scgi" )

scgi.server = (
"/RPC2" => # RT_DIR
( "127.0.0.1" =>
(
"host" => "127.0.0.1", # Ip where rtorrent is listening
"port" => 5000, # Port specified in .rtorrent.rc
"check-local" => "disable"
)
)
)

The next step is optional. If your wdtv is not accessible from the public internet, then you can skip this step. If you are forwarding an external port to your wdtv so you can manage wtorrent remotely, then yes you definitely want to do this.

To edit:

# nano /opt/etc/lighttpd/conf.d/12-mod_auth.conf

inside 12-mod_auth.conf add:

server.modules += ( "mod_auth" )

auth.backend = "htdigest"
auth.backend.htdigest.userfile = "/opt/etc/lighttpd/.passwd"

auth.require = ( "/wtorrent" =>
(
"method" => "basic",
"realm" => "wtorrent.on.wdtv",
"require" => "valid-user"
)
)

Now when you attempt to access wtorrent you’ll be prompted for a username/password, without disclosing whats behind the auth. One last thing we need to do before SCGI is finished, we need to create the directory and set its permissions.

# mkdir /opt/share/www/RPC2
# chmod 777 /opt/share/www/RPC2

We have authorization set up, but one problem…What users are authorized to connect? Inside of 12-mod_auth.conf you should notice these two lines:

auth.backend = "htdigest"
auth.backend.htdigest.userfile = "/opt/etc/lighttpd/.passwd"

Valid user/password combinations are stored in /opt/etc/lighttpd/.passwd. We’ll need to create a little script to add user/password combo’s to this file.

to edit:

# nano /opt/bin/htpasswd && chmod a+x /opt/bin/htpasswd

inside /opt/bin/htpasswd add:

#!/bin/sh

user=$1
realm=$2
pass=$3

hash=`echo -n "$user:$realm:$pass" | md5sum | cut -b -32`
echo "$user:$realm:$hash"

Now I’ll generate a user so I can connect, when things are finished.

# htpasswd b-rad.cc wtorrent.on.wdtv testing >> \
/opt/etc/lighttpd/.passwd

You can change wtorrent.on.wdtv to anything you desire (maybe something less obvious), just be sure there are no spaces in the string.

Are we there yet? Almost. We first need to restart lighttpd to reflect our config changes and kill php-fcgi so it loads the sqlite modules.

# killall php-fcgi
#
# /opt/etc/init.d/S80lighttpd restart
Stopping web server: lighttpd
Starting web server: lighttpd
#

Now we're finally ready to run wtorrents web installer and get things underway.

Open your favourite web browser and enter:

http://<your wdtv's ip>:8081/wtorrent/install.php

You should be welcomed by the install screen. Heres what my config looks like...notice that it asks you for rtorrents scgi port, but I've entered the webserver port instead. I imagine that is a typo on wtorrents part, you must enter your lighttpd port there. When SCGI was enabled earlier we set it to only be exposed to the loopback, so no need to have a username/password there.

wtorrent install.php

Note: don't copy my config information verbatim unless your directories are exactly like mine

Once you've filled the information out correctly, click on try configuration. You should see this:

wtorrent.config.OK

If you don't then you haven't been following very well ;)

If it says you're good, then click save configuration. It should report success like so:

wtorrent config saved

Bingo!

Now there are two things that we need to do before starting, delete install.php like wtorrents asks and protect the wtorrent db from being downloaded.

# rm /opt/share/www/wtorrent/install.php

That takes care of the install script, in order to protect the database we have to modify /opt/etc/lighttpd/lighttpd.conf

# nano /opt/etc/lighttpd/lighttpd.conf

You need to find this line:

url.access-deny = ( "~", ".inc" )

and replace it with this line:

url.access-deny = ("~", ".inc", ".db", ".tpl.php", ".cls.php",)

Restart lighttpd now to reflect that change, then how bout we take wtorrent for a testdrive?

# /opt/etc/init.d/S80lighttpd restart

Ok, navigate to http://<your wdtv's ip>:8081/wtorrent. You're greeted by wtorrents internal log in page, if you enabled mod_auth earlier you'll have to enter a user/password before you access wtorrent.

wtorrent log in

After logging in you're dropped in to the torrent listings. If your rtorrent has torrents currently running you'll see them here, I don't have anything downloading at the moment.

wtorrent empty view

I'll click on add torrent to see about adding something.

wtorrent upload page

I've selected something and checked private, since this is a private torrent, now I'll click to upload.

wtorrent torrent uploaded

Lets go back to the main view to see if the torrent is running.

wtorrent view torrent

Awesome! You now have the ability to add torrents to your wdtv from anywhere in the world...and you don't have to go to the console at all!!! :D

Some things to note:

  • the wdtv is not a powerful web server, give rtorrent/wtorrent time to respond and don't be impatient.

  • extracting archives can be painful

I spend a tremendous amount of time hacking the WDTV firmware and writing up stuff like this, so if you appreciate my efforts please donate a little something using the link below : ) Thanks & enjoy.



]]> http://b-rad.cc/687/wdtv-optware-tips-wtorrent-webgui-for-rtorrent/feed/ 30 WDTV Optware tips #4: lighttpd webserver with PHP http://b-rad.cc/547/wdtv-optware-tips-lighttpd-webserver-running-with-php/ http://b-rad.cc/547/wdtv-optware-tips-lighttpd-webserver-running-with-php/#comments Fri, 27 Mar 2009 19:28:29 +0000 b-rad http://b-rad.cc/?p=547 As I sat down to start on the wtorrent tutorial I promised back in my rtorrent article I thought about how it is really two seperate parts: getting the webserver running and then getting wtorrent running on that. So today I’ll be going through everything to get the lighttpd webserver running on your Western Digital WDTV, with PHP for dynamic pages too. lighttpd is a lightweight fully featured webserver that suits the WDTV perfect. lighttpd even powers some high profile sites like YouTube and wikipedia.

In order to take advantage of this tutorial you must either be running WDLXTV or Zoranders ext3-boot. You must also have my Optware for WDTV package installed, that stuff is covered elsewhere. I’ll be including every necessary step here, so you might be able to skip around if you already have some of this done.


First ssh/telnet into your WDTV, then update your Optware feed and install lighttpd, php, and php-cgi.

$ ssh root@wdtv-01

BusyBox v1.10.0 (2009-02-15 05:09:42 CST) built-in shell (msh)
Enter 'help' for a list of built-in commands.

# ipkg update
Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//Packages.gz
Inflating http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//Packages.gz
Updated list of available packages in /opt/lib/ipkg/lists/wdtv
Successfully terminated.
#
# ipkg install lighttpd php php-fcgi sqlite
Installing lighttpd (1.4.22-1) to root...
Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//lighttpd_1.4.22-1_mipsel.ipk
package lighttpd suggests installing e2fsprogs
package lighttpd suggests installing libmemcache
package lighttpd suggests installing lua
package lighttpd suggests installing memcached
package lighttpd suggests installing sqlite
package lighttpd suggests installing mysql
Installing php (5.2.9-3) to root...
Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//php_5.2.9-3_mipsel.ipk
Installing php-fcgi (5.2.9-1) to root...
Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//php-fcgi_5.2.9-1_mipsel.ipk
Installing sqlite (3.6.11-1) to root...
Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//sqlite_3.6.11-1_mipsel.ipk
Configuring lighttpd
Starting web server: lighttpd
Configuring php
Configuring php-fcgi
Configuring sqlite
Successfully terminated.

Everything installed fine so lets see what comes up in a search for lighttpd in /opt/etc. This directory is where settings and startup scripts for Optware installed programs are.

# find /opt/etc/* | grep lighttpd
/opt/etc/init.d/S80lighttpd
/opt/etc/lighttpd
/opt/etc/lighttpd/lighttpd.conf
/opt/etc/lighttpd/conf.d
/opt/etc/lighttpd/conf.d/01-default.conf
/opt/etc/lighttpd/conf.d/10-php-fcgi.conf

Ok, so /opt/etc/init.d/S80lighttpd is the startup script that gets lighttpd going when the WDTV boots up. The really nice file is /opt/etc/lighttpd/conf.d/10-php-fcgi.conf, this file is loaded when lighttpd starts so we don’t have to touch a thing and php works right out of the box. :D

There are two things we’d like two know that the config file will tell, and those are port number and document root directory of the server. Lets grep /opt/etc/lighttpd/lighttpd.conf for those terms.

# cat /opt/etc/lighttpd/lighttpd.conf | egrep \ 'server.port|server.document-root'
server.document-root = "/opt/share/www/"
server.port = 8081

Ok, so /opt/share/www/ is where all of our html/php/etc files will go. Lets test it out and see if php is really enabled. We’ll do this by editing index.php in our web root, index.php is the default file returned by lighttpd. I’ll use nano to edit /opt/share/www/index.php and add the following:


<?php

// Show all information, defaults to INFO_ALL
phpinfo();

// Show just the module information.
// phpinfo(8); yields identical results.
phpinfo(INFO_MODULES);

?>

The above is a good test page (directly from php.net) because it displays all the different parameters that php was compiled with and accessible modules. If you created the webpage you can navigate to it now in your favourite browser. Don’t forget to enter the port number, which is 8081 if you didn’t change the config file above. The address will look like this, just change the wdtv-01 to whatever your wdtv’s ip address is.

http://wdtv-01:8081/

I’ll however just download the page from the webserver, dump its contents to standard out, and grep a few key terms to make sure everythings working correctly.

# wget -O - wdtv-01:8081 2> /dev/null | egrep 'Server API|System'
<tr> System </td><td class="v">Linux wdtv-01 2.6.15-TvDock #2 PREEMPT Mon Sep 15 20:20:41 CST 2008 mips </td></tr>
<tr><td class="e">Server API </td><td class="v">CGI/FastCGI </td></tr>

it works, cool! Now your WDTV is ready to serve up any php pages you give it. That was almost too easy.

Just to review now:

  • the webserver is started when you turn your WDTV on

  • the root directory of the webserver is /opt/share/www
  • /opt/etc/init.d/S80lighttpd is the startup script, it can be used in three ways:
    • to restart: /opt/etc/init.d/S80lighttpd restart

    • to start: /opt/etc/init.d/S80lighttpd start
    • to stop: /opt/etc/init.d/S80lighttpd stop

    Ok, so next time will actually be the wtorrent tutorial...


    ]]> http://b-rad.cc/547/wdtv-optware-tips-lighttpd-webserver-running-with-php/feed/ 11 WDTV Optware tips #3 – bittorrent with rtorrent http://b-rad.cc/437/wdtv-optware-tips-bittorrent-with-rtorrent/ http://b-rad.cc/437/wdtv-optware-tips-bittorrent-with-rtorrent/#comments Wed, 25 Mar 2009 04:44:49 +0000 b-rad http://b-rad.cc/?p=437 By popular demand I’ll go through all the steps to get a bittorrent client running on the WDTV. My client of choice is rtorrent so that is what I’m going to cover. rtorrent is an extremely fast and lightweight client so it suits the wdtv perfectly. You’ll be downloading torrents in no time flat.

    In order to take advantage of this tutorial you must either be running WDLXTV or Zoranders ext3-boot. You must also have my Optware for WDTV package installed, that stuff is covered elsewhere. I’ll be including every necessary step here, so you might be able to skip around if you already have some of this done.


    So first ssh/telnet into your WDTV.

    Next we’ll update our Optware feed and install rtorrent & screen.

    # ipkg update
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//Packages.gz
    Inflating http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//Packages.gz
    Updated list of available packages in /opt/lib/ipkg/lists/wdtv
    Successfully terminated.
    #
    # ipkg install rtorrent screen
    Installing rtorrent (0.8.2-1) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//rtorrent_0.8.2-1_mipsel.ipk
    package rtorrent suggests installing dtach
    package rtorrent suggests installing adduser
    Installing libtorrent (0.12.4-1) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//libtorrent_0.12.4-1_mipsel.ipk
    Installing screen (4.0.3-2) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//screen_4.0.3-2_mipsel.ipk
    Installing termcap (1.3.1-2) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//termcap_1.3.1-2_mipsel.ipk
    Installing libsigc++ (2.0.18-1) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//libsigc++_2.0.18-1_mipsel.ipk
    Installing libcurl (7.19.4-1) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//libcurl_7.19.4-1_mipsel.ipk
    Installing xmlrpc-c (1.11.00-3) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//xmlrpc-c_1.11.00-3_mipsel.ipk
    Installing libxml2 (2.7.3-1) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//libxml2_2.7.3-1_mipsel.ipk
    Installing libiconv (1.11-2) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//libiconv_1.11-2_mipsel.ipk
    Configuring libcurl
    Configuring libiconv
    Configuring screen
    Configuring termcap
    Configuring libsigc++
    Configuring libtorrent
    Configuring libxml2
    Configuring rtorrent
    Configuring xmlrpc-c
    Successfully terminated.

    Lets see what comes up in a search for rtorrent.

    # find /opt/* | grep rtorrent
    /opt/bin/rtorrent
    /opt/etc/rtorrent.conf
    /opt/etc/init.d/S99rtorrent
    /opt/lib/ipkg/info/rtorrent.control
    /opt/lib/ipkg/info/rtorrent.conffiles
    /opt/lib/ipkg/info/rtorrent.list
    /opt/share/man/man1/rtorrent.1

    There are two important files to point out here: /opt/etc/rtorrent.conf and /opt/etc/init.d/S99rtorrent

    /opt/etc/init.d/S99rtorrent is a startup script that will be executed every single time you start your wdtv. Yes, this means after you make it through this painful tutorial you won’t have to mess with the console again and can just ftp torrents in.

    /opt/etc/rtorrent.conf is what we want to immediately deal with. This is the configuration file, open it with your favorite text editor. I’m using nano. At the top of the file change min/max peers and upload/download rate to whatever suits your connection. If you don’t know what would be good, maybe just modify these two:

    # Global download rate in KiB. "0" for unlimited.
    download_rate = 80

    # Global upload rate in KiB. "0" for unlimited.
    upload_rate = 80

    Setting download rate to zero makes it unlimited, change upload_rate to whatever suits your connection. The default is 80, maybe a bit high for lots of folks. Remember the speed you choose here will affect being able to play high bandwidth material off your network shares! * see note below * :D

    Next we need to select the directory where we’d like to save downloaded file and where we want our *.torrent watch directory to be. The default directory is inside your opt.bin, so unless you’ve made that ginormous you best change this.

    Note: For various reasons I keep my active torrent hard drives seperate from data storage drives and I’ll be doing that here as well. Especially on the WDTV you’re best having your torrents download to a drive without much media so as to not have disk I/O interfere with watching movies, listening to music, etc.

    # Default directory to save downloaded files. Note it doesn't support
    # space yet.
    directory = /tmp/media/usb/torrent-disk/

    # Watch a directory for new torrents, and stop those that have been deleted.
    schedule = watch_directory,5,5,load_start=/tmp/media/usb/torrentdisk/torrent-drop/*.torrent
    schedule = untied_directory,5,5,stop_untied=

    You’ll probably need to set up port forwarding, so make port_range your favourite number and set your router up later.

    # Port range to use for listening.
    port_range = 51777-51780

    Default seed ratio is 200%, I’ll lower that to 110%.

    # Stop torrents when reaching upload ratio in percent,
    # when also reaching total upload in bytes, or when
    # reaching final upload ratio in percent.
    # example: stop at ratio 2.0 with at least 200 MB uploaded, or else ratio 20.0
    #schedule = ratio,60,60,"stop_on_ratio=200,200M,2000"
    schedule = ratio,30,60,stop_on_ratio=110

    If DHT and peer exchange are your thing, then remove the # from the beginning of these lines.

    # Enable DHT support for trackerless torrents or when all trackers are down.
    # May be set to "disable" (completely disable DHT), "off" (do not start DHT),
    # "auto" (start and stop DHT as needed), or "on" (start DHT immediately).
    # The default is "off". For DHT to work, a session directory must be defined.
    # dht = auto

    # UDP port to use for DHT.
    # dht_port = 6881

    # Enable peer exchange (for torrents not marked private)
    # peer_exchange = yes

    Ok, thats it. Now to see if it works.

    # rtorrent
    *** rTorrent 0.8.2/0.12.4 - wdtv-01:2633 ***
    [View: main]


    (21:09:09) Using 'select' based polling.
    (21:09:09) Could not read resource file: ~/.rtorrent.rc
    [Throttle off/off KB] [ .......... ] [H 0/32] [S 0/1/768] [F 0/128]

    no, it does not. This is a good time to mention how you exit rtorrent, Ctrl^q. This means when we start rtorrent we have to point it to /opt/etc/rtorrent.conf.

    # screen rtorrent -n -o import=/opt/etc/rtorrent.conf
    rtorrent: Could not lock session directory: "/opt/share/torrent/session/", No such file or directory
    [screen is terminating]
    # mkdir -p /opt/share/torrent/session

    The session directory doesn’t exist, so I create it. Now it should work.

    # screen rtorrent -n -o import=/opt/etc/rtorrent.conf
    *** rTorrent 0.8.2/0.12.4 - wdtv-01:2850 ***
    [View: main]

    (21:22:08) Using 'select' based polling.
    (21:22:08) Ignoring ~/.rtorrent.rc.
    [Throttle 200/off KB] [ ... ] [D 0/0] [H 0/32] [S 0/2/768] [F 0/128]
    [screen is terminating]
    #



    Perfect, so now everything looks like it will work I’ll:

    • start up rtorrent under screen, so that it may be detached to the background.

    • Once inside rtorrent, press Ctrl^ad (press ctrl, then a, then d) to detach
    • Move a torrent into the watch directory that was setup.
    • resume rtorrent and watch torrent go.
    • detach rtorrent and watch a movie:D

    Here we go:

    # screen rtorrent -n -o import=/opt/etc/rtorrent.conf
    *** rTorrent 0.8.2/0.12.4 - wdtv-01:2960 ***
    [View: main]


    (21:28:43) Using 'select' based polling.
    (21:28:43) Ignoring ~/.rtorrent.rc.
    [Throttle 200/off KB] [ ... ] [D 0/0] [H 0/32] [S 0/2/768] [F 0/128]
    [screen detached]
    #
    # mv /tmp/something.torrent /tmp/media/usb/sda2/torrent-drop
    # screen -r
    *** rTorrent 0.8.2/0.12.4 - wdtv-01:3159 ***
    [View: main]
    something 10.0 / 712.0 MB Rate: 10.0 / 934.2 KB Uploaded: ......
    Tracker[0:0]: Connecting to some tracker

    [Throttle 200/off KB] [ ... ] [D 36/0] [H 0/32] [S 0/38/768] [F 52/128]
    [detached]
    #
    # exit

    Awesome.

    Keys you should be aware of:

    • a / s / d raise upload speed limit 1 / 5 / 50 KiB

    • z / x / c lower upload rate limit 1 / 5 / 50 KiB
    • A / S / D raise download rate limit 1 / 5 / 50 KiB
    • Z / X / C lower download rate limit 1 / 5 / 50 KiB
    • Ctrl^s starts a torrent
    • Ctrl^d stops a started torrent or removes a stopped torrent
    • number 1 – 9 are different views (all / started / stopped / seeding / etc )
    • use the arrow keys to navigate around.
    • Ctrl^ad detaches rtorrent to the background
    • screen -r resumes rtorrent
    • Ctrl^q exits rtorrent

    Note: my WDTV is fairly unresponsive with rtorrent zipping at the settings i chose, which was 200KiB up and unlimited down. I imagine the disk I/O just made my WDTV have a coronary. So maybe you should lower the default max_upload and stick with default max_download values, and experiment raising/lowering them until you find a nice value. I gotta wait 10min till what I started is done to see if my WDTV happens to wake back up :D Well now i know.

    Soon I’ll look into modifying rtorrents priority with nice to set it at idle, and play with a bit of the config settings to see if they’ll help things out. So be sure to check back here for and update.

    Also look out for part 2 of this tutorial soon, where I’ll detail setting up the best rtorrent interface: wtorrent. Then you’ll never have to go to the console again!

    Note: In case you’ve forgotten by now, rtorrent will be started whenever you boot your wdtv. This means you do not start it up if you ssh/telnet in and want you check out your torrents. You simply type:

    # screen -r

    Enjoy!

    EDIT

    my WDTV did not recover from my snafu above :D BUT i changed the settings to max_upload=50 max_download=300 and its downloading fine. In fact no problems as I play a local 1080p mkv, while i view rtorrent downloading and hash checking in a remote shell :D Remember the speed you choose here will affect being able to play high bandwidth material off your network shares!

    Note:
    /opt/etc/init.d/S99rtorrent contains syntax errors so it does not start rtorrent when you boot your wdtv, i’ll look into fixing that soon and provide a patched version.


    ]]>     http://b-rad.cc/437/wdtv-optware-tips-bittorrent-with-rtorrent/feed/ 40     WDTV Optware tips #2 – Rapidshare downloading with SlimRat http://b-rad.cc/198/wdtv-optware-tips-rapidshare-with-slimrat/ http://b-rad.cc/198/wdtv-optware-tips-rapidshare-with-slimrat/#comments Mon, 16 Mar 2009 10:20:51 +0000 b-rad http://b-rad.cc/?p=198 Today I’ll walk through getting perl & SlimRat installed on your WDTV. SlimRat is a command line and GUI utility for downloading files from Rapidshare on Linux.

    In order to take advantage of this tutorial you must either be running WDLXTV or Zoranders ext3-boot. You must also have my Optware for WDTV package installed, that stuff is covered elsewhere. I’ll be including every necessary step here, so you might be able to skip around if you already have some of this done.


    first install perl and all the modules that slimrat requires.

    # ipkg install perl perl-www-mechanize
    Installing perl (5.10.0-3) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//perl_5.10.0-3_mipsel.ipk
    Installing libdb (4.2.52-3) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//libdb_4.2.52-3_mipsel.ipk
    Installing gdbm (1.8.3-2) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//gdbm_1.8.3-2_mipsel.ipk
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//perl-www-mechanize_1.54-2_mipsel.ipk
    Installing perl-http-response-encoding (0.05-1) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//perl-http-response-encoding_0.05-1_mipsel.ipk
    Installing perl-libwww (5.825-1) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//perl-libwww_5.825-1_mipsel.ipk
    Installing perl-uri (1.35-3) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//perl-uri_1.35-3_mipsel.ipk
    Installing perl-compress-zlib (1.42-3) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//perl-compress-zlib_1.42-3_mipsel.ipk
    Installing zlib (1.2.3-3) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//zlib_1.2.3-3_mipsel.ipk
    Installing perl-html-parser (3.60-1) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//perl-html-parser_3.60-1_mipsel.ipk
    Installing perl-html-tagset (3.04-4) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//perl-html-tagset_3.04-4_mipsel.ipk
    Configuring gdbm
    Configuring libdb
    Configuring perl
    Configuring perl-compress-zlib
    Configuring perl-html-parser
    Configuring perl-html-tagset
    Configuring perl-http-response-encoding
    Configuring perl-libwww
    Configuring perl-uri
    Configuring perl-www-mechanize
    Configuring zlib
    Successfully terminated.

    Does perl work?

    # perl -v

    This is perl, v5.10.0 built for mipsel-linux

    Copyright 1987-2007, Larry Wall

    Perl may be copied only under the terms of either the Artistic License or theGNU General Public License, which may be found in the Perl 5 source kit.

    Complete documentation for Perl, including FAQ lists, should be found on this system using "man perl" or "perldoc perl". If you have access to the Internet, point your browser at http://www.perl.org/, the Perl Home Page.

    # perl -e "print "Hello World";"
    Hello World

    Looks like perl works so now lets download & extract SlimRat

    # cd /opt/bin
    # wget http://slimrat.googlecode.com/files/slimrat-0.9.3.tar.bz2
    Connecting to slimrat.googlecode.com (209.85.173.82:80)
    slimrat-0.9.3.tar.bz 100% |*******************************| 12195 --:--:-- ETA
    # bunzip2 slimrat-0.9.3.tar.bz2
    # tar -xvf slimrat-0.9.3.tar
    slimrat-0.9.3/
    slimrat-0.9.3/INSTALL
    slimrat-0.9.3/Plugin.pm
    slimrat-0.9.3/Toolbox.pm
    slimrat-0.9.3/config
    slimrat-0.9.3/index.html
    slimrat-0.9.3/plugins/
    slimrat-0.9.3/plugins/DepositFiles.pm
    slimrat-0.9.3/plugins/Direct.pm
    slimrat-0.9.3/plugins/FastLoad.pm
    slimrat-0.9.3/plugins/Leteckaposta.pm
    slimrat-0.9.3/plugins/MediaFire.pm
    slimrat-0.9.3/plugins/Rapidshare.pm
    slimrat-0.9.3/plugins/YouTube.pm
    slimrat-0.9.3/slimrat.glade
    slimrat-0.9.3/slimrat-gui
    slimrat-0.9.3/slimrat
    # rm slimrat-0.9.3.tar
    # ln -s slimrat-0.9.3/slimrat ./slimrat

    The last line allows us to execute slimrat from anywhere on the system.

    *Note* I’ve just noticed that either: SlimRat was recently added to the nslu2-linux wdtv feed or I never realized it was there : p

    # ipkg install slimrat

    Will install a slightly older version of SlimRat than I’m using here in these examples.

    If bunzip2 says not found, then:

    # ipkg install bzip2

    So now let see if it works.

    # slimrat
    Loaded plugins: FastLoad, MediaFire, YouTube, DepositFiles, Rapidshare, Leteckaposta

    SlimRat

    Downloads files from rapidshare and other servers to your working directory. Files to download are specified by download links like 'http://rapidshare.com/files/012345678/somefile.xxx' as arguments on command line or one per line in file given as --list option ('-' for stdin works too).

    USAGE:
    /opt/bin/slimrat [options] [link [link [...]]]

    OPTIONS:
    -h | --help this help
     -l | --list filename load links from file (one per line)
     -c | --check only check links, don't download them
     -t | --to directory destination directory (where to download)
     -w | --wget wget options, enclosed in quotes
     slimrat -w '--limit-rate=20k' -l file-list

    It works! Now before we test it out and download some stuff theres one issue to work out. Rapidshare enforces a waiting period in between downloads, so a big release could take a while to download. We don’t want to have to keep the shell open the whole time SlimRat works, but if its closed SlimRat will terminate. What we’ll do is utilize the program screen, which will allow us to detach SlimRat and exit our terminal session on the wdtv without affecting the downloading.


    # ipkg install screen
    Installing screen (4.0.3-2) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//screen_4.0.3-2_mipsel.ipk
    Installing termcap (1.3.1-2) to root...
    Downloading http://ipkg.nslu2-linux.org/feeds/optware/wdtv/cross/unstable//termcap_1.3.1-2_mipsel.ipk
    Configuring screen
    Configuring termcap
    Successfully terminated.

    To run a program behing screen prepend it to the command string.

    # screen <program> <arguments>

    Once running there is one main key sequence that you need to remember

    Ctrl^a^d

    That is: press the Ctrl key, then a, then d, then lift off Ctrl. This sequence drops screen to the background and returns us to the shell. In order to get back (if theres only one instance of screen running) to the program:

    # screen -r

    I’ll queue up 3 files and when SlimRat starts the first file I’ll hit Ctrl^a^d, exit my ssh session, grab a snack, and watch a show.

    # cd /tmp/boot
    # mkdir rstests && cd rstests
    # screen slimrat http://rapidshare.com/files/206442508/WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip http://rapidshare.com/files/206443577/WDTV_FW_1_01_02_03_B-RAD.CC_DVD-ENABLED.zip http://rapidshare.com/files/207616110/opt.bin-0.2.zip

    Loaded plugins: FastLoad, MediaFire, YouTube, DepositFiles, Rapidshare, Leteckaposta
    [09:17:34] Slimrat started
    [09:17:34] Downloading http://rapidshare.com/files/206442508/WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip (Rapidshare) [ALIVE]
    [09:17:40] Waiting 00:32
    [09:18:12] Continuing
    --2009-03-16 09:18:12-- http://rs523tl2.rapidshare.com/files/206442508/1409886/WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip
    Resolving rs523tl2.rapidshare.com... 80.239.226.124
    Connecting to rs523tl2.rapidshare.com|80.239.226.124|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 12535355 (12M) [application/octet-stream]
    Saving to: `WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip'

    22% [==================>                  ] 2,816,816 196K/s eta 57s
    [detached]

    (Here I’ve just hit Ctrl^a^d, which detached screen)

    [detached]
    # exit
    connection to wdtv closed.
    $

    Ok, my show is over. Its time to log back in and see if SlimRat is complete yet.

    $ ssh root@wdtv

    BusyBox v1.10.0 (2009-02-15 05:09:42 CST) built-in shell (msh)
    Enter 'help' for a list of built-in commands.

    # screen -r
    [09:17:34] Downloading http://rapidshare.com/files/206442508/WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip (Rapidshare) [ALIVE]
    [09:17:40] Waiting 00:32
    [09:18:12] Continuing
    --2009-03-16 09:18:12-- http://rs523tl2.rapidshare.com/files/206442508/1409886/WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip
    Resolving rs523tl2.rapidshare.com... 80.239.226.124
    Connecting to rs523tl2.rapidshare.com|80.239.226.124|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 12535355 (12M) [application/octet-stream]
    Saving to: `WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip'

    100%[=====================================================================================>] 12,535,355 196K/s in 67s

    2009-03-16 09:19:20 (183 KB/s) - `WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip' saved [12535355/12535355]

    [09:19:20] File downloaded

    [09:19:20] Downloading http://rapidshare.com/files/206443577/WDTV_FW_1_01_02_03_B-RAD.CC_DVD-ENABLED.zip (Rapidshare) [ALIVE]
    [09:19:23] Reached the download limit for free-users
    [09:19:23] Waiting 15:00
    [09:34:24] Continuing
    [09:34:25] Waiting 00:32
    [09:34:57] Continuing
    --2009-03-16 09:34:57-- http://rs234l33.rapidshare.com/files/206443577/1363875/WDTV_FW_1_01_02_03_B-RAD.CC_DVD-ENABLED.zip
    Resolving rs234l33.rapidshare.com... 195.122.149.35
    Connecting to rs234l33.rapidshare.com|195.122.149.35|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 13693232 (13M) [application/octet-stream]
    Saving to: `WDTV_FW_1_01_02_03_B-RAD.CC_DVD-ENABLED.zip'

    100%[=====================================================================================>] 13,693,232 153K/s in 75s

    2009-03-16 09:36:13 (179 KB/s) - `WDTV_FW_1_01_02_03_B-RAD.CC_DVD-ENABLED.zip' saved [13693232/13693232]

    [09:36:13] File downloaded

    [09:36:13] Downloading http://rapidshare.com/files/207616110/opt.bin-0.2.zip (Rapidshare) [ALIVE]
    [09:36:16] Reached the download limit for free-users
    [09:36:16] Waiting 15:00
    [09:51:17] Continuing
    [09:51:18] Waiting 00:33
    [09:51:51] Continuing
    --2009-03-16 09:51:52-- http://rs601l3.rapidshare.com/files/207616110/109812/opt.bin-0.2.zip
    Resolving rs601l3.rapidshare.com... 62.140.7.2
    Connecting to rs601l3.rapidshare.com|62.140.7.2|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 18084506 (17M) [application/octet-stream]
    Saving to: `opt.bin-0.2.zip'

    100%[=====================================================================================>] 18,084,506 193K/s in 80s

    2009-03-16 09:53:23 (227 KB/s) - `opt.bin-0.2.zip' saved [18084506/18084506]

    [09:53:23] File downloaded

    When a program running under screen terminates control is immediately returned to the shell. Any output from the previously running program will disappear. If you ever try screen -r and are told there is no screen to be resumed, then your program has already finished executing. So now we see:

    $ ssh root@wdtv

    BusyBox v1.10.0 (2009-02-15 05:09:42 CST) built-in shell (msh)
    Enter 'help' for a list of built-in commands.

    # screen -r
    [screen terminating]
    # cd /tmp/boot/rstests && ls -la *.zip
    -rwxr-xr-x 1 root root 12535355 Mar 16 09:19 WDTV_FW_1_00_01_03_B-RAD.CC_DVD-ENABLED.zip
    -rwxr-xr-x 1 root root 13693232 Mar 16 09:36 WDTV_FW_1_01_02_03_B-RAD.CC_DVD-ENABLED.zip
    -rwxr-xr-x 1 root root 18084506 Mar 16 09:53 opt.bin-0.2.zip

    Looks like everything downloaded correctly as it should, now to go find some other more interesting stuff to download : )

    Tune in for next time, when i show how to automate SlimRat with directory monitoring and a custom autoextract script...


    ]]> http://b-rad.cc/198/wdtv-optware-tips-rapidshare-with-slimrat/feed/ 5 WDTV Optware tips #1 – resizing opt.bin *updated* http://b-rad.cc/170/wdtv-optware-tips-resizing-optbin/ http://b-rad.cc/170/wdtv-optware-tips-resizing-optbin/#comments Tue, 10 Mar 2009 02:23:00 +0000 b-rad http://b-rad.cc/?p=170 Back in my post about Optware for the WDTV, I mentioned how I had limited opt.bin to 128MB and made a comment hinting about being able to resize it if you need. Well I was called out [sasa ; )] so heres the easy steps to resize your opt.bin to whatever you’d like. 128MB really isn’t that much after all.

    Note: this will require either access to a Linux computer, cygwin shell with ext2fs tools, or if you have time and patience it can be executed straight on the WDTV using Zoranders ext3-boot. It will take a long time on the WDTV though.



    Fire up whatever shell you’re going to use and navigate to the location of opt.bin. Lets check out how much space I have left.

    $ cd /wdtv
    $ mkdir optMount
    $ mount -o loop opt.bin optMount
    $ df ./opt
    Filesystem 1K-blocks Used Available Use% Mounted on
    /dev/loop3 126931 111483 8895 93% /wdtv/opt
    $ umount optMount

    : O Gettin pretty tight! We need to extend this filesystem and give a lot more room to grow, but how to make the opt.bin file itself larger? There are two possible methods, copying to a new file with padding or expanding the file in place.

    Method 1: copying
    First we’ll create a new file that consists of our original opt.bin with a lot of zeroes appended to the end. I want my new opt.bin to be 512MB.

    $ dd if=/dev/zero of=zeroes bs=1024k count=384
    384+0 records in
    384+0 records out
    402653184 bytes (403 MB) copied, 10.6317 s, 37.9 MB/s

    This creates the padding, 384MB, since opt.bin comes stock as 128MB. If you’d like something other than 512MB, then change 384 above to whatever you wish. Now to create the new image.

    $ cat opt.bin zeroes > bigger.opt.bin
    $ ls -la opt.bin bigger.opt.bin zeroes
    -rw-r--r-- 1 b-rad b-rad 536870912 2009-03-09 17:12 bigger.opt.bin
    -rw-r--r-- 1 b-rad b-rad 134217728 2009-03-02 22:08 opt.bin
    -rw-r--r-- 1 b-rad b-rad 402653184 2009-03-09 17:11 zeroes

    This combines the two files into a new file. Perfect, so now we have a new bin that is 512MB. But is it really 512MB?

    $ mount -o loop bigger.opt.bin optMount
    $ df optMount
    Filesystem 1K-blocks Used Available Use% Mounted on
    /dev/loop3 126931 111483 8895 93% /wdtv/optMount
    $umount optMount

    No Its not. Although the file containing the filesystem is 512MB, the filesystem still thinks its 128MB because it hasn’t been told otherwise. So let us resize it to fill up the maximum size opt.bin can hold, using resize2fs.

    $ resize2fs bigger.opt.bin
    resize2fs 1.41.3 (12-Oct-2008)
    Please run 'e2fsck -f bigger.opt.bin' first.

    resize2fs rightly asks you to force check the integrity of your target filesystem before you extend it, using e2fsck.

    $ e2fsck -f bigger.opt.bin
    e2fsck 1.41.3 (12-Oct-2008)
    Pass 1: Checking inodes, blocks, and sizes
    Pass 2: Checking directory structure
    Pass 3: Checking directory connectivity
    /lost+found not found. Create<y>? yes

    Pass 4: Checking reference counts
    Pass 5: Checking group summary information

    bigger.opt.bin: ***** FILE SYSTEM WAS MODIFIED *****
    bigger.opt.bin: 1500/32768 files (0.3% non-contiguous), 23102/131072 blocks

    $ resize2fs bigger.opt.bin
    resize2fs 1.41.3 (12-Oct-2008)
    Resizing the filesystem on newImage.bin to 524288 (1k) blocks.
    The filesystem on newImage.bin is now 524288 blocks long.

    Note above I answered yes when asked to create lost+found.

    Does bigger.opt.bin contain a file system with 512MB of space yet?

    $ mount -o loop bigger.opt.bin optMount
    $ df optMount
    Filesystem 1K-blocks Used Available Use% Mounted on
    /dev/loop3 507748 112243 369293 24% /wdtv/optMount
    $ umount optMount

    : D Yes it does.

    $ mv opt.bin opt.bin.small
    $ mv bigger.opt.bin opt.bin
    $ rm zeroes



    Method 2: expanding opt.bin in place

    This is a slightly more advanced method of expanding opt.bin, which accomplishes the same thing without any extra files.

    $ cd /wdtv
    $ ls -la opt.bin
    -rw-r--r-- 1 b-rad b-rad 134217728 2009-03-02 22:08 opt.bin

    This opt.bin starts out at 128MB like the one above. Now we’ll use dd again, but this time in append mode. This means that the zeroes will be added to the end of opt.bin.

    NOTE: if something goes wrong here it could be bad, so make a backup copy first if you desire.

    # dd if=/dev/zero of=opt.bin bs=1024k count=384 \
    oflag=append conv=notrunc
    384+0 records in
    384+0 records out
    402653184 bytes (403 MB) copied, 18.6361 s, 21.6 MB/s
    $ ls -la opt.bin
    -rw-r--r-- 1 b-rad b-rad 536870912 2009-03-12 17:05 opt.bin

    Notice its the exact same size as using the first method, as it should be. Since we already know that the filesystem won’t realize its larger yet, we’ll do those steps right away.

    $ e2fsck -f opt.bin
    opt.bin: recovering journal
    Pass 1: Checking inodes, blocks, and sizes
    Pass 2: Checking directory structure
    Pass 3: Checking directory connectivity
    /lost+found not found. Create? yes

    Pass 4: Checking reference counts
    Pass 5: Checking group summary information

    opt.bin: ***** FILE SYSTEM WAS MODIFIED *****
    opt.bin: 1558/32768 files (7.8% non-contiguous), 24643/131072 blocks
    $ resize2fs opt.bin
    resize2fs 1.41.3 (12-Oct-2008)
    Resizing the filesystem on opt.bin to 524288 (1k) blocks.
    The filesystem on opt.bin is now 524288 blocks long.
    $ mkdir optMount && mount -o loop opt.bin optMount && df optMount && umount optMount && rmdir optMount
    Filesystem 1K-blocks Used Available Use% Mounted on
    /dev/loop6 507748 21261 460275 5% /wdtv/optMount

    There you go, in place file system expansion. Just be extremely sure to umount opt.bin before doing these operations.

    Now with two different methods of expansion I’ve covered all the bases, enjoy the new free space on your wdtv!


    ]]>     http://b-rad.cc/170/wdtv-optware-tips-resizing-optbin/feed/ 3