DTN

Any chance that the RSS feed could monitor the entire site instead of just the single forum it monitors? The site changes by the minute. Rss feeds are meant to report that. The Site announcements only change about once a month.

http://www.rdtiburon.com/index.php?act=rssout&id=1

supercow

we probably could, is the interest there for something like that though?

Lazyshot

seconded. yeah. pretty sure it's integrated part of Invision.

would definitely love this for my phone and thunderbird.

DTN

bump

If it's a Linux server then I would gladly write a script to do the job

majik

I may be interested in this as well. Then I could add it to my iGoogle page laugh.gif

Adam - what would you need to know to be able to generate a script?

DTN

Not alot, just some web space and the ability to execute a program. My program mythicalLibrarian generates RSS feeds for television shows each time a new one is recorded.
<div class='codetop'>CODE</div><div class='codemain'><?xml version="1.0" encoding="ISO-8859-1" ?>
<rss version="2.0">
<channel>
<title>mythticalLibrarian</title>
<link>http://xbmc.org</link>
<description>mythicalLibrary Daily Report Information</description>
<item>
<title>Futurama</title>
<link>http://www.thetvdb.com/?tab=series&amp;id=73871</link>
<guid>sftp://root@192.168.1.110/var/lib/mythtv/recordings/Episodes/Futurama/Season%202/Futurama%20S02E01%20%28A%20Flight%20To%20Remember% 29.mpg</guid>
<pubDate>Thu, 13 May 2010 21:30:00 -0500</pubDate>
<description>
Episode Title: A Flight To Remember&lt;br /&gt;
Program: Futurama&lt;br /&gt;
Season: S02&lt;br /&gt;
Episode #: E01&lt;br /&gt;&lt;br /&gt;
Romance and danger follow Bender and Fry on the space cruiser Titanic. Voices of Billy West, Katey Sagal and John DiMaggio.
</description>
</item>
<item>
<title>Futurama</title>
<link>http://www.thetvdb.com/?tab=series&amp;id=73871</link>
<guid>sftp://root@192.168.1.110/var/lib/mythtv/recordings/Episodes/Futurama/Season%201/Futurama%20S01E04%20%28Loves%20Labors%20Lost%20In% 20Space%29.mpg</guid>
<pubDate>Wed, 12 May 2010 02:30:00 -0500</pubDate>
<description>
Episode Title: Loves Labors Lost In Space&lt;br /&gt;
Program: Futurama&lt;br /&gt;
Season: S01&lt;br /&gt;
Episode #: E04&lt;br /&gt;&lt;br /&gt;
Leela meets a self-proclaimed ladies' man who wants to make her his new conquest.
</description>
</item>
<item>
<title>Futurama</title>
<link>http://www.thetvdb.com/?tab=series&amp;id=73871</link>
<guid>sftp://root@192.168.1.110/var/lib/mythtv/recordings/Episodes/Futurama/Season%201/Futurama%20S01E08%20%28A%20Big%20Piece%20Of%20Garb age%29.mpg</guid>
<pubDate>Wed, 12 May 2010 00:00:00 -0500</pubDate>
<description>
Episode Title: A Big Piece Of Garbage&lt;br /&gt;
Program: Futurama&lt;br /&gt;
Season: S01&lt;br /&gt;
Episode #: E08&lt;br /&gt;&lt;br /&gt;
Fry must prevent a giant ball of garbage launched into space in the 21st century from crashing back into Earth.
</description>
</item>
<item>
<title>Futurama</title>
<link>http://www.thetvdb.com/?tab=series&amp;id=73871</link>
<guid>sftp://root@192.168.1.110/var/lib/mythtv/recordings/Episodes/Futurama/Season%203/Futurama%20S03E04%20%28Parasites%20Lost%29.mpg</guid>
<pubDate>Tue, 11 May 2010 00:00:00 -0500</pubDate>
<description>
Episode Title: Parasites Lost&lt;br /&gt;
Program: Futurama&lt;br /&gt;
Season: S03&lt;br /&gt;
Episode #: E04&lt;br /&gt;&lt;br /&gt;
Fry eats a sandwich infested with worms that make him stronger and smarter.
</description>
</item>
<item>
<title>South Park</title>
<link>http://www.thetvdb.com/?tab=series&amp;id=75897</link>
<guid>sftp://root@192.168.1.110/var/lib/mythtv/recordings/Episodes/South%20Park/Season%2012/South%20Park%20S12E04%20%28Canada%20On%20Strike%29 .mpg</guid>
<pubDate>Mon, 10 May 2010 21:30:00 -0500</pubDate>
<description>
Episode Title: Canada On Strike&lt;br /&gt;
Program: South Park&lt;br /&gt;
Season: S12&lt;br /&gt;
Episode #: E04&lt;br /&gt;&lt;br /&gt;
The head of the World Canadian Bureau leads the country into a strike and the responsibility of brokering a settlement rests with the boys.
</description>
</item>
<item>
<title>Futurama</title>
<link>http://www.thetvdb.com/?tab=series&amp;id=73871</link>
<guid>sftp://root@192.168.1.110/var/lib/mythtv/recordings/Episodes/Futurama/Season%204/Futurama%20S04E08%20%28Godfellas%29.mpg</guid>
<pubDate>Mon, 10 May 2010 20:30:00 -0500</pubDate>
<description>
Episode Title: Godfellas&lt;br /&gt;
Program: Futurama&lt;br /&gt;
Season: S04&lt;br /&gt;
Episode #: E08&lt;br /&gt;&lt;br /&gt;
Swept away into a space vacuum, Bender has a spiritual experience; Fry, Leela and the professor search for Bender as he floats through space.
</description>
</item>
<item>
<title>Futurama</title>
<link>http://www.thetvdb.com/?tab=series&amp;id=73871</link>
<guid>sftp://root@192.168.1.110/var/lib/mythtv/recordings/Episodes/Futurama/Season%205/Futurama%20S05E15%20%28Bender%20Should%20Not%20Be% 20Allowed%20On%20TV%29.mpg</guid>
<pubDate>Mon, 10 May 2010 20:00:00 -0500</pubDate>
<description>
Episode Title: Bender Should Not Be Allowed On TV&lt;br /&gt;
Program: Futurama&lt;br /&gt;
Season: S05&lt;br /&gt;
Episode #: E15&lt;br /&gt;&lt;br /&gt;
Bender stars on the soap opera "All My Circuits."
</description>
</item>
<item>
<title>Futurama</title>
<link>http://www.thetvdb.com/?tab=series&amp;id=73871</link>
<guid>sftp://root@192.168.1.110/var/lib/mythtv/recordings/Episodes/Futurama/Season%202/Futurama%20S02E19%20%28Mothers%20Day%29.mpg</guid>
<pubDate>Sun, 09 May 2010 23:30:00 -0500</pubDate>
<description>
Episode Title: Mothers Day&lt;br /&gt;
Program: Futurama&lt;br /&gt;
Season: S02&lt;br /&gt;
Episode #: E19&lt;br /&gt;&lt;br /&gt;
The founder of Mom's Friendly Robot Co. wants world domination for a Mother's Day gift.
</description>
</item>
</channel>
</rss></div>
It would be easy to port it over to take the input from RDTiburon.com's main web page and have a feed which is 5 items long.

Basically, I'd need some web space and the ability to execute a program on the server... Server must be linux.

If I can use the existing program, I'm sure I could come up with something with tech access. Either way. I'll make it happen.

should be too easy.. this is some code I did to get the front page of Jeremy's SoulHamsters site.. Combine the code from mythicalLibrarian and this and We'd be up in action.

<div class='codetop'>CODE</div><div class='codemain'>adam@adam-desktop:~/.mythicalLibrarian/mythicalSetup$ curl http://www.soulhamsters.com/forum/index.php?| grep "</a>
" |replace "</a>
" "" | replace "&amp;" "&" | replace "<a href=" ""
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 25771 0 25771 0 0 39839 0 --:--:-- --:--:-- --:--:-- 66937
'http://www.soulhamsters.com/forum/index.php?showtopic=1070&view=getnewpost'>Welcome To Soul Hamsters Forum: WoofersInc
'http://www.soulhamsters.com/forum/index.php?showforum=7'>New Member Area/Introduction
'http://www.soulhamsters.com/forum/index.php?showtopic=936&view=getnewpost'>Welcome To Soul Hamsters Forum: shyrobert
'http://www.soulhamsters.com/forum/index.php?showforum=7'>New Member Area/Introduction
'http://www.soulhamsters.com/forum/index.php?showtopic=574&view=getnewpost'>Welcome To Soul Hamsters: ARKCPA
'http://www.soulhamsters.com/forum/index.php?showforum=7'>New Member Area/Introduction
'http://www.soulhamsters.com/forum/index.php?showtopic=1116&view=getnewpost'>Welcome To Soul Hamsters Forum: PJCorey
'http://www.soulhamsters.com/forum/index.php?showforum=7'>New Member Area/Introduction
'http://www.soulhamsters.com/forum/index.php?showtopic=1110&view=getnewpost'>Welcome To Soul Hamsters Forum: rlazaro
'http://www.soulhamsters.com/forum/index.php?showforum=7'>New Member Area/Introduction</div>

DTN

<span style="font-size:14pt;line-height:100%">RSS FEED IS HERE:
http://24.32.42.11:8080/rdrss/rss.xml

<span style="font-size:10pt;line-height:100%">I came up with it today in about an hour. I'll host it until I reboot my media center. Here is the code to reproduce on any Linux/Mac machine.

/usr/local/bin/genrss
<div class='codetop'>CODE</div><div class='codemain'>deleted because it had problems</div></span></span>

DTN

There we go... The code has been revised so that links work

<div class='codetop'>CODE</div><div class='codemain'>#! /bin/bash

#genrss by Adam Outler

#user settings:
scanSite=http://www.rdtiburon.com
scanTimeOut="30"
rssDir="/var/www/rdrss"

maxItems=7 #maximum number of items to read into the feed


#script settings
rssFile="rss.xml"
lineBreak="&lt;br /&gt;"

#make the dir if it does not exist
test ! -d "$rssDir" && mkdir "$rssDir"
doRssGen () {
#First download the front page and then find the relevant entries, parse the HTML, create a file.
curl "$scanSite" >./rssFeed

cat ./rssFeed | grep "</a>
" |sed s/'<\/a><br\/>'/''/g | sed s/"&amp;"/"&"/g | sed s/"<a href="/""/g >./rssData

#test if rssFile directory is writeable
if [ ! -w "$rssDir" ]; then
echo -e "RSS generation failed:\nDirectory not writeable ($rssDir)"
exit 1
fi

#out with the old and in with the new. Don't worry it disappears for .0002 seconds 1:150,000 downtime
rm -f "$rssDir/$rssFile"

#open the RSS file
echo -e '<?xml version="1.0" encoding="ISO-8859-1" ?>' > $rssDir/$rssFile
echo -e '<rss version="2.0">' >> $rssDir/$rssFile
echo -e '<channel>' >> $rssDir/$rssFile
echo -e '\t<title>RD-RSS</title>' >> $rssDir/$rssFile
echo -e '\t<link>http://www.RDTiburon.com</link>' >> $rssDir/$rssFile
echo -e '\t<description>RDTiburon.com RSS Feed</description>' >> $rssDir/$rssFile

#set up forum/topic switch to make them one entry
forumOrTopic=2
#loop through each line of file; all before > is URL; all after > is topic title

while read line
do
itemURL=`echo $line| sed 's/>.*//'`
itemName=`echo "${line#*>}"`
itemURL=`echo "$itemURL"|tr -d "'"`
#setup the switch
test "$forumOrTopic" = "1" && forumOrTopic=2 || forumOrTopic=1
if [ "$forumOrTopic" = "1" ]; then
echo -e "\t\t<item>">>$rssDir/$rssFile
echo -e "\t\t\t<title>$itemName</title>">>$rssDir/$rssFile
echo -e "\t\t\t<link>$itemURL</link>">>$rssDir/$rssFile
echo -e "\t\t\t<guid>http://www.rdtiburon.com</guid>">>$rssDir/$rssFile
echo -e "\t\t\t<pubDate>"`date`"</pubDate>">>$rssDir/$rssFile
echo -e "\t\t\t<description>">>$rssDir/$rssFile
echo -e "\t\t\t\tTopic: $itemName$lineBreak">>$rssDir/$rssFile
fi
if [ "$forumOrTopic" = "2" ]; then
echo -e "\t\t\t\tForum: $itemName">>$rssDir/$rssFile
echo -e "\t\t\t</description>">>$rssDir/$rssFile
echo -e "\t\t</item>">>$rssDir/$rssFile
fi

#close the file.

done <"./rssData"
echo -e '\t</channel>' >> $rssDir/$rssFile
echo -e '</rss>' >> $rssDir/$rssFile
}

#main loop
while [ 1 ]
do
doRssGen
sleep $scanTimeOut
done

exit 0</div>

Now, I cannot host this forever. I told you, the minute I reboot it goes away. Whenever my dynamic IP address changes, then it goes away. It's here temporarily and being hosted on my dedicated media center PC along with a few other local websites. For reliability, this needs to be hosted somewhere with a DNS attachment. If someone would like to lend me DNS services I can add it as a startup item and host it indefinately. However, my media center PC is not a qualified host for something requiring stability.

If supercow can get me DNS I can host it on my linux box. It can be hosted on a mac box. It can be hosted on a windows box with CygWin. The program is small and effective, checks the site and generates a new RSS every 30 seconds.

I'm going on vacation until Thursday. I will leave it running.

majik

I sent Super a PM notifying him of the thread.

With the RSS, can we get it to show the most recent posts (rather than just the thread titles)? It would be more useful for me because I could view the new posts from my phone without having to visit RDT. Not sure if it would be better for everyone, but I like the idea.

DTN

We could, but it will have to load 8 web pages every 30 seconds, all at the same time