FeedSearchGator Up and Running!


FeedSearchGator is my newest creation based on the fact that there are now literally dozen of search engines that return results as RSS.

What FeedSearchGator does, very simply, is to take your search query that you put on the QueryString, send it out to currently eleven (11) different engines on a threadpool asynchronously, aggregate the results, remove duplicate links, and return a single RSS feed containing up to several hundreds search results that you can subscribe to in your RSS Feed reader. The engines are: feedster.com, search.news.yahoo.com, beta.search.msn.com/news/, moreover.com, blogdigger.com, waypath.com, blogpulse.com, rocketnews (news), rocketnews (blogs) , newsisfree.com,and daypop.com. I am giving my custom threadpool a 20 second WaitAll timeout since occasionally, one or two of these seach engines take a long time to return results (a very long time, too long to wait for a page).

I'm still refining this, but it is fully operational and I'm open to ideas (including marketing ideas) for the concept. The feed results are cached for 12 hours by query, so if your query is something new it can take up to 20 seconds to get back results. Obviously, if your search term is one that's already been run in the last 12 hours, you'll get your results much faster.

I strip out unneccessary HTML tags to keep the "glop" and the bandwidth down, and results are sorted by most recent pubDate first. I've also put in an REL link to a simple XSL transform in the RSS Document which means you can also view this in your browser too.

Currently the engine is set up to insert up to 3 custom advertisements as actual RSS entries, although this feature is currently turned off.

So for example, if I wanted a custom feed on "XMLHTTP" i would point my RSS Reader to:

http://www.myidentityplus.com/feedsearchgator/default.aspx?q=xmlhttp

Enjoy!


Comments

Post a Comment

Popular posts from this blog

Some observations on Script Callbacks, "AJAX", "ATLAS" "AHAB" and where it's all going.

I've taken a more than cursory interest in the whole Remote Scripting (.NET species) vs. AJAX and now ATLAS discussion, mostly because I started using Remote Scripting since Microsoft first released it, and because I continued to refine it after seeing Brent Ashley's excellent work with JSRS, which was one of the first "real" cross-browser solutions back in 2000 (that's the turn of the Century for you history buffs). Now Bertrand Leroy, a Microsoft guy whose work I like , has authored some very interesting ASP.NET 2.0 script callback stuff that he points to on his blog, and he is obviously (at least, to me he is) involved quite heavily in the development of this new ATLAS infrastructure that they'll preview at PDC. Leroy's most recent post brings to the surface what I agree are the major differences between the "AJAX a - la .NET" approach as popularized by Michael Swartz with his AJAX.NET library, and Leroy's RefreshPanel, the ASP.NET 2.0 b
Read more

IE7 - Vista: "Internet Explorer has stopped Working"

Image
This one was a bitch. All of a sudden for no reason at all, out of the blue, I get this dialog "internet Explorer has stopped working". I didn't install any new software, crap- I didn't do anything! So here I am using FIREFART to go on the internet and find out what to do! Damn! Good thing I've got the sucker on the same machine (I'm not "anti-Firefox", i just don't use it that much except to check my page renderings). The Fix The fix (at least for me): 1) Go into Control Panel, and choose "Internet Options". 2) Under the "Advanced" tab, press the "RESET" button at the lower right: Don't ask me why this happens, or why the fix works. That's a BUG, D00D - I don't care how you slice it!
Read more

FIREFOX / IE Word-Wrap, Word-Break, TABLES FIX

One of the most annoying things a developer (who would normally delight in writing code, not futzing with markup) can have is getting rendering issues between different browsers. The two biggest players are of course Internet Exploder and Firefart (as I lovingly like to refer to each). In most cases that's going to take care of 98 percent of your total site traffic. IE has had a proprietary "word-break" style attribute for a long time, and this made it into the CSS 3.0 spec. But that doesn't necessarily help you with Firefox right now. Firefox literally - (and I consider this completely idiotic, since it's been in their bug database for FIVE YEARS) does not have a reliable CSS style element to force table cell content to break in the middle of a word in order to stop the content from expanding your table / div off the page or over other content on the page. Here's a partial fix, which will work for most tables and browsers. The style declaration (I call it m
Read more