March 19, 2003

Sister Open Source States

During the past four years, Utah and about half the other states have cooperatively developed State Government Information Locater Services. Within this group of states, about eight, with the assistance of the State of Washington State Library, have developed search engines using Microsoft Site Server technology. I noticed today that Rhode Island has joined Oregon, Utah, and New Mexico in having their state portal powered by their State Library's Find-It search. Rhode Island, in fact, pioneered the use of MS Find-It. It was their Secretary of State's Office and State Library that sponsored the original Find-It programming that was later shared with us and other states. This spirit of cooperative open source development continues.

Rhode Island, under Jim Willis, their Director of eGovernment for the Secretary of State, has recently won several awards for outstanding open source egovernment innovations. It's great to see how their PHP/mySQL CMS is used to power their press releases. Like Rhode Island, Utah is a NIC state, and local affliate, Utah Interactive, Inc., is developing open source RSS technologies for press releases.

Utah also has agencies experimenting with the Zope application server and Plone CMS. They have been greatly impressed with Texas Governor Rick Perry's application of Zope/Plone at his website.

The Hawaii Information and Communication Services Division is using this same technology for their new intranet portal and has a video presentation of their project.

Oregon joins these state in promoting the use of open source in state government as evidenced through their legislature's proposed Open Source Software for Oregon Act (House Bill 2892).

Former Utah CIO, Phil Windley, has been promoting the use of Open Source this week at the Washington, DC eGovOS conference and his presentation and running commentary at his website is highly recommended.

Posted by Ray_Matthews at 04:40 PM | Comments (0)

EGovernment News Archives

Those monitoring U.S. eGovernment progress and news should take a look at Multimedia Victoria, the Victorian Government's Repository of eGovernment Resources. Of particular note is its archives of State Government websites and egovernment reports. To find such a great resource down under doesn't surprise me knowing how advanced the governments of Australia, New Zealand, and Tasmania are in global information architecture.

Posted by Ray_Matthews at 03:18 PM | Comments (0)

March 14, 2003

Let RSS Power Your Email Marketing

With the proliferation of government web portals and pages, it is becoming ever more necessary for agencies to reach their customers by email. You can no longer even expect your most devoted readers to visit your web sites on a regular basis. One of my web hosters made a major service change several months ago but never notified their customers by email. The notice was only on their website, and then in a place only accessible by password. When I suggested yesterday to their sales rep that email notices were preferable and that the company could provide them at no additional cost, she was incredulous.

Even when governments and businesses do market news and services by email, they're usually using mailing lists and e-newsletters. I subscribe, for example, to newsletters about Utah travel and events, and I get email news of newly posted court opinions and administrative rules. I bet that in every state there are hundreds of these kinds of lists. The problem is that the public cannot easily learn of their existence and they are relatively time intensive for us to prepare and distribute.

Using RSS, customers can more easily find and subscribe to our syndicated news, and we can eliminate all the extra processes needed to prepare information or repackage it for email delivery. As one who has managed 30 simultaneous mailing lists, I know. In a few days from now, I'd like to begin sharing with you some methods of using RSS technologies to automate the process of email news publishing. If you have a method that works for you, please write me, Ray Matthews, and let's share it.

Posted by Ray_Matthews at 09:08 AM | Comments (1)

March 04, 2003

Four Models for Aggregating and Publishing RSS Headlines

The State of Utah is reviewing options for creating, aggregating, and publishing news from state agencies. The decision of which technology to use to create RSS feeds can be made independent to the decision regarding a technology for aggregating and publishing (parsing) the feeds. I'll address the later first and write about the creation/CMS end tomorrow. There seems to me to be at least four models for aggregating and publishing RSS headlines. This lengthy article describes these four models with examples of each.....

Publishing Aggregated News on a Single Topic from Multiple Sources

The American Homeowners Resource Center is a great example of a content managed site that provides resources and collaborative tools for getting things done. It has a News page that presents a newspaper-like presentation of headlines linked to full stories. It also streams a channel of "Breaking News" in a side-column on every page. Its news is limited to the topic of the site and appears to be selected and submitted manually and then reviewed for inclusion by the site's editors. The success of this depends to a great degree on the care given to selecting or filtering headlines for inclusion. Moreover is one such successful aggregator that has for several years created hundreds topical feeds aggregated from numerous business and news sources.


Aggregating and Presenting News in Multiple Channels

The next step beyond presenting a single feed is presenting multiple channels, usually in a predefined number of headlines per channel. The Novell Portal Server provides this kind of RSS support, allowing the user to select a number channels to display. This is usually effective only for monitoring a small set of channels that are usually related in some way.

Dave Winer's Weblogs at Harvard is an example of this kind of aggregation using the Radio Userland News Aggregator. Conceivably, a government agency could present a few feeds of particular interest to their visitors. Add a lot of feeds, though, and you can see from this example how this kind of aggregation can easily get out of control. I don't think this approach will go anywhere considering the sophistication now built into news readers such as NetNewsWire, NewsMonster, and NewZCrawler.


Aggregating and Filtering News in Pre-selected Categories and Channels

I have two examples to illustrate this. The first is Network World Fusion.

This site, created by Adam Gaffin with Percussion Rhythmyx content management software pulls XML content stored in database and presents it using XSL style sheets. Feeds are created with Movable Type and the data , as we speak, is being moved from two Oracle databases into mySQL. News is aggregated and filtered in categories related to networking from three publishers (Network World, Network World Fusion and the IDG News Service) and results are presented in four different views.

The Daily News view presents all of the day's "top" Enterprise Network News aggregated from their dozen or so feeds. The front page has headlines, links, and descriptions for the first five headlines with a link to the full article, where following the article, they stream the "breaking news" for the category. The top page then flows just the headlines for 20 or so more articles of lesser note. In a similar fashion, they provide aggregations of Remote Networking News and Service Provider Network news. They call each of these three displays "channels" and articles are associated with one or more channel through the use of a channel metatag.

News by Vendor presents hundreds of articles from the category of vendor news sortable either by relevance or date. They make a practice of naming companies in headlines to allow you to find news about specific companies. The list provides the headlines, link to full article, date, url, and the first 100 characters from the article.

Newsletter Archives is an index page that provides access to lists or newsletters similar to the News by Vendor for about 25 other categories.

This Week in Print is an online version of a sectional print publication complete with frontpage news, reviews, columns, news of lesser note, and links to past issues. It displays the headline, link, and description for each article in the issue.

My second interesting example of aggregation and filtering is Julian Bond.s and Glenn Watkins' Ecademy: The E-Business Network. It is completely Open Source using PHP, the Drupal content management system, and MySQL.

Latest News are headlines that link to articles arranged chronologically, newest to oldest. News by Source are parsed headlines for each of more than 100 feeds, not too unlike Dave Winer's Harvard Aggregator. This view shows channel title, channel description, a link to a page that parses each channel, and a link to the RSS feed for each channel.

News by Topic are aggregated "bundles" for eight topic categories. In Drupal you have feeds and bundles. �Feeds define news sources and bundles categories syndicated content by source, topic or any other heuristic. �Bundles provide a generalized way of creating composite feeds. �They allow you, for example, to combine various business related feeds into one bundle called "Business". You can have any number of government agencies providing news feeds. �

You can add a feed by clicking the "add feed" link on the import administration pages. Give the feed a name, supply the URI and a comma-separated list of attributes that you want to associate the feed with. �The update interval defines how often Drupal should go out to try and grab fresh content. �The expiration time defines how long syndicated content is kept in the database. �So set the update and expiration time and save your settings. �You have just defined your first feed. If you have more feeds repeat as necessary. To verify whether your feed works, press "update items" at the overview page. The number of news items that have been successfully fetched, should then become visible in the third column of the feed overview.

Now you have to define some bundles. Bundles look for feeds that contain one of the keywords associated with the bundle and display those feeds together. To define a bundle you have to give it a name and a comma-separated list of keywords just like in the case for feeds. Your newly created bundle will now show up in the list of blocks that you can see at the block related administration pages. There you can customize where and when your bundles will be displayed. Julian Bond's Voidstar is another site that uses this same Drupal News Aggregator module.


Aggregating, Filtering, and Customizing News by User Defined Queries

Going back to Network World Fusion, if you look a little deeper, you'll discover that you can use their metatag "tuned" Verity Ultraseek (formerly Inktomi Enterprise Search) site search engine to create RSS channels for search terms (topics, companies, author, etc) of your choosing.

To do this you have to do a bit of a hack. You take their search's query string, i.e.

http://search.nwfusion.com/diy/query.html?col=archive1&qt=keywords%3A%22KEYWORD%22&dt=in&inthe=7776000&nh=5&rf=1&lk=1&st=1

and replace KEYWORD in this string with the keyword(s) or phrase, in lowercase, that you want to use to create your custom RSS feed.

The keywords should match those that the publisher has put into the article's "keywords" metatag. So for example, if you wanted a channel to keep you informed by Adam Gaffin's articles about webbloging, you could replace KEYWORD with gaffin+webblogs.

The first step, though, is to enter Ultraseek queries +keywords:webblogs and +author:gaffin to see if these term actually shows up in the database as a metatag. They do, so we're in luck.

We make the substitutions and now have:

http://search.nwfusion.com/diy/query.html?col=archive1&qt=keywords%3A%22weblogs&qt=author%3A%22gaffin%22&dt=in&inthe=7776000&nh=5&rf=1&lk=1&st=1

Load this into your browser's address field and it loads the channel producing a page, in this case, with four results. You can now cut and paste it into a RSS parser and clean it up a bit by adding a channel title and description.

If you want to, you can drop out the metatags (i.e. keywords%3A and author%3A) so that it will search the full text of the articles for terms.

For more magical tips about creating channels using metatags in query strings see Adam's article Do-It-Yourself RSS Feed. Since all State of Utah agencies put metatags such as author and keywords into their pages (don't they), and since we now have a search engine that can pass terms in query strings, we may be able to do something similar to create custom RSS feeds.

Something to consider is that there are several services that now construct RSS feeds directly from search queries. This includes Chris Ridings' Fresh Search and Julian Bond's free php script, GNews2RSS for creating an instant clipping service by performing a Google News search and turning the results into an RSS feed.

Posted by Ray_Matthews at 11:26 PM | Comments (1)

New RSS Developments

There has been significant developments in the world of RSS in the past two weeks.

There are several services that now construct RSS feeds directly from search queries (eg. Chris Ridings' Fresh Search). There is a movement to combine RSS news aggregation directly with web browsing (eg. Kevin A. Burton's NewsMonster), and there are multi-efforts to combine the trackback, referrer capabilities of RSS with searching.

Google purchased the Blogger technology less than two weeks ago. Already they are experimenting with combining PageRank with RSS technologies. WebQuotes is an early attempt on their part to allow you to search for annotations on the web. It allows you to read the descriptions about links and learn what others are saying about resources that interest you. I'm sure this is only the beginning.

Posted by Ray_Matthews at 08:37 AM | Comments (0)