Adding a Web Feed Source

<< Click to Display Table of Contents >>

Navigation:  »No topics above this level«

Adding a Web Feed Source

Return to chapter overview

The WebFeed source reads a web-based data feed, such as an RSS or ATOM feed. It tails this feed and parses results into a columned stream, using the xpath syntax. For more information on xpath, see https://en.wikipedia.org/wiki/XPath.

As with the Local Log File source, you first add and then configure the source.

To add a Web Feed source:

1.On the Sources page, drag a Web Feed source from the left column into the center area.
2.Click the newly added Web Feed source.

The Edit Web Feed Source page opens.

3.Enter schema and stream information. Schema indicates where in s-Server the stream will reside. You can also choose to create a new schema for the source's stream by selecting the Create Schema? option.
4.Enter a URL for the RSS or ATOM feed. You can verify this feed by clicking the Sample 5 Rows from Source button. This brings up the initial five rows of data for the web feed.

web_feed_source

5.At the bottom of the page (you may need to scroll down), enter column information for the feed. You need to enter the following
a.A column name as it will appear in StreamLab
b.The namespace name for the column from the feed.

You can also choose to enter a type for the column. By default, type is VARCHAR(1024).

sl_columns_webfeed

6.Test the source by clicking the Sample 5 Rows from Source button.
6.When you have finished, click the name of your project to save the source. The web feed source will now be available to guides in StreamLab.
7.To parse the web feed, add a guide using the newly added Web Feed source.

Option

Description

Required

Default

Schema for stream

Schema in which new stream will reside

 

 

Name of stream

Name of stream to be generated from web feed.

Y

 

Create Schema

Whether or not you create a new schema for the WebFeed source.

N

N

URL

Base URL for web feed.

Y

 

MIN_SLEEP_INTERVAL

Minimum sleep interval between fetches, in milliseconds.

N

60000 (one minute)

MAX_SLEEP_INTERVAL

Maximum sleep interval between fetches, in milliseconds.

N

3600000 (one hour)

FEED_FORMAT

Specifies type of web feed to be tailed. For this release, options are "RSS" and "Atom".

Y