Adding a Line Source

<< Click to Display Table of Contents >>

Navigation:  »No topics above this level«

Adding a Line Source

Return to chapter overview

StreamLab lets you access files line-by-line over the file system, network socket, AMQP, or Kafka.

To add a Line source:

1.On the Sources page, drag a Line source from the left column into the center area.

2.Click the new Line source.

The Edit Line Source page opens.

3.By default, StreamLab uses the project schema for the new source. You can also select a schema from the pulldown menu on the left.


4.Select a stream from the pulldown menu on the right. This is the stream into which lines from the Line source will be read.

5.Select File System, Socket, AMQP 0.9.1, AMQP 1.0, or Kafka.

6.Next, enter information in some or all of the following fields. These change depending on your choice of access. For example, for file system, enter the following:

Directory. The file system path to the Line file, such as /var/log/file.Line

File Pattern. Java Regular Expression used to identify the file. Test the source by clicking the Sample 5 Rows from Source button.

5.Test the source by clicking the Sample 5 Rows from Source button.

6.Click the Go Up arrow to exit the Edit Source page.


7.To parse the line file, add a guide using the newly added Line source.