StreamLab lets you access files line-by-line over the file system, network socket, AMQP, or Kafka.
To add a Line source:
|1.||On the Sources page, drag a Line source from the left column into the center area.|
|2.||Click the new Line source. |
The Edit Line Source page opens.
|3.||By default, StreamLab uses the for the new source. You can also select a schema from the pulldown menu on the left.|
|4.||Select a stream from the pulldown menu on the right. This is the stream into which lines from the Line source will be read.|
|5.||Select File System, Socket, AMQP 0.9.1, AMQP 1.0, or Kafka.|
|6.||Next, enter information in some or all of the following fields. These change depending on your choice of access. For example, for file system, enter the following:|
Directory. The file system path to the Line file, such as /var/log/file.Line
File Pattern. Java Regular Expression used to identify the file. Test the source by clicking the Sample 5 Rows from Source button.
|6.||Click the Go Up arrow to exit the Edit Source page.|
|7.||To parse the line file, add a guide using the newly added Line source.|