Transmissions Framework Manual

Transmissions is a flexible framework for building data processing pipelines using RDF configuration. It enables the creation of modular, composable workflows that can transform, route, and process data through configurable processor chains.

Key Features

• RDF-Based Configuration: Define processing pipelines using RDF/Turtle syntax
• Modular Processors: Extensible library of processing components
• Flow Control: Dynamic routing, conditional logic, and nested execution
• Message-Driven Architecture: Process data through message passing between processors
• Flexible I/O: Support for files, HTTP, SPARQL endpoints, and more

Getting Started

Transmissions processes data by executing transmissions - configured pipelines of processors that transform messages as they flow through the system. Each processor performs a specific operation and passes the result to the next processor in the pipeline.

Manual Contents

Core Concepts

• Architecture & Concepts - Framework architecture, messages, processors, and transmissions
• Basic Pipeline Processing - Understanding simple transmission execution
• Nested Pipeline Processing - Working with nested transmissions and complex workflows

Development Guides

• Creating Applications - How to build complete Transmissions applications
• Creating Processors - How to develop custom processors

Flow Control

• Flow Control Overview - High-level guide to flow control processors and patterns
• GOTO Processor - Dynamic transmission execution and routing

Reference

Additional reference documentation coming soon

Last updated: 2025-01-19

Example

# A simple transmission that processes a file
:my-transmission a :Transmission ;
    :pipe (
        :read-file
        :transform-data
        :write-output
    ) .

:read-file a :FileReader ;
    :settings [ :filename "input.json" ] .

:transform-data a :JSONProcessor ;
    :settings [ :operation "transform" ] .

:write-output a :FileWriter ;
    :settings [ :filename "output.json" ] .

This creates a three-stage pipeline that reads a JSON file, transforms the data, and writes the result to a new file.

Architecture

Transmissions follows a message-driven architecture where:

1. Messages flow through processor pipelines
2. Each processor can modify the message
3. Processors emit results to the next stage
4. Flow control processors enable dynamic routing and conditional logic

The framework supports both simple linear pipelines and complex workflows with branching, merging, and nested execution patterns.