Tasks

Operation of the File-chunk connectors (source and sink) is free for single-task configuration. The source connector operates one task to chunk files and produce the chunks to a topic. The sink connector operates one task to consume from the same topic. One partition is used for all file chunks messages.

Multiple source connectors or sink connectors can run (in single-task) mode using the same topic, or multiple topics. If tasks.max is inadvertently set higher than 1 (for the single-task edition) then it is automatically reset to 1.

If tuning options are exhausted and higher throughput is desired, an enterprise edition that supports unlimited scalability using multiple tasks and multiple partitions is available.