Package org.elasticsearch.xpack.esql.datasources

Class AsyncConnectorSourceOperatorFactory

java.lang.Object

org.elasticsearch.xpack.esql.datasources.AsyncConnectorSourceOperatorFactory

All Implemented Interfaces:

Describable, Operator.OperatorFactory, SourceOperator.SourceOperatorFactory

public class AsyncConnectorSourceOperatorFactory
extends Object
implements SourceOperator.SourceOperatorFactory

Source-operator factory that executes a connector query on a background thread and feeds pages into an AsyncExternalSourceBuffer for the driver to consume.

Two execution modes, selected based on whether a ExternalSliceQueue is supplied:

• Slice-queue mode — iterates each ExternalSplit pulled from the queue and executes it via Connector.execute(QueryRequest, ExternalSplit), sharing a single row budget across splits.
• Single-shot mode — executes the request exactly once using Split.SINGLE via Connector.execute(QueryRequest, Split).

The producer runs as a flat state machine (see runProducerLoop(org.elasticsearch.xpack.esql.datasources.AsyncConnectorSourceOperatorFactory.ProducerState, org.elasticsearch.action.ActionListener<java.lang.Void>)) driven by a single ProducerState instance — no CPS recursion, no per-split trampoline. The drain is fully non-blocking: it runs synchronously while the buffer has space and yields the producer thread when full, resuming via the executor when space is freed.

See Also:

• AsyncExternalSourceBuffer
• AsyncExternalSourceOperator

Constructor Summary

Constructors

Constructor	Description
AsyncConnectorSourceOperatorFactory(Connector connector, QueryRequest baseRequest, int maxBufferSize, Executor executor)
AsyncConnectorSourceOperatorFactory(Connector connector, QueryRequest baseRequest, int maxBufferSize, Executor executor, ExternalSliceQueue sliceQueue)

Method Summary

Modifier and Type	Method	Description
String	describe()
SourceOperator	get(DriverContext driverContext)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AsyncConnectorSourceOperatorFactory

public AsyncConnectorSourceOperatorFactory(Connector connector,
 QueryRequest baseRequest,
 int maxBufferSize,
 Executor executor,
 @Nullable
 ExternalSliceQueue sliceQueue)

AsyncConnectorSourceOperatorFactory

public AsyncConnectorSourceOperatorFactory(Connector connector,
 QueryRequest baseRequest,
 int maxBufferSize,
 Executor executor)

Method Details

get

public SourceOperator get(DriverContext driverContext)

Specified by:

get in interface Operator.OperatorFactory

Specified by:

get in interface SourceOperator.SourceOperatorFactory

describe

public String describe()

Specified by:

describe in interface Describable