Record Class BulkInferenceRunnerConfig

java.lang.Object
java.lang.Record
org.elasticsearch.xpack.esql.inference.bulk.BulkInferenceRunnerConfig
Record Components:
maxOutstandingRequests - The maximum number of concurrent inference requests allowed
maxOutstandingBulkRequests - The maximum number of concurrent bulk inference requests allowed

public record BulkInferenceRunnerConfig(int maxOutstandingRequests, int maxOutstandingBulkRequests) extends Record
Configuration record for inference execution parameters.

This record defines the concurrency and resource limits for inference operations, including the number of worker threads and the maximum number of outstanding requests that can be queued or processed simultaneously.

  • Field Details

    • DEFAULT_MAX_OUTSTANDING_BULK_REQUESTS

      public static final int DEFAULT_MAX_OUTSTANDING_BULK_REQUESTS
      Default number of worker threads for inference execution.
      See Also:
    • DEFAULT_MAX_OUTSTANDING_REQUESTS

      public static final int DEFAULT_MAX_OUTSTANDING_REQUESTS
      Default maximum number of outstanding inference requests.
      See Also:
    • DEFAULT

      public static final BulkInferenceRunnerConfig DEFAULT
      Default configuration instance using standard values for most use cases.
  • Constructor Details

    • BulkInferenceRunnerConfig

      public BulkInferenceRunnerConfig(int maxOutstandingRequests, int maxOutstandingBulkRequests)
      Creates an instance of a BulkInferenceRunnerConfig record class.
      Parameters:
      maxOutstandingRequests - the value for the maxOutstandingRequests record component
      maxOutstandingBulkRequests - the value for the maxOutstandingBulkRequests record component
  • Method Details

    • toString

      public final String toString()
      Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.
      Specified by:
      toString in class Record
      Returns:
      a string representation of this object
    • hashCode

      public final int hashCode()
      Returns a hash code value for this object. The value is derived from the hash code of each of the record components.
      Specified by:
      hashCode in class Record
      Returns:
      a hash code value for this object
    • equals

      public final boolean equals(Object o)
      Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. All components in this record class are compared with '=='.
      Specified by:
      equals in class Record
      Parameters:
      o - the object with which to compare
      Returns:
      true if this object is the same as the o argument; false otherwise.
    • maxOutstandingRequests

      public int maxOutstandingRequests()
      Returns the value of the maxOutstandingRequests record component.
      Returns:
      the value of the maxOutstandingRequests record component
    • maxOutstandingBulkRequests

      public int maxOutstandingBulkRequests()
      Returns the value of the maxOutstandingBulkRequests record component.
      Returns:
      the value of the maxOutstandingBulkRequests record component