Interface RerankingInferenceService


public interface RerankingInferenceService
  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final int
    The default window size for small reranking models (512 input tokens).
  • Method Summary

    Modifier and Type
    Method
    Description
    int
    The reranking model's max window or an approximation of measured in the number of words.
  • Field Details

    • CONSERVATIVE_DEFAULT_WINDOW_SIZE

      static final int CONSERVATIVE_DEFAULT_WINDOW_SIZE
      The default window size for small reranking models (512 input tokens).
      See Also:
  • Method Details

    • rerankerWindowSize

      int rerankerWindowSize(String modelId)
      The reranking model's max window or an approximation of measured in the number of words.
      Parameters:
      modelId - The model ID
      Returns:
      Window size in words