Module org.elasticsearch.xcore
Class DebertaV2Tokenization
java.lang.Object
org.elasticsearch.xpack.core.ml.inference.trainedmodel.Tokenization
org.elasticsearch.xpack.core.ml.inference.trainedmodel.DebertaV2Tokenization
- All Implemented Interfaces:
NamedWriteable,Writeable,org.elasticsearch.xcontent.ToXContent,org.elasticsearch.xcontent.ToXContentObject,NamedXContentObject
-
Nested Class Summary
Nested classes/interfaces inherited from class org.elasticsearch.xpack.core.ml.inference.trainedmodel.Tokenization
Tokenization.SpanSettings, Tokenization.TruncateNested classes/interfaces inherited from interface org.elasticsearch.xcontent.ToXContent
org.elasticsearch.xcontent.ToXContent.DelegatingMapParams, org.elasticsearch.xcontent.ToXContent.MapParams, org.elasticsearch.xcontent.ToXContent.ParamsNested classes/interfaces inherited from interface org.elasticsearch.common.io.stream.Writeable
Writeable.Reader<V>, Writeable.Writer<V> -
Field Summary
FieldsFields inherited from class org.elasticsearch.xpack.core.ml.inference.trainedmodel.Tokenization
DEFAULT_MAX_SEQUENCE_LENGTH, DO_LOWER_CASE, doLowerCase, MAX_SEQUENCE_LENGTH, maxSequenceLength, span, SPAN, truncate, TRUNCATE, UNSET_SPAN_VALUE, WITH_SPECIAL_TOKENS, withSpecialTokensFields inherited from interface org.elasticsearch.xcontent.ToXContent
EMPTY, EMPTY_PARAMS -
Constructor Summary
ConstructorsConstructorDescriptionDebertaV2Tokenization(Boolean doLowerCase, Boolean withSpecialTokens, Integer maxSequenceLength, Tokenization.Truncate truncate, Integer span) -
Method Summary
Modifier and TypeMethodDescriptionstatic org.elasticsearch.xcontent.ConstructingObjectParser<DebertaV2Tokenization, Void> createParser(boolean ignoreUnknownFields) static DebertaV2TokenizationfromXContent(org.elasticsearch.xcontent.XContentParser parser, boolean lenient) getName()Methods inherited from class org.elasticsearch.xpack.core.ml.inference.trainedmodel.Tokenization
createDefault, doLowerCase, equals, getMaxSequenceLength, getSpan, getTruncate, hashCode, maxSequenceLength, toXContent, updateWindowSettings, validateSpanAndMaxSequenceLength, validateSpanAndTruncate, validateVocabulary, withSpecialTokens, writeToMethods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, toString, wait, wait, waitMethods inherited from interface org.elasticsearch.xcontent.ToXContentObject
isFragment
-
Field Details
-
NAME
- See Also:
-
MASK_TOKEN
- See Also:
-
-
Constructor Details
-
DebertaV2Tokenization
public DebertaV2Tokenization(Boolean doLowerCase, Boolean withSpecialTokens, Integer maxSequenceLength, Tokenization.Truncate truncate, Integer span) -
DebertaV2Tokenization
- Throws:
IOException
-
-
Method Details
-
createParser
public static org.elasticsearch.xcontent.ConstructingObjectParser<DebertaV2Tokenization,Void> createParser(boolean ignoreUnknownFields) -
fromXContent
public static DebertaV2Tokenization fromXContent(org.elasticsearch.xcontent.XContentParser parser, boolean lenient) -
getMaskToken
- Specified by:
getMaskTokenin classTokenization
-
getWriteableName
-
getName
- Returns:
- The name of the XContentObject that is to be serialized
-