Record Class Tokenizer.Encoding

java.lang.Object
java.lang.Record
ai.beestream.jitnn.nn.text.Tokenizer.Encoding
Enclosing class:
Tokenizer

public static record Tokenizer.Encoding(int[] ids, int[] typeIds, String[] tokens) extends Record
The ids, type ids and tokens of one text (or pair), special tokens included.
  • Constructor Summary

    Constructors
    Constructor
    Description
    Encoding(int[] ids, int[] typeIds, String[] tokens)
    Creates an instance of a Encoding record class.
  • Method Summary

    Modifier and Type
    Method
    Description
    final boolean
    Indicates whether some other object is "equal to" this one.
    final int
    Returns a hash code value for this object.
    int[]
    ids()
    Returns the value of the ids record component.
    Returns the value of the tokens record component.
    final String
    Returns a string representation of this record class.
    int[]
    Returns the value of the typeIds record component.

    Methods inherited from class Object

    clone, finalize, getClass, notify, notifyAll, wait, wait, wait
  • Constructor Details

    • Encoding

      public Encoding(int[] ids, int[] typeIds, String[] tokens)
      Creates an instance of a Encoding record class.
      Parameters:
      ids - the value for the ids record component
      typeIds - the value for the typeIds record component
      tokens - the value for the tokens record component
  • Method Details

    • toString

      public final String toString()
      Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.
      Specified by:
      toString in class Record
      Returns:
      a string representation of this object
    • hashCode

      public final int hashCode()
      Returns a hash code value for this object. The value is derived from the hash code of each of the record components.
      Specified by:
      hashCode in class Record
      Returns:
      a hash code value for this object
    • equals

      public final boolean equals(Object o)
      Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. All components in this record class are compared with Objects::equals(Object,Object).
      Specified by:
      equals in class Record
      Parameters:
      o - the object with which to compare
      Returns:
      true if this object is the same as the o argument; false otherwise.
    • ids

      public int[] ids()
      Returns the value of the ids record component.
      Returns:
      the value of the ids record component
    • typeIds

      public int[] typeIds()
      Returns the value of the typeIds record component.
      Returns:
      the value of the typeIds record component
    • tokens

      public String[] tokens()
      Returns the value of the tokens record component.
      Returns:
      the value of the tokens record component