Module icu::segmenter::provider

🚧 [Unstable] Data provider struct definitions for this ICU4X component.

🚧 This code is considered unstable; it may change at any time, in breaking or non-breaking ways, including in SemVer minor releases. While the serde representation of data structs is guaranteed to be stable, their Rust representation might not be. Use with caution.

Read more about data providers: icu_provider

Structs

• Baked
  Baked data
• DictionaryForWordLineExtendedV1Marker
  Marker type for UCharDictionaryBreakDataV1: “segmenter/dictionary/wl_ext@1”
• DictionaryForWordOnlyAutoV1Marker
  Marker type for UCharDictionaryBreakDataV1: “segmenter/dictionary/w_auto@1”
• GraphemeClusterBreakDataV2Marker
  Marker type for RuleBreakDataV2: “segmenter/grapheme@2”
• LineBreakDataV2Marker
  Marker type for RuleBreakDataV2: “segmenter/line@2”
• LstmDataFloat32
  The struct that stores a LSTM model.
• LstmForWordLineAutoV1Marker
  Marker type for LstmDataV1: “segmenter/lstm/wl_auto@1”
• LstmMatrix1
  The struct that stores a LSTM’s matrix.
• LstmMatrix2
  The struct that stores a LSTM’s matrix.
• LstmMatrix3
  The struct that stores a LSTM’s matrix.
• RuleBreakDataOverrideV1
  codepoint trie data that the difference by specific locale
• RuleBreakDataV2
  Pre-processed Unicode data in the form of tables to be used for rule-based breaking.
• SentenceBreakDataOverrideV1Marker
  Marker type for RuleBreakDataOverrideV1: “segmenter/sentence/override@1”
• SentenceBreakDataV2Marker
  Marker type for RuleBreakDataV2: “segmenter/sentence@2”
• UCharDictionaryBreakDataV1
  char16trie data for dictionary break
• WordBreakDataOverrideV1Marker
  Marker type for RuleBreakDataOverrideV1: “segmenter/word/override@1”
• WordBreakDataV2Marker
  Marker type for RuleBreakDataV2: “segmenter/word@2”

Enums

• BreakState
  Break state
• LstmDataV1
  The data to power the LSTM segmentation model.
• ModelType
  The type of LSTM model

Constants

• MARKERS
  The latest minimum set of markers required by this component.