normalizer

package
v0.0.0-...-6e91ce5 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Dec 1, 2025 License: MIT Imports: 4 Imported by: 0

Documentation

Overview

Package normalizer provides text normalization for sensitive word detection Creator: Done-0 Created: 2025-01-15

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func IsVariantLoaded

func IsVariantLoaded() bool

func LoadVariantMap

func LoadVariantMap(path string) error

Types

type Normalizer

type Normalizer struct {
	// contains filtered or unexported fields
}

func New

func New(variant, caseSensitive bool) *Normalizer

func (*Normalizer) Normalize

func (n *Normalizer) Normalize(text string) string

func (*Normalizer) ToRunes

func (n *Normalizer) ToRunes(text string, buf []rune) []rune

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL