internal

package
v1.2.2 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Mar 4, 2026 License: MIT Imports: 18 Imported by: 0

Documentation

Index

Constants

View Source 
const (
	// Depth limits for various operations
	MaxDeepMergeDepth = 100 // Maximum depth for deep merge operations
	MaxPathParseDepth = 100 // Maximum depth for path parsing
	MaxNestingDepth   = 200 // Maximum JSON nesting depth for security validation

	// Path and cache limits
	// Note: MaxPathLength is also defined in config.go for the public API
	// Both should be kept in sync (value: 5000)
	MaxCacheKeyLength = 1024 // Maximum cache key length to prevent memory issues
)
View Source 
const (
	FlagIsNegative uint8 = 1 << iota
	FlagIsWildcard
	FlagIsFlat
	FlagHasStart
	FlagHasEnd
	FlagHasStep
)

Bit flags for PathSegment fields to avoid pointer allocations

Variables

View Source 
var (
	// ErrPathNotFound indicates the requested path does not exist
	ErrPathNotFound = errors.New("path not found")
	// ErrTypeMismatch indicates a type mismatch during path navigation
	ErrTypeMismatch = errors.New("type mismatch")
	// ErrInvalidPath indicates an invalid path format
	ErrInvalidPath = errors.New("invalid path")
)
View Source 
var DefaultParallelProcessor = NewParallelProcessor(DefaultParallelConfig())

DefaultParallelProcessor is the default parallel processor

View Source 
var FastBufferPool = sync.Pool{
	New: func() any {
		return bytes.NewBuffer(make([]byte, 0, 512))
	},
}

FastBufferPool is a pool of byte buffers for fast encoding

View Source 
var GlobalKeyIntern = NewKeyIntern()

GlobalKeyIntern is the global key interner

View Source 
var GlobalPathIntern = NewPathIntern(50000)

GlobalPathIntern is the global path interner

View Source 
var GlobalStringIntern = NewStringIntern(10 * 1024 * 1024) // 10MB max

GlobalStringIntern is the default string interner

Functions

func ArrayItemKey added in v1.2.0 

func ArrayItemKey(item any) string

ArrayItemKey generates a unique key for array item deduplication

func BatchIntern added in v1.2.0 

func BatchIntern(strings []string) []string

BatchIntern interns multiple strings at once More efficient than calling Intern multiple times due to reduced lock overhead

func BatchInternKeys added in v1.2.0 

func BatchInternKeys(keys []string) []string

BatchInternKeys interns multiple keys at once using the key interner

func BytesToString added in v1.2.0 

func BytesToString(b []byte) string

BytesToString converts a byte slice to a string. SECURITY FIX: Uses standard library conversion for safety. Note: For performance-critical code where the caller guarantees the slice won't be modified, consider using a separate unsafe version with clear documentation.

func ChunkArrayOptimized added in v1.2.0 

func ChunkArrayOptimized(arr []any, chunkSize int) [][]any

ChunkArrayOptimized splits array into chunks

func CompactArrayOptimized added in v1.2.0 

func CompactArrayOptimized(arr []any) []any

CompactArrayOptimized removes null and empty values from array with pooling

func ContainsAnyByte added in v1.2.0 

func ContainsAnyByte(s, chars string) bool

ContainsAnyByte checks if string contains any of the specified bytes This is faster than strings.ContainsAny for single-byte character sets

func CreatePathError added in v1.2.0 

func CreatePathError(path string, operation string, err error) error

CreatePathError creates a path-specific error

func DeepMerge added in v1.2.0 

func DeepMerge(base, override any) any

DeepMerge recursively merges two JSON values using union merge strategy - If both values are objects, recursively merge their keys - If both values are arrays, merge with deduplication (union) - For all other cases (primitives), value2 takes precedence

func EncodeFast added in v1.2.0 

func EncodeFast(v any, buf *bytes.Buffer) bool

EncodeFast attempts to encode a primitive value directly to a buffer PERFORMANCE: Inline encoding for primitives avoids reflection and allocations Returns true if the value was encoded, false if it needs standard encoding

func EscapeJSONPointer added in v1.1.0 

func EscapeJSONPointer(s string) string

EscapeJSONPointer escapes special characters for JSON Pointer Uses single-pass algorithm to avoid multiple allocations

func FastMarshal added in v1.2.0 

func FastMarshal(v any) ([]byte, error)

FastMarshal marshals a value to JSON using the fast encoder

func FastMarshalToString added in v1.2.0 

func FastMarshalToString(v any) (string, error)

FastMarshalToString marshals a value to a JSON string

func FastParseFloat added in v1.2.0 

func FastParseFloat(b []byte) (float64, error)

FastParseFloat parses a float from a byte slice

func FastParseInt added in v1.2.0 

func FastParseInt(b []byte) (int64, error)

FastParseInt parses an integer from a byte slice PERFORMANCE: Avoids string allocation by parsing directly from bytes SECURITY FIX: Proper overflow detection for both positive and negative numbers

func FilterArrayOptimized added in v1.2.0 

func FilterArrayOptimized(arr []any, predicate func(any) bool) []any

FilterArrayOptimized filters array with a predicate function using pooling

func FlattenArray added in v1.2.0 

func FlattenArray(arr []any) []any

FlattenArray flattens a nested array structure

func FlattenArrayOptimized added in v1.2.0 

func FlattenArrayOptimized(arr []any) []any

FlattenArrayOptimized flattens nested arrays with pooling

func FormatNumberForDedup added in v1.2.0 

func FormatNumberForDedup(f float64) string

FormatNumberForDedup formats a number for deduplication key generation

func GetByteSlice added in v1.2.0 

func GetByteSlice() *[]byte

GetByteSlice gets a byte slice from the pool PERFORMANCE: Reusable byte slices for encoding operations

func GetEncoderBuffer added in v1.2.0 

func GetEncoderBuffer() *bytes.Buffer

GetEncoderBuffer gets a buffer from the pool

func GetFastBuffer added in v1.2.0 

func GetFastBuffer() *bytes.Buffer

GetFastBuffer gets a buffer from the pool

func GetPooledSlice added in v1.2.0 

func GetPooledSlice() *[]any

GetPooledSlice gets a pooled slice for array operations

func GetSafeArrayElement added in v1.0.7 

func GetSafeArrayElement(arr []any, index int) (any, bool)

func HasComplexSegments added in v1.2.0 

func HasComplexSegments(segments []PathSegment) bool

HasComplexSegments checks if any segment is complex (slice or extract)

func IndexIgnoreCase added in v1.2.0 

func IndexIgnoreCase(s, pattern string) int

IndexIgnoreCase finds a pattern in s case-insensitively without allocation This is a shared utility function used by multiple packages for security pattern matching

func IntToStringFast added in v1.2.0 

func IntToStringFast(n int) string

IntToStringFast converts an integer to string using pre-computed values PERFORMANCE: Avoids strconv.Itoa allocations for values 0-99

func InternKey added in v1.2.0 

func InternKey(key string) string

InternKey interns a JSON key using the global key interner

func InternKeyBytes added in v1.2.0 

func InternKeyBytes(b []byte) string

InternKeyBytes interns a JSON key from bytes

func InternString added in v1.2.0 

func InternString(s string) string

InternString interns a string using the global string interner

func InternStringBytes added in v1.2.0 

func InternStringBytes(b []byte) string

InternStringBytes interns a string from bytes

func IsArrayPath added in v1.2.0 

func IsArrayPath(path string) bool

IsArrayPath checks if a path contains array access

func IsArrayType added in v1.2.0 

func IsArrayType(data any) bool

IsArrayType checks if data is an array type

func IsComplexPath added in v1.2.0 

func IsComplexPath(path string) bool

IsComplexPath checks if a path contains complex patterns Optimized: single scan instead of multiple Contains calls

func IsDigit added in v1.2.0 

func IsDigit(c byte) bool

IsDigit reports whether the character is a digit

func IsDistributedOperationPath added in v1.2.0 

func IsDistributedOperationPath(path string) bool

IsDistributedOperationPath checks if a path contains distributed operation patterns

func IsDistributedOperationSegment added in v1.2.0 

func IsDistributedOperationSegment(segment PathSegment) bool

IsDistributedOperationSegment checks if a segment triggers distributed operations

func IsDotNotationPath added in v1.2.0 

func IsDotNotationPath(path string) bool

IsDotNotationPath checks if a path uses dot notation format

func IsExtractionPath added in v1.2.0 

func IsExtractionPath(path string) bool

IsExtractionPath checks if a path contains extraction syntax

func IsJSONArray added in v1.2.0 

func IsJSONArray(data any) bool

IsJSONArray checks if data is a JSON array ([]any)

func IsJSONObject added in v1.2.0 

func IsJSONObject(data any) bool

IsJSONObject checks if data is a JSON object (map[string]any)

func IsJSONPointerPath added in v1.2.0 

func IsJSONPointerPath(path string) bool

IsJSONPointerPath checks if a path uses JSON Pointer format

func IsJSONPrimitive added in v1.2.0 

func IsJSONPrimitive(data any) bool

IsJSONPrimitive checks if data is a JSON primitive type

func IsMapType added in v1.2.0 

func IsMapType(data any) bool

IsMapType checks if data is a map type

func IsMatchPatternIgnoreCase added in v1.2.0 

func IsMatchPatternIgnoreCase(s, pattern string) bool

IsMatchPatternIgnoreCase is the exported version for use by other packages

func IsNilOrEmpty added in v1.2.0 

func IsNilOrEmpty(data any) bool

IsNilOrEmpty checks if a value is nil or empty

func IsObjectType added in v1.2.0 

func IsObjectType(data any) bool

IsObjectType checks if data is an object type

func IsSlicePath added in v1.2.0 

func IsSlicePath(path string) bool

IsSlicePath checks if a path contains slice notation

func IsSpace added in v1.2.0 

func IsSpace(c byte) bool

IsSpace reports whether the character is a JSON whitespace character

func IsValidArrayIndex added in v1.2.0 

func IsValidArrayIndex(index string) bool

IsValidArrayIndex checks if a string is a valid array index

func IsValidIndex added in v1.0.7 

func IsValidIndex(index, length int) bool

func IsValidJSONNumber added in v1.2.0 

func IsValidJSONNumber(s string) bool

IsValidJSONNumber validates if a string represents a valid JSON number format according to RFC 8259. Supports integers, decimals, and scientific notation.

func IsValidJSONPrimitive added in v1.2.0 

func IsValidJSONPrimitive(s string) bool

IsValidJSONPrimitive checks if a string represents a valid JSON primitive (true, false, null, or number)

func IsValidNumberString added in v1.2.0 

func IsValidNumberString(s string) bool

IsValidNumberString checks if a string represents a valid number

func IsValidPropertyName added in v1.2.0 

func IsValidPropertyName(name string) bool

IsValidPropertyName checks if a name is a valid property name

func IsValidSliceRange added in v1.2.0 

func IsValidSliceRange(rangeStr string) bool

IsValidSliceRange checks if a range string is a valid slice range

func IsValidUTF8 added in v1.2.0 

func IsValidUTF8(b []byte) bool

IsValidUTF8 checks if a byte slice is valid UTF-8

func IsWordChar added in v1.2.0 

func IsWordChar(c byte) bool

IsWordChar returns true if the character is part of a word (alphanumeric or underscore)

func MapArrayOptimized added in v1.2.0 

func MapArrayOptimized(arr []any, transform func(any) any) []any

MapArrayOptimized transforms array elements using pooling

func MarshalJSON added in v1.2.0 

func MarshalJSON(value any, pretty bool, prefix, indent string) (string, error)

MarshalJSON marshals a value to JSON string with optional pretty printing

func MergeObjects added in v1.2.0 

func MergeObjects(obj1, obj2 map[string]any) map[string]any

MergeObjects merges two objects, with the second object taking precedence

func NeedsDotBefore added in v1.2.0 

func NeedsDotBefore(prevChar rune) bool

NeedsDotBefore determines if a dot should be inserted before a character

func NeedsDotBeforeByte added in v1.2.0 

func NeedsDotBeforeByte(prevChar byte) bool

NeedsDotBeforeByte determines if a dot should be inserted before a character (byte version for ASCII fast path)

func NeedsPathPreprocessing added in v1.2.0 

func NeedsPathPreprocessing(path string) bool

NeedsPathPreprocessing checks if a path needs preprocessing before parsing

func NewPathError added in v1.2.0 

func NewPathError(path, message string, err error) error

NewPathError creates a new path error

func NormalizeIndex added in v1.0.7 

func NormalizeIndex(index, length int) int

func NormalizePathSeparators added in v1.2.0 

func NormalizePathSeparators(path string) string

NormalizePathSeparators removes duplicate dots and trims leading/trailing dots Optimized: single-pass construction using strings.Builder

func NormalizeSlice added in v1.0.7 

func NormalizeSlice(start, end, length int) (int, int)

func ParseAndValidateArrayIndex added in v1.1.0 

func ParseAndValidateArrayIndex(s string, arrayLength int) (int, bool)

ParseAndValidateArrayIndex parses a string as an array index and validates it against array length Returns the index and true if successful, 0 and false otherwise

func ParseArrayIndex added in v1.0.7 

func ParseArrayIndex(property string) (int, bool)

func ParseIntFast added in v1.2.0 

func ParseIntFast(s string) (int, bool)

ParseIntFast parses a string as an integer without using strconv PERFORMANCE: Avoids strconv.Atoi allocation for common cases SECURITY: Proper overflow detection for both 32-bit and 64-bit systems Returns (value, true) if successful, (0, false) otherwise

func ParseSliceComponents added in v1.0.7 

func ParseSliceComponents(slicePart string) (start, end, step *int, err error)

func PerformArraySlice added in v1.0.7 

func PerformArraySlice(arr []any, start, end, step *int) []any

PerformArraySlice performs Python-style array slicing with optimized capacity calculation

func PreprocessPath added in v1.2.0 

func PreprocessPath(path string, sb *strings.Builder) string

PreprocessPath adds dots before brackets/braces where needed

func PutByteSlice added in v1.2.0 

func PutByteSlice(b *[]byte)

PutByteSlice returns a byte slice to the pool

func PutEncoder added in v1.2.0 

func PutEncoder(e *FastEncoder)

PutEncoder returns an encoder to the appropriate pool PERFORMANCE: Use tiered pools - buffers > 64KB are discarded to prevent memory bloat

func PutEncoderBuffer added in v1.2.0 

func PutEncoderBuffer(buf *bytes.Buffer)

PutEncoderBuffer returns a buffer to the pool

func PutFastBuffer added in v1.2.0 

func PutFastBuffer(buf *bytes.Buffer)

PutFastBuffer returns a buffer to the pool

func PutPooledSlice added in v1.2.0 

func PutPooledSlice(s *[]any)

PutPooledSlice returns a slice to the pool

func ReconstructPath added in v1.2.0 

func ReconstructPath(segments []PathSegment) string

ReconstructPath reconstructs a path string from segments

func ReverseArray added in v1.2.0 

func ReverseArray(arr []any)

ReverseArray reverses an array in place

func ReverseArrayOptimized added in v1.2.0 

func ReverseArrayOptimized(arr []any)

ReverseArrayOptimized reverses array in place

func StringToBytes added in v1.2.0 

func StringToBytes(s string) []byte

StringToBytes converts string to []byte Using standard conversion for safety and compatibility

func TakeFirst added in v1.2.0 

func TakeFirst(arr []any, n int) []any

TakeFirst returns first n elements

func TakeLast added in v1.2.0 

func TakeLast(arr []any, n int) []any

TakeLast returns last n elements

func TryConvertToArray added in v1.2.0 

func TryConvertToArray(m map[string]any) ([]any, bool)

TryConvertToArray attempts to convert a map to an array if it has numeric keys

func UnescapeJSONPointer added in v1.1.0 

func UnescapeJSONPointer(s string) string

UnescapeJSONPointer unescapes JSON Pointer special characters Uses single-pass algorithm to avoid multiple allocations

func UniqueArray added in v1.2.0 

func UniqueArray(arr []any) []any

UniqueArray removes duplicate values from an array

func UniqueArrayOptimized added in v1.2.0 

func UniqueArrayOptimized(arr []any) []any

UniqueArrayOptimized removes duplicates from array using map for O(n) lookup

func ValidatePath added in v1.0.7 

func ValidatePath(path string) error

ValidatePath validates a path string for security and correctness Uses single-pass validation for optimal performance (no regex) PERFORMANCE: Added fast path for simple property paths

func WrapError added in v1.2.0 

func WrapError(err error, context string) error

WrapError wraps an error with context

Types

type CacheConfig added in v1.0.10 

type CacheConfig interface {
	IsCacheEnabled() bool
	GetMaxCacheSize() int
	GetCacheTTL() time.Duration
}

CacheConfig provides the configuration needed by CacheManager This minimal interface avoids circular dependencies with the main json package

type CacheManager 

type CacheManager struct {
	// contains filtered or unexported fields
}

CacheManager handles all caching operations with performance and memory management

func NewCacheManager 

func NewCacheManager(config CacheConfig) *CacheManager

NewCacheManager creates a new cache manager with sharding

func (*CacheManager) CleanExpiredCache 

func (cm *CacheManager) CleanExpiredCache()

CleanExpiredCache removes expired entries from all shards (with goroutine limit)

func (*CacheManager) Clear added in v1.0.6 

func (cm *CacheManager) Clear()

Clear removes all entries from the cache

func (*CacheManager) Close added in v1.2.2 

func (cm *CacheManager) Close()

Close gracefully shuts down the cache manager, waiting for cleanup goroutines to complete

func (*CacheManager) Delete added in v1.0.6 

func (cm *CacheManager) Delete(key string)

Delete removes a value from the cache

func (*CacheManager) Get 

func (cm *CacheManager) Get(key string) (any, bool)

Get retrieves a value from cache with O(1) complexity PERFORMANCE: Optimized to minimize lock contention - Uses RLock for the common fast path - Only upgrades to Lock when TTL expiration needs cleanup - LRU position update is deferred to reduce write lock frequency

func (*CacheManager) GetStats 

func (cm *CacheManager) GetStats() CacheStats

GetStats returns cache statistics

func (*CacheManager) Set 

func (cm *CacheManager) Set(key string, value any)

Set stores a value in the cache

type CacheStats 

type CacheStats struct {
	Entries          int64
	TotalMemory      int64
	HitCount         int64
	MissCount        int64
	HitRatio         float64
	MemoryEfficiency float64
	Evictions        int64
	ShardCount       int
}

CacheStats represents cache statistics

type CheckResult 

type CheckResult struct {
	Healthy bool   `json:"healthy"`
	Message string `json:"message"`
}

CheckResult represents the result of a single health check

type ChunkProcessor added in v1.2.0 

type ChunkProcessor struct {
	// contains filtered or unexported fields
}

ChunkProcessor processes data in chunks for memory efficiency

func NewChunkProcessor added in v1.2.0 

func NewChunkProcessor(chunkSize int) *ChunkProcessor

NewChunkProcessor creates a new chunk processor

func (*ChunkProcessor) ProcessMap added in v1.2.0 

func (cp *ChunkProcessor) ProcessMap(m map[string]any, fn func(chunk map[string]any) error) error

ProcessMap processes a map in chunks

func (*ChunkProcessor) ProcessSlice added in v1.2.0 

func (cp *ChunkProcessor) ProcessSlice(arr []any, fn func(chunk []any) error) error

ProcessSlice processes a slice in chunks

type CompiledPath added in v1.2.0 

type CompiledPath struct {
	// contains filtered or unexported fields
}

CompiledPath represents a pre-parsed JSON path ready for fast operations

func CompilePath added in v1.2.0 

func CompilePath(path string) (*CompiledPath, error)

CompilePath parses and compiles a JSON path string into a CompiledPath The returned CompiledPath can be reused for multiple operations

func CompilePathUnsafe added in v1.2.0 

func CompilePathUnsafe(path string) (*CompiledPath, error)

CompilePathUnsafe compiles a path without validation Use only when the path is known to be safe

func (*CompiledPath) Exists added in v1.2.0 

func (cp *CompiledPath) Exists(data any) bool

Exists checks if a value exists at the compiled path

func (*CompiledPath) Get added in v1.2.0 

func (cp *CompiledPath) Get(data any) (any, error)

Get retrieves a value from parsed JSON data using the compiled path

func (*CompiledPath) GetFromRaw added in v1.2.0 

func (cp *CompiledPath) GetFromRaw(raw []byte) (any, error)

GetFromRaw retrieves a value from raw JSON bytes using the compiled path

func (*CompiledPath) Hash added in v1.2.0 

func (cp *CompiledPath) Hash() uint64

Hash returns the pre-computed hash of the path

func (*CompiledPath) IsEmpty added in v1.2.0 

func (cp *CompiledPath) IsEmpty() bool

IsEmpty returns true if the path has no segments

func (*CompiledPath) Len added in v1.2.0 

func (cp *CompiledPath) Len() int

Len returns the number of segments in the path

func (*CompiledPath) Path added in v1.2.0 

func (cp *CompiledPath) Path() string

Path returns the original path string

func (*CompiledPath) Release added in v1.2.0 

func (cp *CompiledPath) Release()

Release returns the CompiledPath to the pool Do not use the CompiledPath after calling Release

func (*CompiledPath) Segments added in v1.2.0 

func (cp *CompiledPath) Segments() []PathSegment

Segments returns the parsed path segments

func (*CompiledPath) String added in v1.2.0 

func (cp *CompiledPath) String() string

String returns the path string representation

type CompiledPathCache added in v1.2.0 

type CompiledPathCache struct {
	// contains filtered or unexported fields
}

CompiledPathCache caches compiled paths for reuse

func GetGlobalCompiledPathCache added in v1.2.0 

func GetGlobalCompiledPathCache() *CompiledPathCache

GetGlobalCompiledPathCache returns the global compiled path cache

func NewCompiledPathCache added in v1.2.0 

func NewCompiledPathCache(max int) *CompiledPathCache

NewCompiledPathCache creates a new compiled path cache

func (*CompiledPathCache) Clear added in v1.2.0 

func (c *CompiledPathCache) Clear()

Clear clears the cache

func (*CompiledPathCache) Get added in v1.2.0 

func (c *CompiledPathCache) Get(path string) (*CompiledPath, error)

Get retrieves a compiled path from the cache, compiling it if not found

func (*CompiledPathCache) Size added in v1.2.0 

func (c *CompiledPathCache) Size() int

Size returns the number of cached paths

type CompiledPathError added in v1.2.0 

type CompiledPathError struct {
	Path    string
	Message string
	Err     error
}

CompiledPathError represents an error during compiled path operations

func (*CompiledPathError) Error added in v1.2.0 

func (e *CompiledPathError) Error() string

Error implements the error interface

func (*CompiledPathError) Unwrap added in v1.2.0 

func (e *CompiledPathError) Unwrap() error

Unwrap returns the underlying error

type ExtractionGroup added in v1.2.0 

type ExtractionGroup struct {
	Segments []PathSegment
}

ExtractionGroup represents a group of consecutive extraction segments used for processing complex extraction patterns in JSON paths.

func DetectConsecutiveExtractions added in v1.2.0 

func DetectConsecutiveExtractions(segments []PathSegment) []ExtractionGroup

DetectConsecutiveExtractions identifies groups of consecutive extraction segments. This is useful for processing complex extraction patterns where multiple extractions need to be processed together.

type FastEncoder added in v1.2.0 

type FastEncoder struct {
	// contains filtered or unexported fields
}

FastEncoder provides fast JSON encoding without reflection for common types

func GetEncoder added in v1.2.0 

func GetEncoder() *FastEncoder

GetEncoder retrieves an encoder from the pool

func GetEncoderWithSize added in v1.2.0 

func GetEncoderWithSize(hint int) *FastEncoder

GetEncoderWithSize retrieves an encoder with appropriate capacity hint PERFORMANCE: Use tiered pools for better memory management and reduced allocations

func (*FastEncoder) Bytes added in v1.2.0 

func (e *FastEncoder) Bytes() []byte

Bytes returns the encoded bytes

func (*FastEncoder) EncodeArray added in v1.2.0 

func (e *FastEncoder) EncodeArray(arr []any) error

EncodeArray encodes a []any

func (*FastEncoder) EncodeBase64 added in v1.2.0 

func (e *FastEncoder) EncodeBase64(b []byte)

EncodeBase64 encodes a []byte as base64 string

func (*FastEncoder) EncodeBool added in v1.2.0 

func (e *FastEncoder) EncodeBool(b bool)

EncodeBool encodes a boolean

func (*FastEncoder) EncodeFloat added in v1.2.0 

func (e *FastEncoder) EncodeFloat(n float64, bits int)

EncodeFloat encodes a floating point number PERFORMANCE: Uses pre-computed common values and fast integer conversion SECURITY: Special values (NaN, Inf) are encoded as null for JSON compatibility

func (*FastEncoder) EncodeFloat32Slice added in v1.2.0 

func (e *FastEncoder) EncodeFloat32Slice(arr []float32)

EncodeFloat32Slice encodes a []float32 PERFORMANCE: Specialized encoder avoids interface conversion overhead

func (*FastEncoder) EncodeFloatSlice added in v1.2.0 

func (e *FastEncoder) EncodeFloatSlice(arr []float64)

EncodeFloatSlice encodes a []float64

func (*FastEncoder) EncodeInt added in v1.2.0 

func (e *FastEncoder) EncodeInt(n int64)

EncodeInt encodes an integer PERFORMANCE: Uses pre-computed lookup tables for integers -999 to 9999

func (*FastEncoder) EncodeInt32Slice added in v1.2.0 

func (e *FastEncoder) EncodeInt32Slice(arr []int32)

EncodeInt32Slice encodes a []int32 PERFORMANCE: Specialized encoder avoids interface conversion overhead

func (*FastEncoder) EncodeInt64Slice added in v1.2.0 

func (e *FastEncoder) EncodeInt64Slice(arr []int64)

EncodeInt64Slice encodes a []int64

func (*FastEncoder) EncodeIntSlice added in v1.2.0 

func (e *FastEncoder) EncodeIntSlice(arr []int)

EncodeIntSlice encodes a []int

func (*FastEncoder) EncodeMap added in v1.2.0 

func (e *FastEncoder) EncodeMap(m map[string]any) error

EncodeMap encodes a map[string]any

func (*FastEncoder) EncodeMapStringFloat64 added in v1.2.0 

func (e *FastEncoder) EncodeMapStringFloat64(m map[string]float64) error

EncodeMapStringFloat64 encodes a map[string]float64

func (*FastEncoder) EncodeMapStringInt added in v1.2.0 

func (e *FastEncoder) EncodeMapStringInt(m map[string]int) error

EncodeMapStringInt encodes a map[string]int

func (*FastEncoder) EncodeMapStringInt64 added in v1.2.0 

func (e *FastEncoder) EncodeMapStringInt64(m map[string]int64) error

EncodeMapStringInt64 encodes a map[string]int64

func (*FastEncoder) EncodeMapStringString added in v1.2.0 

func (e *FastEncoder) EncodeMapStringString(m map[string]string) error

EncodeMapStringString encodes a map[string]string

func (*FastEncoder) EncodeString added in v1.2.0 

func (e *FastEncoder) EncodeString(s string)

EncodeString encodes a JSON string PERFORMANCE: Avoids reflection, uses inline escaping

func (*FastEncoder) EncodeStringSlice added in v1.2.0 

func (e *FastEncoder) EncodeStringSlice(arr []string)

EncodeStringSlice encodes a []string

func (*FastEncoder) EncodeTime added in v1.2.0 

func (e *FastEncoder) EncodeTime(t time.Time)

EncodeTime encodes a time.Time in RFC3339 format

func (*FastEncoder) EncodeUint added in v1.2.0 

func (e *FastEncoder) EncodeUint(n uint64)

EncodeUint encodes an unsigned integer PERFORMANCE: Uses pre-computed lookup tables for integers 0-9999

func (*FastEncoder) EncodeUint64Slice added in v1.2.0 

func (e *FastEncoder) EncodeUint64Slice(arr []uint64)

EncodeUint64Slice encodes a []uint64

func (*FastEncoder) EncodeValue added in v1.2.0 

func (e *FastEncoder) EncodeValue(v any) error

EncodeValue encodes any value to JSON Uses fast paths for common types, falls back to stdlib for complex types

func (*FastEncoder) Reset added in v1.2.0 

func (e *FastEncoder) Reset()

Reset clears the encoder buffer

type HealthChecker 

type HealthChecker struct {
	// contains filtered or unexported fields
}

HealthChecker provides health checking functionality for the JSON processor

func NewHealthChecker 

func NewHealthChecker(metrics *MetricsCollector, config *HealthCheckerConfig) *HealthChecker

NewHealthChecker creates a new health checker with optional custom thresholds

func (*HealthChecker) CheckHealth 

func (hc *HealthChecker) CheckHealth() HealthStatus

CheckHealth performs health checks and returns overall status

type HealthCheckerConfig added in v1.0.7 

type HealthCheckerConfig struct {
	MaxMemoryBytes      uint64
	MaxErrorRatePercent float64
}

HealthCheckerConfig holds configuration for health checker

type HealthStatus 

type HealthStatus struct {
	Timestamp time.Time              `json:"timestamp"`
	Healthy   bool                   `json:"healthy"`
	Checks    map[string]CheckResult `json:"checks"`
}

HealthStatus represents the health status of the processor

func (*HealthStatus) GetFailedChecks 

func (hs *HealthStatus) GetFailedChecks() []string

GetFailedChecks returns a list of failed health check names

func (*HealthStatus) GetSummary 

func (hs *HealthStatus) GetSummary() string

GetSummary returns a formatted summary of the health status

type InternStats added in v1.2.0 

type InternStats struct {
	Entries   int
	Size      int64
	Hits      int64
	Misses    int64
	Evictions int64
}

Stats returns statistics about the string intern

type KeyIntern added in v1.2.0 

type KeyIntern struct {
	// contains filtered or unexported fields
}

KeyIntern is a specialized interner for JSON keys Uses sharding for better concurrent performance with hot key cache

func NewKeyIntern added in v1.2.0 

func NewKeyIntern() *KeyIntern

NewKeyIntern creates a new sharded key interner with 64 shards

func (*KeyIntern) Clear added in v1.2.0 

func (ki *KeyIntern) Clear()

Clear removes all interned keys

func (*KeyIntern) GetStats added in v1.2.0 

func (ki *KeyIntern) GetStats() KeyInternStats

GetStats returns current statistics

func (*KeyIntern) Intern added in v1.2.0 

func (ki *KeyIntern) Intern(key string) string

Intern returns an interned version of the key PERFORMANCE: First checks hot key cache (lock-free), then falls back to sharded lookup SECURITY FIX: Added memory-based eviction when shard exceeds maxShardSize

func (*KeyIntern) InternBytes added in v1.2.0 

func (ki *KeyIntern) InternBytes(b []byte) string

InternBytes returns an interned string from a byte slice SECURITY: Added empty slice check to prevent panic

type KeyInternStats added in v1.2.0 

type KeyInternStats struct {
	ShardCount  int
	HotKeyCount int64
}

Stats returns statistics about the key interner

type Metrics 

type Metrics struct {
	// Operation metrics
	TotalOperations int64 `json:"total_operations"`
	SuccessfulOps   int64 `json:"successful_ops"`
	FailedOps       int64 `json:"failed_ops"`
	CacheHits       int64 `json:"cache_hits"`
	CacheMisses     int64 `json:"cache_misses"`

	// Performance metrics
	TotalProcessingTime time.Duration `json:"total_processing_time"`
	AvgProcessingTime   time.Duration `json:"avg_processing_time"`
	MaxProcessingTime   time.Duration `json:"max_processing_time"`
	MinProcessingTime   time.Duration `json:"min_processing_time"`

	// Memory metrics
	TotalMemoryAllocated int64 `json:"total_memory_allocated"`
	PeakMemoryUsage      int64 `json:"peak_memory_usage"`
	CurrentMemoryUsage   int64 `json:"current_memory_usage"`

	// Concurrency metrics
	ActiveConcurrentOps int64 `json:"active_concurrent_ops"`
	MaxConcurrentOps    int64 `json:"max_concurrent_ops"`

	// Runtime metrics
	RuntimeMemStats runtime.MemStats `json:"runtime_mem_stats"`
	Uptime          time.Duration    `json:"uptime"`
	ErrorsByType    map[string]int64 `json:"errors_by_type"`
}

Metrics represents collected performance metrics

type MetricsCollector 

type MetricsCollector struct {
	// contains filtered or unexported fields
}

MetricsCollector collects and provides performance metrics for the JSON processor

func NewMetricsCollector 

func NewMetricsCollector() *MetricsCollector

NewMetricsCollector creates a new metrics collector

func (*MetricsCollector) EndConcurrentOperation 

func (mc *MetricsCollector) EndConcurrentOperation()

EndConcurrentOperation records the end of a concurrent operation

func (*MetricsCollector) GetMetrics 

func (mc *MetricsCollector) GetMetrics() Metrics

GetMetrics returns current metrics with runtime stats

func (*MetricsCollector) GetSummary 

func (mc *MetricsCollector) GetSummary() string

GetSummary returns a formatted summary of metrics

func (*MetricsCollector) RecordCacheHit 

func (mc *MetricsCollector) RecordCacheHit()

RecordCacheHit records a cache hit

func (*MetricsCollector) RecordCacheMiss 

func (mc *MetricsCollector) RecordCacheMiss()

RecordCacheMiss records a cache miss

func (*MetricsCollector) RecordError 

func (mc *MetricsCollector) RecordError(errorType string)

RecordError records an error by type

func (*MetricsCollector) RecordOperation 

func (mc *MetricsCollector) RecordOperation(duration time.Duration, success bool, memoryUsed int64)

RecordOperation records a completed operation

func (*MetricsCollector) Reset 

func (mc *MetricsCollector) Reset()

Reset resets all metrics

func (*MetricsCollector) StartConcurrentOperation 

func (mc *MetricsCollector) StartConcurrentOperation()

StartConcurrentOperation records the start of a concurrent operation

func (*MetricsCollector) UpdateMemoryUsage added in v1.0.6 

func (mc *MetricsCollector) UpdateMemoryUsage(current int64)

UpdateMemoryUsage updates memory usage metrics

type ParallelConfig added in v1.2.0 

type ParallelConfig struct {
	Workers     int // Number of worker goroutines
	BatchSize   int // Items per batch
	MinParallel int // Minimum items to trigger parallel processing
	MaxWorkers  int // Maximum number of workers (0 = no limit, default 64)
}

ParallelConfig holds configuration for parallel operations

func DefaultParallelConfig added in v1.2.0 

func DefaultParallelConfig() ParallelConfig

DefaultParallelConfig returns the default parallel configuration

type ParallelMapResult added in v1.2.0 

type ParallelMapResult struct {
	Key   string
	Value any
	Index int
}

ParallelMapResult represents a result from parallel map processing

type ParallelProcessor added in v1.2.0 

type ParallelProcessor struct {
	// contains filtered or unexported fields
}

ParallelProcessor handles parallel batch operations

func NewParallelProcessor added in v1.2.0 

func NewParallelProcessor(config ParallelConfig) *ParallelProcessor

NewParallelProcessor creates a new parallel processor

func (*ParallelProcessor) ParallelFilter added in v1.2.0 

func (pp *ParallelProcessor) ParallelFilter(arr []any, predicate func(value any) bool) []any

ParallelFilter filters slice elements in parallel

func (*ParallelProcessor) ParallelForEach added in v1.2.0 

func (pp *ParallelProcessor) ParallelForEach(arr []any, fn func(index int, value any) error) error

ParallelForEach iterates over slice elements in parallel The function is called concurrently, ensure thread safety

func (*ParallelProcessor) ParallelForEachMap added in v1.2.0 

func (pp *ParallelProcessor) ParallelForEachMap(m map[string]any, fn func(key string, value any) error) error

ParallelForEachMap iterates over map entries in parallel

func (*ParallelProcessor) ParallelMap added in v1.2.0 

func (pp *ParallelProcessor) ParallelMap(m map[string]any, fn func(key string, value any) (any, error)) (map[string]any, error)

ParallelMap processes map entries in parallel

func (*ParallelProcessor) ParallelSlice added in v1.2.0 

func (pp *ParallelProcessor) ParallelSlice(arr []any, fn func(index int, value any) (any, error)) ([]any, error)

ParallelSlice processes slice elements in parallel

func (*ParallelProcessor) ParallelTransform added in v1.2.0 

func (pp *ParallelProcessor) ParallelTransform(arr []any, transform func(value any) any) []any

ParallelTransform transforms slice elements in parallel

type ParallelSliceResult added in v1.2.0 

type ParallelSliceResult struct {
	Index int
	Value any
}

ParallelSliceResult represents a result from parallel slice processing

type PathIntern added in v1.2.0 

type PathIntern struct {
	// contains filtered or unexported fields
}

PathIntern caches parsed path segments with their string representations

func NewPathIntern added in v1.2.0 

func NewPathIntern(maxSize int) *PathIntern

NewPathIntern creates a new path interner

func (*PathIntern) Clear added in v1.2.0 

func (pi *PathIntern) Clear()

Clear removes all cached paths

func (*PathIntern) Get added in v1.2.0 

func (pi *PathIntern) Get(path string) ([]PathSegment, bool)

Get retrieves cached path segments

func (*PathIntern) Set added in v1.2.0 

func (pi *PathIntern) Set(path string, segments []PathSegment)

Set stores path segments in cache

type PathSegment 

type PathSegment struct {
	Type  PathSegmentType
	Key   string // Used for PropertySegment and ExtractSegment
	Index int    // Used for ArrayIndexSegment and slice start
	End   int    // Direct value (was *int) for ArraySliceSegment
	Step  int    // Direct value (was *int) for ArraySliceSegment
	Flags uint8  // Bit-packed flags
}

PathSegment represents a single segment in a JSON path Optimized to avoid pointer allocations by using direct values and bit flags

func NewArrayIndexSegment 

func NewArrayIndexSegment(index int) PathSegment

NewArrayIndexSegment creates an array index access segment

func NewArraySliceSegment 

func NewArraySliceSegment(start, end, step int, hasStart, hasEnd, hasStep bool) PathSegment

NewArraySliceSegment creates an array slice access segment Now accepts direct values instead of pointers to avoid heap allocations

func NewExtractSegment 

func NewExtractSegment(extract string) PathSegment

NewExtractSegment creates an extraction segment

func NewPropertySegment 

func NewPropertySegment(key string) PathSegment

NewPropertySegment creates a property access segment

func ParseArraySegment added in v1.2.0 

func ParseArraySegment(part string, segments []PathSegment) []PathSegment

ParseArraySegment parses array access segments like [0], [1:3], etc.

func ParseComplexSegment added in v1.0.7 

func ParseComplexSegment(part string) ([]PathSegment, error)

ParseComplexSegment parses a complex segment that may contain mixed syntax

func ParseExtractionSegment added in v1.2.0 

func ParseExtractionSegment(part string, segments []PathSegment) []PathSegment

ParseExtractionSegment parses extraction segments like {key}, {flat:key}, etc.

func ParsePath added in v1.0.7 

func ParsePath(path string) ([]PathSegment, error)

ParsePath parses a JSON path string into segments

func ParsePathSegment added in v1.2.0 

func ParsePathSegment(part string, segments []PathSegment) []PathSegment

ParsePathSegment parses a single path segment and appends to segments slice

func SplitPathIntoSegments added in v1.2.0 

func SplitPathIntoSegments(path string, segments []PathSegment) []PathSegment

SplitPathIntoSegments splits a path into segments by dots

func (PathSegment) GetArrayIndex 

func (ps PathSegment) GetArrayIndex(arrayLength int) (int, error)

GetArrayIndex returns the array index, handling negative indices

func (*PathSegment) GetEnd added in v1.2.0 

func (ps *PathSegment) GetEnd() (int, bool)

GetEnd returns the end value and whether it was set

func (*PathSegment) GetStart added in v1.2.0 

func (ps *PathSegment) GetStart() (int, bool)

GetStart returns the start value and whether it was set

func (*PathSegment) GetStep added in v1.2.0 

func (ps *PathSegment) GetStep() (int, bool)

GetStep returns the step value and whether it was set

func (*PathSegment) HasEnd added in v1.2.0 

func (ps *PathSegment) HasEnd() bool

HasEnd returns true if slice has an end value

func (*PathSegment) HasStart added in v1.2.0 

func (ps *PathSegment) HasStart() bool

HasStart returns true if slice has a start value

func (*PathSegment) HasStep added in v1.2.0 

func (ps *PathSegment) HasStep() bool

HasStep returns true if slice has a step value

func (PathSegment) IsArrayAccess 

func (ps PathSegment) IsArrayAccess() bool

IsArrayAccess returns true if this segment accesses an array

func (*PathSegment) IsFlatExtract added in v1.2.0 

func (ps *PathSegment) IsFlatExtract() bool

IsFlatExtract returns true for flat extraction

func (*PathSegment) IsNegativeIndex added in v1.2.0 

func (ps *PathSegment) IsNegativeIndex() bool

IsNegativeIndex returns true if Index is negative

func (*PathSegment) IsWildcardSegment added in v1.2.0 

func (ps *PathSegment) IsWildcardSegment() bool

IsWildcardSegment returns true for WildcardSegment

func (PathSegment) String 

func (ps PathSegment) String() string

String returns a string representation of the path segment

func (PathSegment) TypeString 

func (ps PathSegment) TypeString() string

TypeString returns the string type for the segment

type PathSegmentType 

type PathSegmentType int

PathSegmentType represents the type of path segment 

const (
	PropertySegment PathSegmentType = iota
	ArrayIndexSegment
	ArraySliceSegment
	WildcardSegment
	RecursiveSegment
	FilterSegment
	ExtractSegment // For extract operations
)

func (PathSegmentType) String 

func (pst PathSegmentType) String() string

String returns the string representation of PathSegmentType

type StringIntern added in v1.2.0 

type StringIntern struct {
	// contains filtered or unexported fields
}

StringIntern stores interned strings for reuse

func NewStringIntern added in v1.2.0 

func NewStringIntern(maxSize int64) *StringIntern

NewStringIntern creates a new string interner with a maximum size

func (*StringIntern) Clear added in v1.2.0 

func (si *StringIntern) Clear()

Clear removes all interned strings

func (*StringIntern) GetStats added in v1.2.0 

func (si *StringIntern) GetStats() InternStats

GetStats returns current statistics including eviction count

func (*StringIntern) Intern added in v1.2.0 

func (si *StringIntern) Intern(s string) string

Intern returns an interned version of the string If the string is already interned, returns the existing copy Otherwise, stores and returns a copy of the string SECURITY: Fixed race condition and memory exhaustion with proactive eviction at 80% PERFORMANCE: Uses pooled buffers for string copying

func (*StringIntern) InternBytes added in v1.2.0 

func (si *StringIntern) InternBytes(b []byte) string

InternBytes returns an interned string from a byte slice SECURITY: Added empty slice check to prevent panic

type StructFieldInfo added in v1.2.0 

type StructFieldInfo struct {
	Index     int
	Name      string
	OmitEmpty bool
	EncodeFn  func(*FastEncoder, reflect.Value) error // Type-specific encoder
	Offset    uintptr                                 // Field offset for direct access
	Type      reflect.Type                            // Cached type information
	IsPointer bool                                    // Whether the field is a pointer type
}

StructFieldInfo contains cached information about a struct field

func GetStructEncoder added in v1.2.0 

func GetStructEncoder(t reflect.Type) []StructFieldInfo

GetStructEncoder gets cached struct field info PERFORMANCE: Generates type-specific encoding functions for known types

type WorkerPool added in v1.2.0 

type WorkerPool struct {
	// contains filtered or unexported fields
}

WorkerPool manages a pool of worker goroutines

func NewWorkerPool added in v1.2.0 

func NewWorkerPool(workers int) *WorkerPool

NewWorkerPool creates a new worker pool

func (*WorkerPool) Stop added in v1.2.0 

func (wp *WorkerPool) Stop()

Stop stops the worker pool

func (*WorkerPool) Submit added in v1.2.0 

func (wp *WorkerPool) Submit(task func()) bool

Submit adds a task to the pool Returns true if task was submitted/executed, false if pool was stopped SECURITY FIX: Returns status instead of silently dropping tasks

func (*WorkerPool) SubmitWait added in v1.2.2 

func (wp *WorkerPool) SubmitWait(task func()) error

SubmitWait adds a task and blocks until submitted (but not necessarily completed) Returns error if pool is stopped

func (*WorkerPool) Wait added in v1.2.0 

func (wp *WorkerPool) Wait()

Wait waits for all tasks to complete SECURITY FIX: Always acquire lock to avoid race with Broadcast PERFORMANCE: Uses condition variable instead of busy-wait for efficient CPU usage

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.