Tok - Estimador de tokens
Herramienta de estimación de tokens sub-microsegundos que soporta 100+ modelos de IA. Maneja prompts de escala MB con dependencias mínimas y fórmula de promedio para compatibilidad entre modelos.
2025•AI Innovation•Publicado
Características clave
- ✓Multi-provider support: 'OpenAI, Anthropic, OpenRouter, Llama models'
- ✓Enterprise features: Per-million token pricing with separate prompt/completion rates
- ✓Lightweight design: Minimal dependencies for maximum performance
Impacto
- **Sub-microsecond performance** for instant token estimation
- **100+ model support** through averaging formula approach
- **MB-scale prompt handling** with minimal dependencies
- **20MB size reduction** by removing TIC token dependency
- **Developer Efficiency**: Instant cost visibility prevents budget overruns
- **Enterprise Ready**: Supports programmatic budget management
- **Global Adoption**: Used worldwide via npm registry
- **Performance Optimization**: Trade-off of precision for significant performance gains
Tecnología Stack
Pila principal
TypeScriptJavaScriptNode.js
- TypeScript/JavaScript
- Node.js 18.0.0+
- Plugin-based provider system
- Averaging formula for token estimation
Etiquetas
AItoken-estimationcost-optimizationLLM-costssub-microsecondmulti-providerlightweightOpenAIAnthropicClaudeGPT-4developer-toolsnpm-package