🤖 Tokenizin

A powerful monorepo of AI development tools designed to enhance your coding workflow. Built with TypeScript and modern best practices.

🚀 Features

• Repository Analysis: Deep analysis of JavaScript/TypeScript codebases
• AI-Ready Output: Structured JSON output perfect for LLM consumption
• Fast & Efficient: Built with performance in mind
• TypeScript Support: First-class TypeScript support with full type definitions

📦 Packages

Package	Description	Version
@tokenizin/ai-repomap	Repository analyzer for AI tools
@tokenizin/config	Shared configurations for TypeScript, ESLint, and Prettier

🛠️ Development

Prerequisites

• Node.js >= 18
• pnpm >= 8

Getting Started

# Clone the repository
git clone https://github.com/tokenizin-agency/aicore.git
cd aicore

# Install dependencies
pnpm install

# Build all packages
pnpm build

Available Scripts

# Build all packages
pnpm build

# Run tests
pnpm test

# Run linting
pnpm lint

# Format code
pnpm format

# Create a changeset
pnpm changeset

# Release packages
pnpm release

📖 Usage

Repository Mapping

# Install globally
npm install -g @tokenizin/ai-repomap

# Run in any repository
tokenizin-repomap

The tool will analyze your repository and output a detailed JSON structure containing:

• File structure
• Function and class definitions
• Import/export relationships
• JSX usage detection
• Git metadata

🤝 Security

Please see our Security Policy for reporting vulnerabilities.

🤝 Contributing

Contributions are welcome! Please read our Contributing Guide for details on our code of conduct and the process for submitting pull requests.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙏 Acknowledgments

• tree-sitter for powerful code parsing
• The TypeScript team for an amazing language
• The pnpm team for efficient package management

---

Made with ❤️ by the Tokenizin team