feat: Add NSFW/privacy content filtering and semantic classification
- Add NSFW/privacy boolean fields to models (providers.json, rotations.json, autoselect.json) - Implement content classification using last 3 messages for performance - Add semantic classification with hybrid BM25 + sentence-transformer re-ranking - Update autoselect handler to support classify_semantic flag - Add new semantic_classifier.py module with hybrid search capabilities - Update dashboard templates to manage new configuration fields - Update documentation (README.md, DOCUMENTATION.md) with new features - Bump version to 0.6.0 in pyproject.toml and setup.py - Add new dependencies: sentence-transformers, rank-bm25 - Update package configuration for PyPI distribution
Showing
aisbf/classifier.py
0 → 100644
This diff is collapsed.
aisbf/semantic_classifier.py
0 → 100644
| ... | @@ -13,6 +13,8 @@ langchain-text-splitters | ... | @@ -13,6 +13,8 @@ langchain-text-splitters |
| tiktoken | tiktoken | ||
| torch | torch | ||
| transformers | transformers | ||
| sentence-transformers | |||
| rank-bm25 | |||
| jinja2 | jinja2 | ||
| itsdangerous | itsdangerous | ||
| bs4 | bs4 | ||
| ... | ... |
Please
register
or
sign in
to comment