feat(filter): preserve important comments for AI context & multi-area improvements

[saoqixiaomm]

Summary

• MinimalFilter comment preservation: Instead of stripping all comments, the minimal filter now preserves comments containing important markers (TODO, FIXME, NOTE, HACK, BUG, WARNING, SECURITY, PERF, WHY, etc.). This gives AI agents better context when reading filtered code. Unknown file types are now handled conservatively (no comment patterns assumed) to avoid stripping semantically important content.

• TOML filter safety rail: Added ERROR_SIGNAL_RE check to prevent success short-circuit messages (e.g., "ok") from being emitted when the raw output clearly contains error signals (error, failed, panic, traceback, etc.).

• Config defaults raised: Increased status_max_files 15→30, status_max_untracked 10→20, passthrough_max_chars 2000→6000 to keep more context in AI/code-review workflows.

• Analytics improvements: Adaptive precision for percentage formatting, comma-separated exact token counts alongside compact notation, and separate tracking of token-tracked vs passthrough/fallback commands in rtk gain.

• Codex session support: rtk session / rtk discover now parse Codex (~/.codex/sessions/) JSONL logs alongside Claude Code logs. Supports exec_command / function_call_output event types and session_meta CWD-based project filtering.

• Registry hardening: Improved shell tokenizer to handle variable assignments, command substitutions, heredocs, and complex quoting — reducing false-positive rewrite suggestions.

• New TOML filter: poetry-api-test (tail-based, strips ANSI, keeps last 10 lines).

• Codex awareness hook: Expanded guidance to prefer RTK-native commands and the rtk proxy <cmd> | rtk tail pattern for bounded output.

Test plan

• All 1308 tests pass (cargo test --all)
• cargo fmt --all --check passes
• cargo clippy --all-targets — 0 errors, 4 pre-existing warnings
• No company/personal information in diff (sanitized test fixtures)
• Manual: rtk read -l minimal <file> preserves TODO/FIXME comments
• Manual: rtk gain shows token-tracked vs passthrough breakdown

Made with Cursor

[saoqixiaomm]

@aeppling Hi! Could you please review this PR when you have a moment?

This PR improves the MinimalFilter to preserve important comments (TODO/FIXME/NOTE/etc.) for AI context, adds a TOML filter safety rail against false-positive success messages, raises config defaults for richer AI workflows, and adds Codex session log support to rtk discover/session. All 1308 tests pass.

Thanks!

[CLAassistant]

All committers have signed the CLA.

[saoqixiaomm]

recheck