3 Commits

Author	SHA1	Message	Date
Goon	93860714f1	fix(skills): update skill-creator paths and metadata for GoClaw (#168) ... Align skill-creator with GoClaw conventions: update skill store paths to ~/.goclaw/skills-store/, fix author metadata, remove external Claude Code references, update publish_skill documentation.	2026-03-12 18:35:35 +07:00
Viet Tran	ace07509b7	feat(skills): system skills integration — toggle, dep checking, per-item install (#161) ... * feat(infra): add runtime package support for skills Install nodejs, npm, pandoc, github-cli + pre-install Python packages (openpyxl, pandas, python-pptx, markitdown) and Node packages (docx, pptxgenjs). Configure runtime dirs for agent pip/npm installs with PIP_TARGET, NPM_CONFIG_PREFIX, NODE_PATH to enable dynamic package installation in read-only container environment. * feat(infra): add bundled skills with runtime package support - Add 5 bundled skills: docx, pdf, pptx, xlsx, skill-creator from container skills-store - Wire GOCLAW_BUILTIN_SKILLS_DIR env var in gateway and CLI - Support optional runtime packages alongside dynamic skill loading - Update Dockerfile to COPY bundled-skills at /app/bundled-skills/ - Add PIP_CACHE_DIR in docker-entrypoint.sh for clean pip installs - Document bundled skills in 14-skills-runtime.md section 6 * feat(infra): remove ai-multimodal skill directory from bundled skills Remove the ai-multimodal skill package as part of consolidating runtime package support for bundled skills. This directory is no longer needed in the bundled skills structure. * feat(ci): add semantic release and Docker Hub publishing Add go-semantic-release workflow to auto-create semver tags on merge to main. Extend docker-publish to push all variants to both GHCR and Docker Hub (digitop/goclaw). * feat(skills): add system skills infrastructure with is_system column, dep scanning, and seeder - Migration 000017: add is_system boolean column with partial index - Store layer: UpsertSystemSkill, delete protection, IsSystemSkill - ListAccessible auto-includes system skills (no grants needed) - ListWithGrantStatus returns is_system field - Dependency scanner: auto-detect deps from scripts/ or skill-manifest.json - Dependency checker: verify system binaries, Python/Node packages - Seeder: seed bundled skills into DB on startup (idempotent via hash) - Gateway wiring: GOCLAW_BUNDLED_SKILLS_DIR env for bundled skills - HTTP: delete guard (403), slug conflict check (409), rescan-deps endpoint - UI: System badge, hide delete for system skills, rescan deps button - Agent skills tab: "Always available" for system skills - i18n: en/vi/zh keys for system skills, deps scanning * feat(skills): conditional system prompt, skill manifests, and Zip Slip fix - System prompt: only show package list when python3/node are available - Add skill-manifest.json for pdf, docx, xlsx, pptx bundled skills - Fix Zip Slip vulnerability in office/unpack.py (all 3 copies) * refactor(skills): extract shared office code to _shared/ and deduplicate Move office scripts (pack, unpack, validate, schemas, validators) from duplicated copies in docx/xlsx/pptx to skills/_shared/office/ with symlinks. Remove soffice.py (non-functional in containers) and update SKILL.md references to use soffice binary directly. Update seeder copyDir to follow symlinks. Removes ~45K lines of duplicate code across 3 skills. * fix(skills): address code review findings for system skills integration - H1: Remove dead symlink branch in copyDir (filepath.Walk follows symlinks) - H3: Fix rescan-deps to query ALL skills (including archived) and re-activate when deps become available; add ListAllSkills() + Status field to SkillInfo - H4: Add Status field to SkillCreateParams, stop overloading Visibility - M1: Batch Python/Node dep checks into single subprocess per runtime - M4: Add rows.Err() check in ListSkills to prevent caching partial results * feat(skills): async dep checking with realtime WS events Split Seed() into sync DB upsert + async CheckDepsAsync() goroutine. Gateway startup no longer blocks on Python/Node subprocess dep checks. - Seed() returns seeded skills list, all initially status="active" - CheckDepsAsync() runs in background, emits skill.deps.checked per-skill - skill.deps.complete event emitted when all checks finish - Each failed dep check: archives skill + BumpVersion() for immediate cache invalidation so next agent turn picks up the change - UI: use-query-invalidation listens to skill.deps.* events → auto-refresh skills list in realtime * feat(skills): system skills integration with toggle, dep checking, and per-item install - Add is_system, deps, enabled columns to skills table (migration 017) - Seed bundled core skills (pdf, docx, pptx, xlsx, skill-creator) on startup - PYTHONPATH-based dep detection — eliminates false positives from local modules - Per-item dep install UI with individual status (installing/success/error) - Enable/disable toggle for core and custom skills (independent of dep status) - Re-run dep check when skill is toggled back on - Inline skill thresholds: 40 skills / 5000 tokens before switching to search mode - Fix UpsertSystemSkill: backfill null file_hash without bumping DB version - Remove redundant skill-manifest.json files (replaced by deps JSONB column) - Show author from frontmatter in custom skills tab - Runtime checker for python3/pip3/node/npm availability - WS events for dep checking/installing progress - docs: add 15-core-skills-system.md, 16-skill-publishing.md --------- Co-authored-by: Goon <duy@wearetopgroup.com>	2026-03-12 09:20:41 +07:00
Goon	c25e770d43	feat(ui): multi-skill upload with client-side validation (#149) ... * feat(ui): multi-skill upload with client-side validation Allow uploading multiple skill ZIP files at once with pre-upload validation. JSZip parses each ZIP client-side to verify SKILL.md presence, frontmatter format, and slug validity before upload. - Add JSZip dependency (lazy-loaded, code-split ~30KB gzip) - Create validate-skill-zip.ts mirroring server-side checks - Rewrite skill-upload-dialog for multi-file with status badges - Add concurrent validation, sequential upload with per-file progress - Add empty SKILL.md check to backend upload handler - Add i18n keys for all new UI strings (en/vi/zh) * fix(ui): duplicate entries and validation hang in multi-skill upload - Move pending list construction to assignment inside updater return to prevent StrictMode double-invoke from pushing duplicates - Wrap per-file validateSkillZip in try/catch so one failure doesn't block Promise.all and leave entries stuck in "validating" state * fix(ui): use static import for JSZip instead of dynamic import Dynamic import("jszip") fails in browser - bare module specifiers don't resolve at runtime. Use static import which Vite handles via its module graph and code-splits automatically. * feat(ui): add inline visibility toggle on skills table Click the visibility badge on managed skills to cycle through private → internal → public. File-based skills stay read-only. * fix(ui): move dedup logic outside state updater in upload dialog Avoids reading stale entries inside functional updater. Builds pending list from current entries state before calling setEntries. * fix(ui): auto-select first active agent when current agent unavailable When agents load from API, if the current selected agent is not in the active agents list, automatically select the first available active agent instead of remaining unset. Prevents chat page from being unable to send messages when default agent selection is invalid. * feat(ui): make agent display name editable in setup wizard Allow users to customize the agent display name during onboarding instead of keeping it hardcoded to "GoClaw". Removed read-only state from the display name input and added a placeholder for guidance. * feat: add document path enrichment and media filename support Backend changes: - enrichDocumentPaths() in agent/media.go: injects persisted file paths into <media:document> tags - Document paths allow skills (e.g. pdf skill via exec) to access files directly - chat.go: support new media format {path, filename} alongside legacy string paths - Updated read_document tool description to guide agent on using path attribute - Docker: add pypdf to Python dependencies for PDF processing - Softened MUST language in read_* tool descriptions (changed to Call this) Frontend changes: - chat-input.tsx: attach filename with each uploaded file in media payload - use-chat-send.ts: send media as {path, filename} objects instead of just paths - i18n: add "uploaded_files" text in en, vi, zh locales - chat-page.tsx: minor adjustment for media handling Enables skills to process uploaded documents directly without intermediate copying.	2026-03-11 16:59:03 +07:00