每日备份 2026-06-10 12:57:13

config/openclaw/skills/deep-scraper/SKILL.md

@@ -0,0 +1,29 @@
+# Skill: deep-scraper
+
+## Overview
+A high-performance engineering tool for deep web scraping. It uses a containerized Docker + Crawlee (Playwright) environment to penetrate protections on complex websites like YouTube and X/Twitter, providing "interception-level" raw data.
+
+## Requirements
+1.  **Docker**: Must be installed and running on the host machine.
+2.  **Image**: Build the environment with the tag `clawd-crawlee`.
+    *   Build command: `docker build -t clawd-crawlee skills/deep-scraper/`
+
+## Integration Guide
+Simply copy the `skills/deep-scraper` directory into your `skills/` folder. Ensure the Dockerfile remains within the skill directory for self-contained deployment.
+
+## Standard Interface (CLI)
+```bash
+docker run -t --rm -v $(pwd)/skills/deep-scraper/assets:/usr/src/app/assets clawd-crawlee node assets/main_handler.js [TARGET_URL]
+```
+
+## Output Specification (JSON)
+The scraping results are printed to stdout as a JSON string:
+- `status`: SUCCESS | PARTIAL | ERROR
+- `type`: TRANSCRIPT | DESCRIPTION | GENERIC
+- `videoId`: (For YouTube) The validated Video ID.
+- `data`: The core text content or transcript.
+
+## Core Rules
+1.  **ID Validation**: All YouTube tasks MUST verify the Video ID to prevent cache contamination.
+2.  **Privacy**: Strictly forbidden from scraping password-protected or non-public personal information.
+3.  **Alpha-Focused**: Automatically strips ads and noise, delivering pure data optimized for LLM processing.

config/openclaw/skills/deep-scraper/_meta.json

@@ -0,0 +1,11 @@
+{
+  "owner": "opsun",
+  "slug": "deep-scraper",
+  "displayName": "Deep Scraper",
+  "latest": {
+    "version": "1.0.1",
+    "publishedAt": 1770205151953,
+    "commit": "https://github.com/clawdbot/skills/commit/0609dee8b158bc95d246a5446f5c4ab95f54cac7"
+  },
+  "history": []
+}

config/openclaw/skills/deep-scraper/package.json

@@ -0,0 +1,27 @@
+{
+  "name": "deep-scraper",
+  "version": "1.0.0",
+  "description": "High-performance containerized scraper for YouTube, X (Twitter), and dynamic SPAs. Features raw API interception and ID validation.",
+  "main": "assets/main_handler.js",
+  "scripts": {
+    "test": "node assets/main_handler.js https://www.youtube.com/watch?v=dQw4w9WgXcQ"
+  },
+  "keywords": [
+    "scraper",
+    "crawlee",
+    "youtube",
+    "alpha",
+    "openclaw"
+  ],
+  "author": "Joseph",
+  "license": "MIT",
+  "dependencies": {
+    "crawlee": "^3.0.0",
+    "playwright": "^1.40.0"
+  },
+  "openclaw": {
+    "requires": {
+      "docker": true
+    }
+  }
+}