Productivity & Collaboration

Web Page Cleaner

Extracts readable Markdown from cluttered web pages before knowledge-base ingestion.

41/ 100
Not recommended

Current benefit does not outweigh risk or uncertainty.

See how it was scored ↓
Works as-is in
Codex · Claude Code
Stars
★ 16k
Last updated
1mo ago
License
MIT
web-extractionmarkdown-cleaningobsidianknowledge-management
+1defuddle-cli

What does this skill do, and when should you use it?

defuddle cleans web content before it is ingested into an Obsidian knowledge base. It removes ads, cookie banners, navigation, headers, footers, related articles, and social-sharing elements while preserving the article body as Markdown. It is intended for news articles, blog posts, documentation pages, and local HTML files. Clean Markdown or PDF sources, dashboards, and app pages generally do not need it.

It runs defuddle-cli against a URL or local HTML file, extracts the meaningful article content, and writes cleaned Markdown to stdout. The output can be redirected into .raw/articles/ and supplemented with YAML frontmatter containing the source URL and fetch date. If defuddle is unavailable, the skill checks whether the command is installed and recommends WebFetch as a less-clean fallback.

Good fit
  • A researcher importing news articles into an Obsidian knowledge base wants to remove page chrome first.
  • A personal knowledge-management user processing long blog posts or documentation wants to reduce token usage.
  • A Claude Code user building a second-brain workflow needs web sources saved under .raw/ before ingestion.
  • A user with a local HTML file wants to extract its readable main content.

How do you install this skill?

Before you use it
  • The defuddle-cli dependency is not version-pinned, creating supply-chain and behavior-drift risk.
  • URL fetching sends page content through external network tooling; confirm data flow and authorization before processing sensitive or private pages.
  • The shell examples do not consistently demonstrate safe URL and path escaping; complex or untrusted inputs may create command or path issues.
  • Chinese-language pages, authenticated pages, dynamic applications, and mainland-China network reachability are unverified.
Before you start
Your agent needs
  • Shell / CLI
  • Network access
  • Local filesystem
Install first
  • defuddle-cli
  • npm

Install the command-line dependency with npm install -g defuddle-cli, then verify it with defuddle --version. The repository documents installation of the full collection by cloning it and running bash bin/setup-vault.sh, or installing it as a Claude Code plugin; it does not document a separate installation command for this skill directory alone.

Generic route: install into Claude Code manually (macOS / Linux)
tmp="$(mktemp -d)"
git clone --depth 1 https://github.com/AgriciDaniel/claude-obsidian.git "$tmp"
mkdir -p ~/.claude/skills
cp -R "$tmp/skills/defuddle" ~/.claude/skills/
rm -rf "$tmp"

Generated from the source repository and skill path; it copies only this skill's folder. If the author's install steps above differ, follow those first. To scope it to one project, replace ~/.claude/skills with that project's .claude/skills.

How do you use this skill?

Clean a URL with defuddle 'https://example.com/article'. Clean local HTML with defuddle page.html. Save the result with defuddle 'https://example.com/article' > .raw/articles/article-slug-$(date +%Y-%m-%d).md. The skill recommends using it before URL ingestion. When used through /wiki-ingest, that separate ingestion skill checks for and calls defuddle automatically.

What are this skill's strengths and limitations?

Pros
  • Targets article-body extraction and removes common web-page clutter.
  • Produces plain Markdown suitable for Obsidian and later ingestion.
  • The source claims 40–60% token savings on typical web articles.
  • Supports both URLs and local HTML, with a WebFetch fallback.
Limitations
  • Designed for article-style pages, not dashboards, applications, or structured data.
  • Extraction quality depends on page structure and heuristic behavior; some pages may extract poorly.
  • Without defuddle-cli, the direct-fetch fallback produces less-clean content.
  • The source provides no separate test results or test suite for this skill.

How does this skill compare with similar options?

Side by side with related skills; every score comes from the same FSRS standard.

Skill FS score Stars Last updated License
Web Page Cleaner this page 41 · Not recommended ★ 16k 1mo ago MIT
Obsidian CLI Knowledge Transport 48 · Use with care ★ 16k 1mo ago MIT
Compound Vault Methodology Modes 56 · Use with care ★ 16k 1mo ago MIT
Wiki Log Folder 55 · Use with care ★ 16k 1mo ago MIT
Obsidian Wiki Query 50 · Use with care ★ 16k 1mo ago MIT

How did FollowSkills review this skill?

FollowSkills review · FSRS-2.0
Not recommended
41/ 100 5-point scale 2.1 / 5
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
1Trust9 / 25 · 1.8/5

The skill declares only Read and Bash and describes output to stdout or .raw/, while identifying the defuddle-cli upstream; however, Bash is broad, installation is unpinned, URL fetching creates an external data flow, and there is no user confirmation, sensitive-data warning, rollback, or recovery guidance, so points are deducted.

2Reliability7 / 20 · 1.8/5

The install, version check, URL/HTML inputs, save commands, skip conditions, and WebFetch fallback form a coherent workflow; however, the selected skill has no tests, pinned dependency, or diagnosable handling for fetch and extraction failures. The 40–60% token-saving and extraction claims are not reproduced in the files, so points are deducted.

3Adaptability8 / 15 · 2.7/5

Triggers, use cases, skip cases, and local HTML input are reasonably clear; however, broader non-article boundaries, platform requirements, and Chinese-language or Chinese-web compatibility are unspecified, while npm and target-page access may be constrained on mainland-China networks, so points are deducted.

4Convention8 / 15 · 2.7/5

The document includes frontmatter, installation, verification, usage, scenarios, fallback, and wiki-ingest integration, with upstream attribution and a version note; however, it lacks skill-specific version history, changelog, maintenance ownership, upgrade path, parameter conventions, and troubleshooting detail, so points are deducted.

5Effectiveness6 / 15 · 2.0/5

The skill clearly produces clean Markdown and provides directly usable stdout and save commands, giving it practical value for webpage cleaning; however, output quality depends on heuristic extraction, failure guidance is minimal, and no representative output or comparative verification is provided, so manual rework may still be required and points are deducted.

6Verifiability3 / 10 · 1.5/5

The skill provides an upstream defuddle-cli repository link, a post-install version check, and reproducible command examples; however, this review is static, the commands were not executed, and there are no skill-specific tests, sample outputs, or third-party execution records, so only limited points are justified.

1 2 3 4 5 6

Open a dimension to read why it scored that way

Reviewed Jul 20, 2026 Reviewed revision cb93ff6d82f9 Review evidence[1][2][3][4][5][6][7][8]

Evidence confidence:Low — Mostly static review, author material or a limited demo; useful for discovery, not high-risk decisions.

See the full review method →

FAQ

Does it save pages into Obsidian automatically?
No. It outputs cleaned Markdown to stdout. You can redirect it into .raw/ and then pass the saved file to the repository's ingestion workflow.
When should I skip it?
Skip it for clean Markdown or PDF sources, dashboards, app pages, and structured data.
What if extraction quality is poor?
The skill recommends flagging the failure rather than forcing the result, then considering a defuddle-cli upgrade or another extractor. If the CLI is not installed, use WebFetch as the less-clean fallback.

More skills from this repository

All from AgriciDaniel/claude-obsidian

Productivity & Collaboration

Obsidian CLI Knowledge Transport

Use Obsidian CLI to read, write, search, and maintain a Markdown vault.

★ 16k FS 48 Use with care 1mo ago
Productivity & Collaboration

Compound Vault Methodology Modes

Routes new Obsidian vault pages according to LYT, PARA, Zettelkasten, or Generic conventions.

★ 16k FS 56 Use with care 1mo ago
Productivity & Collaboration

Wiki Log Folder

Turns Obsidian wiki logs into traceable Markdown rollups without altering their source entries.

★ 16k FS 55 Use with care 1mo ago
Productivity & Collaboration

Obsidian Wiki Query

Retrieve, cite, and compound answers from your Obsidian knowledge vault.

★ 16k FS 50 Use with care 1mo ago
Productivity & Collaboration

Conversation Archivist

Turn valuable conversations and insights into structured, linked Obsidian Markdown notes.

★ 16k FS 49 Use with care 1mo ago
Productivity & Collaboration

Wiki Knowledge Companion

Build and maintain a compounding Markdown wiki in Obsidian.

★ 16k FS 49 Use with care 1mo ago
Productivity & Collaboration

Wiki Ingest for Obsidian

Turn files, URLs, and images into connected Obsidian knowledge pages.

★ 16k FS 49 Use with care 1mo ago
Productivity & Collaboration

Vault Hybrid Retrieval

Paragraph-level Obsidian vault search combining contextual prefixes, BM25 retrieval, and optional vector reranking.

★ 16k FS 54 Use with care 1mo ago
Productivity & Collaboration

Autonomous Research Filing

Turn a research topic into traceable Obsidian knowledge-base pages.

★ 16k FS 52 Use with care 1mo ago
Productivity & Collaboration

Obsidian Markdown Syntax Assistant

Write valid Obsidian Markdown and avoid broken links, embeds, callouts, and properties.

★ 16k FS 45 Not recommended 1mo ago
Productivity & Collaboration

Obsidian Bases Views

Turn Obsidian notes into queryable tables, cards, and lists with native dynamic views.

★ 16k FS 50 Use with care 1mo ago
Productivity & Collaboration

Obsidian Wiki Health Check

Find broken links, stale claims, and structural gaps in your wiki.

★ 16k FS 48 Use with care 1mo ago
Productivity & Collaboration

Canvas Visual Knowledge Board

Organize images, PDFs, and wiki pages on an Obsidian visual canvas.

★ 16k FS 41 Not recommended 1mo ago
Productivity & Collaboration

Ten-Principle Thinking Loop

A structured ten-stage loop that helps Claude analyze complex problems, challenge assumptions, and produce actionable conclusions.

★ 16k FS 53 Use with care 1mo ago

Related skills