العودة إلى التحديثات
New releaseOct 21, 2026

trawl v1.9.2

محرك كشط مستضاف ذاتيًا — يتجاوز أي تحدٍّ JavaScript وكابتشا: Cloudflare، Turnstile، reCAPTCHA، hCaptcha، GeeTest. بديل FlareSolverr وByparr وبديل متوافق مباشرةً مع حزمة *arr الخاصة بك.

مشاركة



TRAWL

Self-hosted web scraping for applications and AI agents. Get page content through an API or MCP, with built-in handling for supported browser challenges and CAPTCHAs.

TRAWL starts with HTTP, reuses verified clearance and opens Camoufox when a browser is needed. Repeat requests fetch fresh content without repeating a full solve whenever the site accepts the saved session.

HTTP + supported PoW walls → cached browser session → fresh browser solve → residential proxy

The HTTP tier can clear supported ALTCHA and Friendly Captcha v1 access forms with bounded local computation. Ordinary embedded widgets keep their browser lifecycle. Coverage and limits.

Website · Documentation · Latest release

Features

  • Challenge handling: Cloudflare, Anubis, NCBI proof of work, Akamai, Imperva, DDoS-Guard and supported AWS WAF and DataDome flows. Built-in CAPTCHA paths include Turnstile, reCAPTCHA v2, hCaptcha, GeeTest Slide, ALTCHA, Friendly Captcha, CAP and supported Shumei spatial puzzles. Coverage and limits.
  • Fast repeat requests: automatic HTTP clearance reuse, Redis or in-memory caching, and browser fallback when required. No named session is needed for shared clearance reuse.
  • MCP for agents: read Markdown, scrape HTML, extract structured JSON, capture screenshots and inspect browser activity from known URLs.
  • Isolated browser sessions: retain cookies, localStorage, sessionStorage and browser identity. Scrape within a session, keep a page open for JavaScript eval and read cookies. Session API.
  • API and forward proxy: use /scrape, the FlareSolverr-compatible /v1 endpoint, or a challenge-aware HTTP/HTTPS proxy with WebSockets and Range support.
  • Local dashboard: persistent request history, tier outcomes, failure causes and live updates.
  • Local solving by default: optional 2Captcha fallback and opt-in Firefox TLS/HTTP2 impersonation; Bun fetch remains the default HTTP transport.

Sponsors

View/Collapse All
Birght Data Bright Data - The most powerful platform for Web Unlocker, SERP API and web scraping tools.

Why Bright Data?
• Web Unlocker - bypass any anti-bot protection
• SERP API - real-time Google, Bing & more results
• Scraping Browser & dedicated scrapers
• Massive residential proxy network
• Built for scale and reliability

Get started for free with Bright Data!
NodeMaven NodeMaven - The most efficient proxy provider for Web Scrapping and Automation with the Highest Quality IP on the market.

Why NodeMaven?
• ZIP targeting
• 99.9% uptime
• IP filtering: all proxies have fraud score <97%
• No KYC required
• Unique free tools: Proxy Bandwidth Checker, Meta Tag Checker, IP Lookup and others!

Special codes for TRAWL users:
• TRAWL35 - 35% off to Mobile and Residential Proxies
• TRAWL40 - 40% off to ISP (Static) Proxies
• TRAWL2X - 2X traffic for Black Friday
Thordata Thordata - Residential Proxies & Web Data APIs

Give TRAWL reliable upstream access with 100M+ residential IPs across 190+ countries, including city and ASN targeting.

Why Thordata?
• Residential Proxies: rotating and sticky sessions for scraping and browser automation
• SERP API: structured Google, Bing, and other search results for research workflows
• Web Scraper API: collect public web data through a simple API

TRAWL users:
• Start with free trial traffic and get 10% off with code TRAWL10

Performance

Selected same-machine comparisons show faster first and repeat responses than FlareSolverr and Byparr on the default Cloudflare workload:

Protected pageBest firstBest repeat
NopeCHA Cloudflare demo6.0 s879 ms
1337x3.8 s85 ms
EZTV4.6 s473 ms

Measured 2026-10-17 on a development build after v1.8.0. These are verified minima from the recorded sample. First requests used a warm browser with an empty target cache; repeats are fresh fetches with reusable clearance. Results vary by site, IP and session state.

Full comparison, medians and CPU/RAM · Method · Performance guide · Low-resource setup

Quick start

Run one browser with MCP, an in-memory clearance cache and persistent dashboard history:

الفئات