arakun fetch and arakun crawl load them in Cloudflare Browser Run, a real browser on Cloudflare’s network, and give back Markdown an agent can read.
They work without a running Arakun.
Set up a token
1
Create a Cloudflare API token
Give it the Browser Run - Edit permission. The
cf sign-in doesn’t carry it.2
Store it with its account
CLOUDFLARE_BROWSER_RUN_TOKEN and CLOUDFLARE_ACCOUNT_ID instead.
Fetch a page
Crawl a site
Limits
- What you can fetch depends on your Workers plan. On a rate limit, Arakun waits and tries again a few times.
- It does not get past captchas.
arakun crawlhonorsrobots.txtand Content Signals.