Log In Sign Up

sudo.ws
robots.txt

Robots Exclusion Standard data for sudo.ws

Resource Scan

Scan Details

Site Domain sudo.ws
Base Domain sudo.ws
Scan Status Ok
Last Scan2025-06-18T17:14:25+00:00
Next Scan 2025-07-18T17:14:25+00:00

Last Scan

Scanned2025-06-18T17:14:25+00:00
URL https://sudo.ws/robots.txt
Redirect https://www.sudo.ws/robots.txt
Redirect Domain www.sudo.ws
Redirect Base sudo.ws
Domain IPs 104.26.12.121, 104.26.13.121, 172.67.72.152, 2606:4700:20::681a:c79, 2606:4700:20::681a:d79, 2606:4700:20::ac43:4898
Redirect IPs 104.26.12.121, 104.26.13.121, 172.67.72.152, 2606:4700:20::681a:c79, 2606:4700:20::681a:d79, 2606:4700:20::ac43:4898
Response IP 104.26.13.121
Found Yes
Hash b882ccc7759cb0d596a1b1688059fe4d567daeb831b39d6719fbb1b2509cb933
SimHash 701c99d1e795

Groups

applebot-extended
bytespider
ccbot
claudebot
diffbot
facebookbot
google-extended
gptbot
imagesiftbot
meta-externalagent
omgili
timpibot

Rule Path
Disallow /

amazonbot
applebot
oai-searchbot
perplexitybot
youbot

Rule Path
Disallow /

anthropic-ai
claude-web
cohere-ai

Rule Path
Disallow /

*

Rule Path
Disallow /tags/*
Disallow /bugs/*
Disallow /bugzilla/*
Disallow /cgi-bin/*
Disallow /dist/*
Disallow /ftp/*
Disallow /gallery/*
Disallow /gallery2/*
Disallow /gallery3/*
Disallow /mktemp/*
Disallow /newsyslog/*
Disallow /pub/*
Disallow /repos/*
Disallow /smokeping/*
Back to top

Other Records

Field Value
sitemap https://www.sudo.ws/sitemap.xml
Back to top

Comments

  • AI Data Scrapers [https://darkvisitors.com/agents]
  • AI Search Crawlers [https://darkvisitors.com/agents]
  • Undocumented AI Agents [https://darkvisitors.com/agents]
Back to top