2ch.so
robots.txt

Robots Exclusion Standard data for 2ch.so

Resource Scan

Scan Details

Site Domain 2ch.so
Base Domain 2ch.so
Scan Status Ok
Last Scan2025-12-29T12:13:50+00:00
Next Scan 2026-01-28T12:13:50+00:00

Last Scan

Scanned2025-12-29T12:13:50+00:00
URL https://2ch.so/robots.txt
Redirect https://www.maskdogecoin.io/robots.txt
Redirect Domain www.maskdogecoin.io
Redirect Base maskdogecoin.io
Domain IPs 104.21.6.249, 172.67.135.132, 2606:4700:3033::6815:6f9, 2606:4700:3037::ac43:8784
Redirect IPs 104.21.9.123, 172.67.189.66, 2606:4700:3031::ac43:bd42, 2606:4700:3037::6815:97b
Response IP 172.67.189.66
Found Yes
Hash 9648b62738c413ee606c31a022a8e29c57bf8976348f023dc06c1764087d0939
SimHash eb4bd804491a

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

teleport
teleportpro
emailcollector
emailsiphon
webbandit
webzip
webreaper
webstripper
web downloader
ahrefsbot
semrushbot
mj12bot
webcopier
offline explorer pro
offline explorer
httrack website copier
offline commander
leech
websnake
blackwidow
http weazel

Rule Path
Disallow /
Disallow /author/
Disallow /*/trackback
Disallow /img/
Disallow /tag/
Disallow /feed
Disallow /*/feed
Disallow /comments/feed
Disallow /?s=*
Disallow /attachment/
Disallow /*?utm_source
Disallow /*%26utm_source

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.maskdogecoin.io/sitemap_index.xml

Comments

  • Allow Facebook scraper