ch.togetter.com
robots.txt

Robots Exclusion Standard data for ch.togetter.com

Resource Scan

Scan Details

Site Domain ch.togetter.com
Base Domain togetter.com
Scan Status Ok
Last Scan2025-04-23T15:51:47+00:00
Next Scan 2025-05-23T15:51:47+00:00

Last Scan

Scanned2025-04-23T15:51:47+00:00
URL https://ch.togetter.com/robots.txt
Domain IPs 18.181.8.159, 35.79.32.73, 52.199.174.4
Response IP 35.79.32.73
Found Yes
Hash ad651b400e1217118a4fa559b5ecd93a04fdb72f27729cfd8172e6066320a784
SimHash 6914d0f2c7b5

Groups

googlebot
bingbot
slurp

Rule Path
Allow /

megalodon

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

twitterbot

Rule Path
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /