bintan.me
robots.txt

Robots Exclusion Standard data for bintan.me

Resource Scan

Scan Details

Site Domain bintan.me
Base Domain bintan.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-24T23:47:15+00:00
Next Scan 2024-10-22T23:47:15+00:00

Last Successful Scan

Scanned2023-09-29T21:08:24+00:00
URL https://bintan.me/robots.txt
Domain IPs 206.223.145.136
Response IP 206.223.145.136
Found Yes
Hash 413d68740daeb2d8674ae162cc68d344e5082723c2dd9d03b5c81f777cae91ac
SimHash 8a1c9a50a713

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap http://2ch.bintan.me/smap.xml