termasyhur.com
robots.txt

Robots Exclusion Standard data for termasyhur.com

Resource Scan

Scan Details

Site Domain termasyhur.com
Base Domain termasyhur.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-30T15:40:39+00:00
Next Scan 2025-07-29T15:40:39+00:00

Last Successful Scan

Scanned2023-01-11T06:39:49+00:00
URL https://termasyhur.com/robots.txt
Domain IPs 104.21.22.210, 172.67.207.25, 2606:4700:3034::6815:16d2, 2606:4700:3034::ac43:cf19
Response IP 104.21.22.210
Found Yes
Hash beb1f2b4d900e20ee6ba2e6248e507339e1684bdf8ceecb988e778f068750351
SimHash 6439d94145f4

Groups

*

Rule Path
Disallow /feed/
Disallow /author/

msnbot

Rule Path
Disallow /author/
Disallow /feed/

Other Records

Field Value
crawl-delay 120

bingbot

Rule Path
Disallow /author/
Disallow /feed/

Other Records

Field Value
crawl-delay 120

googlebot

Rule Path
Disallow /author/