ww1.hassanlatif.net
robots.txt

Robots Exclusion Standard data for ww1.hassanlatif.net

Resource Scan

Scan Details

Site Domain ww1.hassanlatif.net
Base Domain hassanlatif.net
Scan Status Ok
Last Scan2024-09-08T07:06:36+00:00
Next Scan 2024-10-08T07:06:36+00:00

Last Scan

Scanned2024-09-08T07:06:36+00:00
URL https://ww1.hassanlatif.net/robots.txt
Domain IPs 104.21.17.234, 172.67.178.169, 2606:4700:3031::ac43:b2a9, 2606:4700:3033::6815:11ea
Response IP 172.67.178.169
Found Yes
Hash c0070cbddc3f9dd52c8ddc8ac123442231b3e86568f406fc5aec1c8778f353a4
SimHash 207ad4d140bd

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

googlebot-mobile
yandeximageresizer
mediapartners-google
twitterbot
facebookexternalhit
twiceler
baiduspider
w3c-checklink
slurp
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60