mustakbilcorner.com
robots.txt

Robots Exclusion Standard data for mustakbilcorner.com

Resource Scan

Scan Details

Site Domain mustakbilcorner.com
Base Domain mustakbilcorner.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-01T00:58:59+00:00
Next Scan 2024-10-08T00:58:59+00:00

Last Successful Scan

Scanned2024-09-23T00:55:42+00:00
URL https://mustakbilcorner.com/robots.txt
Domain IPs 2a02:4780:b:861:0:36a9:da15:2, 82.180.172.235
Response IP 82.180.172.235
Found Yes
Hash 353ff364a13793b0842f3c33551920425a03ad6abbfd9b994a9e3e921d76bafb
SimHash 6550c3977715

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

ninjabot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /