anrufer.info
robots.txt

Robots Exclusion Standard data for anrufer.info

Resource Scan

Scan Details

Site Domain anrufer.info
Base Domain anrufer.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-11-19T18:50:16+00:00
Next Scan 2024-11-20T18:50:16+00:00

Last Successful Scan

Scanned2024-11-12T16:21:59+00:00
URL https://anrufer.info/robots.txt
Domain IPs 65.108.228.225
Response IP 65.108.228.225
Found Yes
Hash abe6fe9574b9d582b61e25672833dc2d8869e281170777275fc0cc83b4e8d69b
SimHash 20149a81d7b4

Groups

*

Rule Path
Disallow /

teoma

Rule Path
Disallow /

psbot

Rule Path
Disallow /

dotsemantic

Rule Path
Disallow /

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

yahoo! slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

twiceler

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

microsoft.url.control

Rule Path
Allow /

googlebot

Rule Path
Allow /
Disallow /inhaber/
Disallow /rufnummer/08333924289

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

Warnings

  • `noindex` is not a known field.