crosswordanswers911.net
robots.txt

Robots Exclusion Standard data for crosswordanswers911.net

Resource Scan

Scan Details

Site Domain crosswordanswers911.net
Base Domain crosswordanswers911.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-25T02:24:43+00:00
Next Scan 2024-10-24T02:24:43+00:00

Last Successful Scan

Scanned2024-06-27T02:08:12+00:00
URL https://crosswordanswers911.net/robots.txt
Domain IPs 137.184.78.235
Response IP 137.184.78.235
Found Yes
Hash 9e5f021fe2fa8fdb509aab0aff02ab26f26513339f7ef771f77710f0cc259bd2
SimHash 65109c27cfb7

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 9

ezoic

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ezoicbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://crosswordanswers911.net/sitemap/dailylink.xml