contextualdictionary.com
robots.txt

Robots Exclusion Standard data for contextualdictionary.com

Resource Scan

Scan Details

Site Domain contextualdictionary.com
Base Domain contextualdictionary.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-04T21:20:49+00:00
Next Scan 2024-11-02T21:20:49+00:00

Last Successful Scan

Scanned2024-01-08T20:44:34+00:00
URL https://contextualdictionary.com/robots.txt
Redirect https://www.contextualdictionary.com/robots.txt
Redirect Domain www.contextualdictionary.com
Redirect Base contextualdictionary.com
Domain IPs 51.250.125.126
Redirect IPs 51.250.125.126
Response IP 51.250.125.126
Found Yes
Hash f84567bfdb8bff68beb89492d5664731c17305361e6c2c423409c11e1be48cf4
SimHash 2b44cc008d90

Groups

mediapartners-google

Rule Path
Disallow

yandex

Rule Path
Disallow /videos/
Disallow /abuse/
Disallow /printvideo/
Disallow /download/
Disallow /loadvideo/
Disallow /load/

*

Rule Path
Disallow /abuse/
Disallow /printvideo/
Disallow /download/
Disallow /loadvideo/
Disallow /load/

Other Records

Field Value
sitemap https://www.contextualdictionary.com/sitemap_index.xml

Warnings

  • `host` is not a known field.