ebonyhorizons.com
robots.txt

Robots Exclusion Standard data for ebonyhorizons.com

Resource Scan

Scan Details

Site Domain ebonyhorizons.com
Base Domain ebonyhorizons.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-23T17:15:54+00:00
Next Scan 2024-10-23T17:15:54+00:00

Last Successful Scan

Scanned2024-08-25T08:55:04+00:00
URL https://ebonyhorizons.com/robots.txt
Redirect https://www.ebonyhorizons.com/robots.txt
Redirect Domain www.ebonyhorizons.com
Redirect Base ebonyhorizons.com
Domain IPs 66.147.237.90
Redirect IPs 66.147.237.90
Response IP 66.147.237.90
Found Yes
Hash f593399b9ff69f1049aec30d70f85e834ab4433516c0920d5f092d7e65478f37
SimHash 4842d2915537

Groups

googlebot

Rule Path
Disallow /api/
Allow /

mediapartners-google

Rule Path
Disallow /api/
Allow /

googlebot-image

Rule Path
Disallow /api/
Allow /

yahoo-mmcrawler

Rule Path
Disallow /api/
Allow /

yahoo-slurp

Rule Path
Disallow /api/
Allow /

slurp

Rule Path
Disallow /api/
Allow /

msnbot

Rule Path
Disallow /api/
Allow /

msnbot-media

Rule Path
Disallow /api/
Allow /

bing preview bot

Rule Path
Disallow /api/
Allow /

twitterbot

Rule Path
Disallow /api/
Allow /

facebookexternalhit

Rule Path
Disallow /api/
Allow /

*

Rule Path
Disallow /