index.about.com
robots.txt

Robots Exclusion Standard data for index.about.com

Resource Scan

Scan Details

Site Domain index.about.com
Base Domain about.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-19T12:42:32+00:00
Next Scan 2024-06-17T12:42:32+00:00

Last Successful Scan

Scanned2023-07-30T12:56:55+00:00
URL https://index.about.com/robots.txt
Domain IPs 199.232.46.114
Response IP 199.232.46.114
Found Yes
Hash 8b7572063f8da148fd21e650cf4154a8ae6da672e76a26f9192d5fe035609496
SimHash 4540dbc0d710

Groups

googlebot

Rule Path
Disallow /
Allow /ads.txt

mediapartners-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

adidxbot

Rule Path
Disallow

proximic

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • Default robots.txt