preprod.tasteofhome.com
robots.txt

Robots Exclusion Standard data for preprod.tasteofhome.com

Resource Scan

Scan Details

Site Domain preprod.tasteofhome.com
Base Domain tasteofhome.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-12T10:04:32+00:00
Next Scan 2024-08-10T10:04:32+00:00

Last Successful Scan

Scanned2023-09-23T08:00:32+00:00
URL https://preprod.tasteofhome.com/robots.txt
Domain IPs 104.18.41.183, 172.64.146.73, 2606:4700:4400::6812:29b7, 2606:4700:4400::ac40:9249
Response IP 104.18.41.183
Found Yes
Hash 7e388b347c670d831541bc2be9640a20b36a1d80a97a7b59c8693823557c1a05
SimHash 6224dd64ab26

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ahrefs

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://preprod.tasteofhome.com/sitemap_index.xml

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/