entertainingdiva.com
robots.txt

Robots Exclusion Standard data for entertainingdiva.com

Resource Scan

Scan Details

Site Domain entertainingdiva.com
Base Domain entertainingdiva.com
Scan Status Ok
Last Scan2024-10-02T23:38:30+00:00
Next Scan 2024-10-09T23:38:30+00:00

Last Scan

Scanned2024-10-02T23:38:30+00:00
URL https://entertainingdiva.com/robots.txt
Redirect https://www.entertainingdiva.com/robots.txt
Redirect Domain www.entertainingdiva.com
Redirect Base entertainingdiva.com
Domain IPs 104.26.0.91, 104.26.1.91, 172.67.72.34, 2606:4700:20::681a:15b, 2606:4700:20::681a:5b, 2606:4700:20::ac43:4822
Redirect IPs 104.26.0.91, 104.26.1.91, 172.67.72.34, 2606:4700:20::681a:15b, 2606:4700:20::681a:5b, 2606:4700:20::ac43:4822
Response IP 104.26.0.91
Found Yes
Hash 8d84f1cf7faa3e63c0630500c8b3074807e8fdbb5f579f5c55f36867bafc8f0f
SimHash 6808d82087b2

Groups

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

googleextended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

yumbot/1.0

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.entertainingdiva.com/sitemap_index.xml
sitemap https://www.entertainingdiva.com/recipes/sitemap_index.xml