swankyrecipes.com
robots.txt

Robots Exclusion Standard data for swankyrecipes.com

Resource Scan

Scan Details

Site Domain swankyrecipes.com
Base Domain swankyrecipes.com
Scan Status Ok
Last Scan2024-11-13T02:24:42+00:00
Next Scan 2024-11-20T02:24:42+00:00

Last Scan

Scanned2024-11-13T02:24:42+00:00
URL https://swankyrecipes.com/robots.txt
Domain IPs 104.21.14.114, 172.67.202.233, 2606:4700:3033::6815:e72, 2606:4700:3033::ac43:cae9
Response IP 172.67.202.233
Found Yes
Hash a57c7e6bfda5f6a0eccf55ccbbb55a23250beeeb276976fdf18d464826eae7bd
SimHash 1414d9408516

Groups

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

opebot-v

Rule Path
Allow /