adoptierte.de
robots.txt

Robots Exclusion Standard data for adoptierte.de

Resource Scan

Scan Details

Site Domain adoptierte.de
Base Domain adoptierte.de
Scan Status Ok
Last Scan2025-12-08T04:36:49+00:00
Next Scan 2026-01-07T04:36:49+00:00

Last Scan

Scanned2025-12-08T04:36:49+00:00
URL https://adoptierte.de/robots.txt
Domain IPs 104.21.39.111, 172.67.144.148, 2606:4700:3030::ac43:9094, 2606:4700:3033::6815:276f
Response IP 104.21.39.111
Found Yes
Hash c62aac26e63f041538a72c001d6969229a6ce67239fcf2e2619a774da0cc1ed5
SimHash 4f10db72e633

Groups

*

Rule Path
Disallow /?
Disallow /*?
Disallow /*?page=
Disallow /cgi-bin*
Disallow /functions/sitemap-generation.php
Allow /*.css
Allow /*.js

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://adoptierte.de/sitemap.xml

Warnings

  • `host` is not a known field.