deiters.de
robots.txt

Robots Exclusion Standard data for deiters.de

Resource Scan

Scan Details

Site Domain deiters.de
Base Domain deiters.de
Scan Status Ok
Last Scan2024-09-07T23:42:03+00:00
Next Scan 2024-10-07T23:42:03+00:00

Last Scan

Scanned2024-09-07T23:42:03+00:00
URL https://deiters.de/robots.txt
Redirect https://www.deiters.de/robots.txt
Redirect Domain www.deiters.de
Redirect Base deiters.de
Domain IPs 104.26.12.211, 104.26.13.211, 172.67.73.102, 2606:4700:20::681a:cd3, 2606:4700:20::681a:dd3, 2606:4700:20::ac43:4966
Redirect IPs 104.26.12.211, 104.26.13.211, 172.67.73.102, 2606:4700:20::681a:cd3, 2606:4700:20::681a:dd3, 2606:4700:20::ac43:4966
Response IP 104.26.13.211
Found Yes
Hash 43f612b860208bd732e162874dffc74e482e990c08f0953c5ca6c776025f3a72
SimHash 0a1c9400cdb3

Groups

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

*

Rule Path
Disallow /*.pdf$
Disallow /*.doc$
Disallow /*.rtf$
Disallow */account/
Disallow */checkout/
Disallow */widgets/
Disallow */navigation/
Disallow */bundles/
Allow /bundles/deiters/favicon

Other Records

Field Value
sitemap https://www.deiters.de/sitemap.xml

Comments

  • https://megaindex.com/crawler