homepage-ratgeber.de
robots.txt

Robots Exclusion Standard data for homepage-ratgeber.de

Resource Scan

Scan Details

Site Domain homepage-ratgeber.de
Base Domain homepage-ratgeber.de
Scan Status Ok
Last Scan2024-06-10T05:17:29+00:00
Next Scan 2024-07-10T05:17:29+00:00

Last Scan

Scanned2024-06-10T05:17:29+00:00
URL https://homepage-ratgeber.de/robots.txt
Redirect https://www.homepage-ratgeber.de/robots.txt
Redirect Domain www.homepage-ratgeber.de
Redirect Base homepage-ratgeber.de
Domain IPs 54.93.106.22
Redirect IPs 13.226.225.34, 13.226.225.41, 13.226.225.52, 13.226.225.89, 2600:9000:201f:1e00:16:e895:bd00:93a1, 2600:9000:201f:2600:16:e895:bd00:93a1, 2600:9000:201f:3a00:16:e895:bd00:93a1, 2600:9000:201f:ae00:16:e895:bd00:93a1, 2600:9000:201f:d600:16:e895:bd00:93a1, 2600:9000:201f:dc00:16:e895:bd00:93a1, 2600:9000:201f:e000:16:e895:bd00:93a1, 2600:9000:201f:fe00:16:e895:bd00:93a1
Response IP 18.165.171.105
Found Yes
Hash f62a76300a39a11494e54479e349299cb00d2510f5445631a12f32031558754e
SimHash 031081568ba3

Groups

*

Rule Path
Disallow /craft/
Disallow /*/*.pdf$

Other Records

Field Value
sitemap https://www.homepage-ratgeber.de/sitemap.xml/

Comments

  • Don't allow web crawlers to index Craft CMS