1-2-family.de
robots.txt

Robots Exclusion Standard data for 1-2-family.de

Resource Scan

Scan Details

Site Domain 1-2-family.de
Base Domain 1-2-family.de
Scan Status Ok
Last Scan2024-06-23T17:22:19+00:00
Next Scan 2024-06-30T17:22:19+00:00

Last Scan

Scanned2024-06-23T17:22:19+00:00
URL https://1-2-family.de/robots.txt
Redirect https://www.1-2-family.de/robots.txt
Redirect Domain www.1-2-family.de
Redirect Base 1-2-family.de
Domain IPs 185.175.196.1, 2a00:1c98:60:1010::c81:18fa
Redirect IPs 185.175.196.1, 2a00:1c98:60:1010::c81:18fa
Response IP 185.175.196.1
Found Yes
Hash 9d76d2085cd5bb39233aad084ee29e3c338b1b6086be78d57ddeb407d4b994fd
SimHash 7f23550c66d3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /wp-json/
Disallow /wp-content/themes/
Disallow /wp-content/plugins/
Disallow /readme.html
Disallow /trackback/
Disallow /comment-page-
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /cgi-bin/
Disallow /wp-trackback.php
Disallow /category/
Disallow /author/
Disallow /tag/
Disallow /page/
Disallow /?s=

mozilla/5.0 (compatible; ogdwctxcrawler)

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /wp-json/
Disallow /wp-content/themes/
Disallow /wp-content/plugins/
Disallow /readme.html
Disallow /trackback/
Disallow /comment-page-
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /cgi-bin/
Disallow /wp-trackback.php
Disallow /category/
Disallow /author/
Disallow /tag/
Disallow /page/
Disallow /?s=

Other Records

Field Value
sitemap https://www.1-2-family.de/sitemap_index.xml