Log In Sign Up

arzt-wirtschaft.de
robots.txt

Robots Exclusion Standard data for arzt-wirtschaft.de

Resource Scan

Scan Details

Site Domain arzt-wirtschaft.de
Base Domain arzt-wirtschaft.de
Scan Status Ok
Last Scan2024-09-27T03:09:34+00:00
Next Scan 2024-10-04T03:09:34+00:00

Last Scan

Scanned2024-09-27T03:09:34+00:00
URL https://arzt-wirtschaft.de/robots.txt
Redirect https://www.arzt-wirtschaft.de/robots.txt
Redirect Domain www.arzt-wirtschaft.de
Redirect Base arzt-wirtschaft.de
Domain IPs 195.50.177.153
Redirect IPs 195.50.177.153, 208.82.73.153
Response IP 208.82.73.153
Found Yes
Hash 05912c910f237d4c8b46a3719b22c504825f1929a810f0a4b304db1df2b397fb
SimHash 6c718f094ad3

Groups

*

Rule Path
Disallow /nutzer
Disallow /feedback
Disallow /_next
Allow /_next/static/css/
Allow /_next/static/chunks/
Back to top

Other Records

Field Value
sitemap https://www.arzt-wirtschaft.de/api/sitemap.xml
Back to top

Comments

  • Block all crawlers for /nutzer
  • Define the location of the sitemap
  • [ DOMAIN ] is a placeholder for the domain of the website (e. g.: https://staging.arzt-wirtschaft.de)
  • [ DOMAIN ] is replaced with the value of the variable NEXT_PUBLIC_NEXTJS_SITE_URL in the .env file during deployment
  • Trailing-slashes in NEXT_PUBLIC_NEXTJS_SITE_URL are removed in the responsible shell script
Back to top