Log In Sign Up

dental-wirtschaft.de
robots.txt

Robots Exclusion Standard data for dental-wirtschaft.de

Resource Scan

Scan Details

Site Domain dental-wirtschaft.de
Base Domain dental-wirtschaft.de
Scan Status Ok
Last Scan2024-09-26T13:19:40+00:00
Next Scan 2024-10-03T13:19:40+00:00

Last Scan

Scanned2024-09-26T13:19:40+00:00
URL https://dental-wirtschaft.de/robots.txt
Redirect https://www.dental-wirtschaft.de/robots.txt
Redirect Domain www.dental-wirtschaft.de
Redirect Base dental-wirtschaft.de
Domain IPs 195.50.177.153
Redirect IPs 195.50.177.153, 208.82.73.153
Response IP 195.50.177.153
Found Yes
Hash 6313a598915c99e0f158b6e35ea522694a6735fb19c65277f0269cbefeccaf8a
SimHash ec718f094e92

Groups

*

Rule Path
Disallow /nutzer
Disallow /feedback
Disallow /_next
Allow /_next/static/css/
Allow /_next/static/chunks/
Back to top

Other Records

Field Value
sitemap https://www.dental-wirtschaft.de/api/sitemap.xml
Back to top

Comments

  • Block all crawlers for /nutzer
  • Define the location of the sitemap
  • [ DOMAIN ] is a placeholder for the domain of the website (e. g.: https://staging.arzt-wirtschaft.de)
  • [ DOMAIN ] is replaced with the value of the variable NEXT_PUBLIC_NEXTJS_SITE_URL in the .env file during deployment
  • Trailing-slashes in NEXT_PUBLIC_NEXTJS_SITE_URL are removed in the responsible shell script
Back to top