Log In Sign Up

quizforalle.no
robots.txt

Robots Exclusion Standard data for quizforalle.no

Resource Scan

Scan Details

Site Domain quizforalle.no
Base Domain quizforalle.no
Scan Status Ok
Last Scan2025-09-19T03:03:16+00:00
Next Scan 2025-10-19T03:03:16+00:00

Last Scan

Scanned2025-09-19T03:03:16+00:00
URL https://quizforalle.no/robots.txt
Domain IPs 104.21.95.101, 172.67.144.71, 2606:4700:3032::6815:5f65, 2606:4700:3035::ac43:9047
Response IP 104.21.95.101
Found Yes
Hash 8697e5d13483fa96c1c5bb31ff0eef8c72214b39b46cb361679a4dd86205dbb5
SimHash ba490dc78511

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /auth/
Back to top

Other Records

Field Value
sitemap https://quizforalle.no/sitemap.xml
sitemap https://quizforalle.com/sitemap.xml
Back to top

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
  • Disallow admin and authentication paths
  • Sitemaps - Production
  • Test environment-specific rules
  • These will be used when the site is deployed to test.quizforalle.no
  • User-agent: *
  • Disallow: /
  • or
  • Sitemap: https://test.quizforalle.no/sitemap.xml
Back to top