Log In Sign Up

oscarquiz.com
robots.txt

Robots Exclusion Standard data for oscarquiz.com

Resource Scan

Scan Details

Site Domain oscarquiz.com
Base Domain oscarquiz.com
Scan Status Ok
Last Scan2025-07-26T08:02:29+00:00
Next Scan 2025-08-02T08:02:29+00:00

Last Scan

Scanned2025-07-26T08:02:29+00:00
URL https://oscarquiz.com/robots.txt
Redirect https://www.oscarquiz.com/robots.txt
Redirect Domain www.oscarquiz.com
Redirect Base oscarquiz.com
Domain IPs 18.155.68.10, 18.155.68.29, 18.155.68.69, 18.155.68.86
Redirect IPs 2600:9000:23d2:4600:13:2d03:1900:93a1, 2600:9000:23d2:4800:13:2d03:1900:93a1, 2600:9000:23d2:6400:13:2d03:1900:93a1, 2600:9000:23d2:6a00:13:2d03:1900:93a1, 2600:9000:23d2:7600:13:2d03:1900:93a1, 2600:9000:23d2:d800:13:2d03:1900:93a1, 2600:9000:23d2:da00:13:2d03:1900:93a1, 2600:9000:23d2:ee00:13:2d03:1900:93a1, 3.175.207.110, 3.175.207.2, 3.175.207.61, 3.175.207.89
Response IP 18.155.68.29
Found Yes
Hash 8ff026e7ed0458a43409c6f93a1072eb6bf4fe4115b3de294a45f855a7ac1063
SimHash 23c45b73aea4

Groups

*

Rule Path
Allow /
Allow /index.html
Allow /quiz/
Allow /privacy.html
Allow /terms.html
Allow /images/
Disallow /style.css
Disallow /fonts/
Disallow /data/
Disallow /question/
Disallow /topic/
Disallow /results.html

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://oscarquiz.com/sitemap.xml
Back to top

Comments

  • Allow crawling of important pages
  • Allow crawling of static assets
  • Disallow crawling of data files and internal pages
  • Sitemap location
  • Crawl delay (optional - helps with server load)
Back to top