Log In Sign Up

slate.freejobalert.com
robots.txt

Robots Exclusion Standard data for slate.freejobalert.com

Resource Scan

Scan Details

Site Domain slate.freejobalert.com
Base Domain freejobalert.com
Scan Status Ok
Last Scan2025-10-16T01:15:46+00:00
Next Scan 2025-11-15T01:15:46+00:00

Last Scan

Scanned2025-10-16T01:15:46+00:00
URL https://slate.freejobalert.com/robots.txt
Domain IPs 104.26.4.152, 104.26.5.152, 172.67.74.249, 2606:4700:20::681a:498, 2606:4700:20::681a:598, 2606:4700:20::ac43:4af9
Response IP 104.26.4.152
Found Yes
Hash 54dad7a43aa8a64570d65fd73fdc74c36b983cb52929ac5b76bc9a076b0d58aa
SimHash 6d16c933e309

Groups

*

Rule Path
Allow /
Allow /image-resizer/
Allow /pdf-converter-editor/
Allow /mock-test/
Allow /Slate_Logo_test.png
Disallow /cgi-bin/
Disallow /image/
Disallow /*.zip
Disallow /cache-buster.js
Disallow /clear-cache.php

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://slate.freejobalert.com/sitemap.xml
Back to top

Comments

  • Welcome to SLATE - Free Online Tools
  • Main sections:
  • - Image Resizer: https://slate.freejobalert.com/image-resizer/
  • - PDF Converter & Editor: https://slate.freejobalert.com/pdf-converter-editor/
  • - Mock Test : https://slate.freejobalert.com/mock-test/
  • Crawl delay to be respectful of server resources
Back to top

Warnings

  • 2 invalid lines.
Back to top