Log In Sign Up

skilljobgov.com
robots.txt

Robots Exclusion Standard data for skilljobgov.com

Resource Scan

Scan Details

Site Domain skilljobgov.com
Base Domain skilljobgov.com
Scan Status Ok
Last Scan2026-02-28T14:09:40+00:00
Next Scan 2026-03-07T14:09:40+00:00

Last Scan

Scanned2026-02-28T14:09:40+00:00
URL https://skilljobgov.com/robots.txt
Domain IPs 2.57.91.84, 2a02:4780:84:4bb9:1dfb:6494:6430:c977, 2a02:4780:85:c606:3cf8:ec28:cd3c:1175, 84.32.84.238
Response IP 93.127.201.24
Found Yes
Hash 6d39860b8a544af7463b1e443438297f7ccf1d6b78193afb5869e556550137ec
SimHash 6924c200c7f3

Groups

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /db/
Disallow /config/
Disallow /admin/
Disallow /includes/
Disallow /*e-page-
Disallow /*?preview=
Disallow /*?session=
Disallow /*?p=
Disallow /*?utm_
Disallow /*?replytocom=
Disallow /tag/
Disallow /author/
Disallow /page/
Allow /
Back to top

Other Records

Field Value
sitemap https://skilljobgov.com/sitemap.php
Back to top

Comments

  • --- Allow Google Ads ---
  • --- All Search Engines ---
  • Block sensitive system folders
  • Block duplicate/junk parameter URLs
  • Block tag, author & paginated pages
  • Allow everything else
  • Sitemap
Back to top