itjobs.pt
robots.txt

Robots Exclusion Standard data for itjobs.pt

Resource Scan

Scan Details

Site Domain itjobs.pt
Base Domain itjobs.pt
Scan Status Ok
Last Scan2024-11-12T13:37:11+00:00
Next Scan 2024-11-19T13:37:11+00:00

Last Scan

Scanned2024-11-12T13:37:11+00:00
URL https://itjobs.pt/robots.txt
Redirect https://www.itjobs.pt/robots.txt
Redirect Domain www.itjobs.pt
Redirect Base itjobs.pt
Domain IPs 104.26.10.238, 104.26.11.238, 172.67.71.250, 2606:4700:20::681a:aee, 2606:4700:20::681a:bee, 2606:4700:20::ac43:47fa
Redirect IPs 104.26.10.238, 104.26.11.238, 172.67.71.250, 2606:4700:20::681a:aee, 2606:4700:20::681a:bee, 2606:4700:20::ac43:47fa
Response IP 104.26.10.238
Found Yes
Hash 27de289aa557a3a94187985b253980bf98b2f4eabea74ee335976d1b31f0fa0c
SimHash 0010a9348a40

Groups

*

Rule Path
Disallow
Disallow /*?lang=
Disallow /admin
Disallow /index.php
Allow /user/login
Allow /user/register
Disallow /user/*

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Comments

  • Disallow: /emprego*?
  • Disallow: /formacao*?
  • Disallow: /tag/*?
  • Disallow: /local/*?