empregosonline.pt
robots.txt

Robots Exclusion Standard data for empregosonline.pt

Resource Scan

Scan Details

Site Domain empregosonline.pt
Base Domain empregosonline.pt
Scan Status Ok
Last Scan2024-11-11T20:21:40+00:00
Next Scan 2024-11-18T20:21:40+00:00

Last Scan

Scanned2024-11-11T20:21:40+00:00
URL https://empregosonline.pt/robots.txt
Redirect https://www.empregosonline.pt/robots.txt
Redirect Domain www.empregosonline.pt
Redirect Base empregosonline.pt
Domain IPs 195.23.36.47
Redirect IPs 88.157.217.147
Response IP 88.157.217.147
Found Yes
Hash 7d1547a08929dd95787da7f1f549e155f300f6ee912cfbabb20d41d536c9a4e7
SimHash 3c193f40efd3

Groups

*

Product Comment
* all bots
Rule Path
Disallow /Images/
Disallow /JS/

Other Records

Field Value
sitemap http://www.empregosonline.pt/sitemap.xml

Comments

  • File that defines the exclusion list for search crawlers
  • location of the site's list of URLs