net-empregos.com
robots.txt

Robots Exclusion Standard data for net-empregos.com

Resource Scan

Scan Details

Site Domain net-empregos.com
Base Domain net-empregos.com
Scan Status Ok
Last Scan2024-06-22T21:43:05+00:00
Next Scan 2024-06-29T21:43:05+00:00

Last Scan

Scanned2024-06-22T21:43:05+00:00
URL https://net-empregos.com/robots.txt
Redirect https://www.net-empregos.com/robots.txt
Redirect Domain www.net-empregos.com
Redirect Base net-empregos.com
Domain IPs 5.196.64.149
Redirect IPs 5.196.64.149
Response IP 5.196.64.149
Found Yes
Hash 9bf655bc5e5b937c84bf57334291d4bdcf84534bcf51f3d1b075e529c0872e8a
SimHash c10cc300ff71

Groups

*

Rule Path
Allow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.net-empregos.com/Sitemap.asp
sitemap http://www.net-empregos.com/rss.asp
sitemap http://www.net-empregos.com/rss_pesquisas.asp
sitemap http://www.net-empregos.com/trovit_all.asp
sitemap http://www.net-empregos.com/careerjet_all.asp
sitemap http://www.net-empregos.com/listagem_cv_livre.asp
sitemap http://www.net-empregos.com/listagem_livre3.asp