trabajopolis.bo
robots.txt

Robots Exclusion Standard data for trabajopolis.bo

Resource Scan

Scan Details

Site Domain trabajopolis.bo
Base Domain trabajopolis.bo
Scan Status Ok
Last Scan2024-06-08T04:27:07+00:00
Next Scan 2024-06-15T04:27:07+00:00

Last Scan

Scanned2024-06-08T04:27:07+00:00
URL https://trabajopolis.bo/robots.txt
Redirect https://www.trabajopolis.bo/robots.txt
Redirect Domain www.trabajopolis.bo
Redirect Base trabajopolis.bo
Domain IPs 172.66.40.212, 172.66.43.44, 2606:4700:3108::ac42:28d4, 2606:4700:3108::ac42:2b2c
Redirect IPs 172.66.40.212, 172.66.43.44, 2606:4700:3108::ac42:28d4, 2606:4700:3108::ac42:2b2c
Response IP 172.66.43.44
Found Yes
Hash da91f7e0fac2abe3f742c5e56c457d78c2c515c3ff01d8e122bd315b46dd9d61
SimHash 05054e5c8e8a

Groups

ia_archiver

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sitecheckerbotcrawler

Rule Path
Disallow /

*

Rule Path
Disallow /ayuda-crear-cv
Disallow /display-job
Disallow /files/pictures
Disallow /find-jobs
Disallow /manage-listing
Disallow /my-account
Disallow /oferta-de-trabajo-y-empleo-en-bolivia
Disallow /registrarse-para-publicar-empleos-y-trabajos-en-bolivia
Disallow /save-search
Disallow /saved-ads
Disallow /search-results-jobs
Disallow /seleccionar-tipo-de-publicacion
Disallow /templates/Trabajopolis.bo

Other Records

Field Value
sitemap https://www.trabajopolis.bo/sitemap.xml