bourse-du-travail.com
robots.txt

Robots Exclusion Standard data for bourse-du-travail.com

Resource Scan

Scan Details

Site Domain bourse-du-travail.com
Base Domain bourse-du-travail.com
Scan Status Ok
Last Scan2024-06-30T13:12:31+00:00
Next Scan 2024-07-07T13:12:31+00:00

Last Scan

Scanned2024-06-30T13:12:31+00:00
URL https://bourse-du-travail.com/robots.txt
Redirect https://www.bourse-du-travail.com/robots.txt
Redirect Domain www.bourse-du-travail.com
Redirect Base bourse-du-travail.com
Domain IPs 94.23.12.129
Redirect IPs 94.23.12.129
Response IP 94.23.12.129
Found Yes
Hash ec6baca9ca7052fab101d1b168cd4babe9520eae79b84e0a89774b43ddc04fc8
SimHash 794958108411

Groups

*

Rule Path
Disallow

turnitinbot

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml