werkenbijjessa.be
robots.txt

Robots Exclusion Standard data for werkenbijjessa.be

Resource Scan

Scan Details

Site Domain werkenbijjessa.be
Base Domain werkenbijjessa.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-14T15:12:52+00:00
Next Scan 2024-07-13T15:12:52+00:00

Last Successful Scan

Scanned2022-08-21T00:31:56+00:00
URL https://www.werkenbijjessa.be/robots.txt
Response IP 52.84.45.75
Found Yes
Hash 4f8f2a7c52bb0060a970c36c44fd2c67634db5f05bd7be137c8b3340bdbd0170
SimHash 1a1cfc026893

Groups

*

Rule Path
Disallow

blexbot

Rule Path
Disallow /

k6

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ggg

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.werkenbijjessa.be:80/sitemap.xml