sochicken.nl
robots.txt

Robots Exclusion Standard data for sochicken.nl

Resource Scan

Scan Details

Site Domain sochicken.nl
Base Domain sochicken.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-09T05:15:36+00:00
Next Scan 2024-12-08T05:15:36+00:00

Last Successful Scan

Scanned2023-02-11T15:45:26+00:00
URL https://sochicken.nl/robots.txt
Domain IPs 104.26.12.110, 104.26.13.110, 172.67.70.105, 2606:4700:20::681a:c6e, 2606:4700:20::681a:d6e, 2606:4700:20::ac43:4669
Response IP 172.67.70.105
Found Yes
Hash 2020a355ad3070b5e60b3c48e03485596ae8198cf798301eee45fafd1176ebe6
SimHash d23c5dc06c0b

Groups

*

Rule Path
Disallow /ga/*
Disallow /wp-admin/*
Disallow /wp-includes/*
Disallow /wp-content/plugins/*
Disallow /wp-content/cache/*
Disallow /adserver/*
Disallow /search/*
Disallow /shop/*

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

crystalsemantics

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-content/cache/

Comments

  • BEGIN W3TC ROBOTS
  • END W3TC ROBOTS

Warnings

  • 2 invalid lines.