gunderwear.nl
robots.txt

Robots Exclusion Standard data for gunderwear.nl

Resource Scan

Scan Details

Site Domain gunderwear.nl
Base Domain gunderwear.nl
Scan Status Ok
Last Scan2024-09-16T13:45:25+00:00
Next Scan 2024-10-16T13:45:25+00:00

Last Scan

Scanned2024-09-16T13:45:25+00:00
URL https://gunderwear.nl/robots.txt
Domain IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash 118463061fe1e67777d079908f8bf2bbe3718a477de56ce6a54c38cb8384f53d
SimHash c34d9c306d10

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

compspybot

Rule Path
Disallow /

gwm-gsa-crawler

Rule Path
Disallow /

linguee

Rule Path
Disallow /

appcodescrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

fatbot 2.0

Rule Path
Disallow /

ahc/1.0

Rule Path
Disallow /

ahc/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

bluechipbacklinks

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gunderwear.nl/wp-sitemap.xml