permadi.com
robots.txt

Robots Exclusion Standard data for permadi.com

Resource Scan

Scan Details

Site Domain permadi.com
Base Domain permadi.com
Scan Status Ok
Last Scan2024-11-15T23:43:11+00:00
Next Scan 2024-11-22T23:43:11+00:00

Last Scan

Scanned2024-11-15T23:43:11+00:00
URL https://permadi.com/robots.txt
Domain IPs 173.231.196.19
Response IP 173.231.196.19
Found Yes
Hash 923a6356d351d402a1cb51328c3da15659a157f457e166033cb993a5bd0ef6a3
SimHash 27797ba5c682

Groups

adsbot-google
googlebot
yandex
bingbot
baiduspider
slurp
googlebot-image
googlebot-mobile
googlebot-news
baiduspider-image
baiduspider-mobile
baiduspider-news
baiduspider-video
msnbot
msnbot-media
amazonbot

Rule Path
Disallow /poster/
Disallow /ads/
Disallow /cgi-bin/
Disallow /fpcgi/
Disallow /canvasImages/
Disallow /wp-admin/

amazonbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /