badaniaprenatalne.pl
robots.txt

Robots Exclusion Standard data for badaniaprenatalne.pl

Resource Scan

Scan Details

Site Domain badaniaprenatalne.pl
Base Domain badaniaprenatalne.pl
Scan Status Ok
Last Scan2025-09-15T10:48:34+00:00
Next Scan 2025-10-15T10:48:34+00:00

Last Scan

Scanned2025-09-15T10:48:34+00:00
URL https://badaniaprenatalne.pl/robots.txt
Domain IPs 146.59.106.44
Response IP 146.59.106.44
Found Yes
Hash 9c5e18d27417fcec780a54988780e51422c7fbaf0331d5d9cc61184ed4ef4ce8
SimHash e22062ee07b8

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /xmlrpc.php -
Disallow /?s= Block search queries to avoid duplicate content
Disallow /tag/ Block tag pages to avoid thin content
Allow /wp-admin/admin-ajax.php Allow AJAX for functionality

gptbot allow: /
chatgpt-user allow: /
anthropic-ai allow: /
claudebot allow: /
google-extended allow: /
perplexitybot allow: /
bytespider allow: /
ccbot allow: /
diffbot allow: /
facebookbot allow: /
omgili allow: /

No rules defined. All paths allowed.