csorbatamas.hu
robots.txt

Robots Exclusion Standard data for csorbatamas.hu

Resource Scan

Scan Details

Site Domain csorbatamas.hu
Base Domain csorbatamas.hu
Scan Status Ok
Last Scan2025-09-17T08:58:44+00:00
Next Scan 2025-10-17T08:58:44+00:00

Last Scan

Scanned2025-09-17T08:58:44+00:00
URL https://csorbatamas.hu/robots.txt
Domain IPs 91.204.209.23
Response IP 91.204.209.23
Found Yes
Hash 8db41c0068128d4f3ad42e929fc8c2efb14ae7c197412aee927ac0994fd6924b
SimHash 195cde32ab33

Groups

*

Rule Path
Disallow /*.pdf$

*

Rule Path
Disallow /*.xlsx$

*

Rule Path
Disallow /*.doc$

*

Rule Path
Disallow /*.docx$

*

Rule Path
Disallow /*.xls$

*

Rule Path
Disallow /*.php$

*

Rule Path
Disallow /download.php

*

Rule Path
Disallow /ajax.php

unnecessarybot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /