pojdfotit.cz
robots.txt

Robots Exclusion Standard data for pojdfotit.cz

Resource Scan

Scan Details

Site Domain pojdfotit.cz
Base Domain pojdfotit.cz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-07T06:54:18+00:00
Next Scan 2025-10-05T06:54:18+00:00

Last Successful Scan

Scanned2025-03-10T06:52:48+00:00
URL https://pojdfotit.cz/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.64.1
Found Yes
Hash d51c856bbc260e4ec5cd07258c7de267a8f880d840197cf619e327ad3c3e8e35
SimHash 4b08d8c08011

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/
Disallow /cgi-bin/
Disallow /wp-includes/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.com
Disallow /wp-login.php
Disallow /comments/feed/

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://pojdfotit.cz/sitemap.xml
sitemap https://pojdfotit.cz/bpsitemap/sitemap_index.xml