kaszuby24.pl
robots.txt

Robots Exclusion Standard data for kaszuby24.pl

Resource Scan

Scan Details

Site Domain kaszuby24.pl
Base Domain kaszuby24.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-11T19:27:55+00:00
Next Scan 2025-02-09T19:27:55+00:00

Last Successful Scan

Scanned2023-04-21T14:11:17+00:00
URL https://kaszuby24.pl/robots.txt
Domain IPs 85.128.54.50
Response IP 85.128.54.50
Found Yes
Hash b4d19b94b96e50f7c31ef10e8a7c4b2f747c6ad9c00b25cb57eef888d6c04508
SimHash 6900da0083b2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://kaszuby24.pl/wp-sitemap.xml