tekstowo.pl
robots.txt

Robots Exclusion Standard data for tekstowo.pl

Resource Scan

Scan Details

Site Domain tekstowo.pl
Base Domain tekstowo.pl
Scan Status Ok
Last Scan2024-11-02T16:41:40+00:00
Next Scan 2024-11-09T16:41:40+00:00

Last Scan

Scanned2024-11-02T16:41:40+00:00
URL https://tekstowo.pl/robots.txt
Domain IPs 2001:41d0:602:383f::fafa:fefe, 54.37.134.30
Response IP 54.37.134.30
Found Yes
Hash cebe2b3972ef396f47c4f81c52da8524de6662ecc41d5fce6cf4722ef28a3917
SimHash 6714c050c735

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5