induweb.pl
robots.txt

Robots Exclusion Standard data for induweb.pl

Resource Scan

Scan Details

Site Domain induweb.pl
Base Domain induweb.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-21T01:05:39+00:00
Next Scan 2026-02-19T01:05:39+00:00

Last Successful Scan

Scanned2025-04-02T22:03:04+00:00
URL https://induweb.pl/robots.txt
Domain IPs 104.21.1.177, 172.67.129.173, 2606:4700:3035::ac43:81ad, 2606:4700:3036::6815:1b1
Response IP 104.21.1.177
Found Yes
Hash 25bff034924300c29bd7fd4e44c6b8b76a823abebb6d3d345cf9fac3bb0558d3
SimHash d00c4360ed91

Groups

semrushbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://induweb.pl/sitemap.xml