amerykański-sport.pl
robots.txt

Robots Exclusion Standard data for amerykański-sport.pl

Resource Scan

Scan Details

Site Domain amerykański-sport.pl
Base Domain amerykański-sport.pl
Scan Status Ok
Last Scan2025-04-22T03:50:17+00:00
Next Scan 2025-04-29T03:50:17+00:00

Last Scan

Scanned2025-04-22T03:50:17+00:00
URL https://amerykański-sport.pl/robots.txt
Redirect https://xn--amerykaski-sport-ozc.pl/robots.txt
Domain IPs 57.128.229.166
Response IP 57.128.229.166
Found Yes
Hash b86f6ef7df27ec4f7c81f0a411846c607fcac476d371028f9d7aa7fde980f19b
SimHash 101591125712

Groups

scrapy

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /