itay4.xyz
robots.txt

Robots Exclusion Standard data for itay4.xyz

Resource Scan

Scan Details

Site Domain itay4.xyz
Base Domain itay4.xyz
Scan Status Ok
Last Scan2025-10-19T16:31:35+00:00
Next Scan 2025-11-18T16:31:35+00:00

Last Scan

Scanned2025-10-19T16:31:35+00:00
URL https://itay4.xyz/robots.txt
Domain IPs 108.181.242.156
Response IP 108.181.242.156
Found Yes
Hash 8b6847d933b8e3ad8be9c75dd0e3b9ecda215e899afc65e6a6ffd2ef6a488a9a
SimHash 1018d542ea20

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefsbot

Rule Path
Allow /

mj12bot

Rule Path
Allow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /