informatii-az.ro
robots.txt

Robots Exclusion Standard data for informatii-az.ro

Resource Scan

Scan Details

Site Domain informatii-az.ro
Base Domain informatii-az.ro
Scan Status Ok
Last Scan2024-06-01T19:20:08+00:00
Next Scan 2024-06-08T19:20:08+00:00

Last Scan

Scanned2024-06-01T19:20:08+00:00
URL https://informatii-az.ro/robots.txt
Redirect https://www.informatii-az.ro/robots.txt
Redirect Domain www.informatii-az.ro
Redirect Base informatii-az.ro
Domain IPs 104.21.81.65, 172.67.157.106, 2606:4700:3030::6815:5141, 2606:4700:3030::ac43:9d6a
Redirect IPs 104.21.81.65, 172.67.157.106, 2606:4700:3030::6815:5141, 2606:4700:3030::ac43:9d6a
Response IP 172.67.157.106
Found Yes
Hash 61cca28a9f4d3d8c64978b6ac0ae8b25b5eb1c1a7563e5f12582bf3a579bd808
SimHash 00085184fb20

Groups

*

Rule Path
Allow /

petalbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /stiri/cautare/*

Warnings

  • 2 invalid lines.