toplegal.it
robots.txt

Robots Exclusion Standard data for toplegal.it

Resource Scan

Scan Details

Site Domain toplegal.it
Base Domain toplegal.it
Scan Status Ok
Last Scan2024-11-15T01:09:36+00:00
Next Scan 2024-11-22T01:09:36+00:00

Last Scan

Scanned2024-11-15T01:09:36+00:00
URL https://toplegal.it/robots.txt
Redirect https://www.toplegal.it/robots.txt
Redirect Domain www.toplegal.it
Redirect Base toplegal.it
Domain IPs 82.223.120.89
Redirect IPs 82.223.120.89
Response IP 82.223.120.89
Found Yes
Hash 82582ab781951394eafaf372f287d41b93733dba3cff2ded79d8cd693b1b1495
SimHash 3a1a9940ee10

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

slurp

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /error.html
Disallow /app_data/
Disallow /app_plugins/
Disallow /bin/
Disallow /config/
Disallow /data/
Disallow /umbraco/
Disallow /views/

Other Records

Field Value
sitemap https://www.toplegal.it/sitemap.xml