Log In Sign Up

automap.it
robots.txt

Robots Exclusion Standard data for automap.it

Resource Scan

Scan Details

Site Domain automap.it
Base Domain automap.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-08T13:55:42+00:00
Next Scan 2024-10-15T13:55:42+00:00

Last Successful Scan

Scanned2024-09-30T13:55:16+00:00
URL https://automap.it/robots.txt
Redirect https://www.automap.it/robots.txt
Redirect Domain www.automap.it
Redirect Base automap.it
Domain IPs 46.37.25.130
Redirect IPs 46.37.25.130
Response IP 46.37.25.130
Found Yes
Hash f45d4bcb951899d07f81749f7098ecb598e47ae09cb6169411fd83dd7d365c7d
SimHash 9b0d45d48f9b

Groups

ias_crawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

iaarchiver-1.0

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yahoo pipes 2.0

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.automap.it/sitemap.xml
Back to top

Comments

  • robots.txt
  • 01/08/2024
Back to top