investiremag.it
robots.txt

Robots Exclusion Standard data for investiremag.it

Resource Scan

Scan Details

Site Domain investiremag.it
Base Domain investiremag.it
Scan Status Ok
Last Scan2024-11-09T21:42:26+00:00
Next Scan 2024-11-16T21:42:26+00:00

Last Scan

Scanned2024-11-09T21:42:26+00:00
URL https://investiremag.it/robots.txt
Domain IPs 35.214.178.185
Response IP 35.214.178.185
Found Yes
Hash da894ba1b85fd85c10cff0c56a7b0ce1a9a1094210c48ded2486b3c3cdefe3c8
SimHash 273add417096

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Comments

  • Simple Robots.txt 0.1