metroactive.com
robots.txt

Robots Exclusion Standard data for metroactive.com

Resource Scan

Scan Details

Site Domain metroactive.com
Base Domain metroactive.com
Scan Status Ok
Last Scan2025-04-05T22:25:01+00:00
Next Scan 2025-04-12T22:25:01+00:00

Last Scan

Scanned2025-04-05T22:25:01+00:00
URL https://metroactive.com/robots.txt
Redirect http://www.metroactive.com/robots.txt
Redirect Domain www.metroactive.com
Redirect Base metroactive.com
Domain IPs 104.21.79.133, 172.67.145.188, 2606:4700:3030::6815:4f85, 2606:4700:3030::ac43:91bc
Redirect IPs 104.21.79.133, 172.67.145.188, 2606:4700:3030::6815:4f85, 2606:4700:3030::ac43:91bc
Response IP 104.21.79.133
Found Yes
Hash 6caabb610a2f0a11623f562b31907096e2ff54f597bc08162969ab64f0dfb72e
SimHash 4a18dcf0ea13

Groups

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1