mallsinamerica.com
robots.txt

Robots Exclusion Standard data for mallsinamerica.com

Resource Scan

Scan Details

Site Domain mallsinamerica.com
Base Domain mallsinamerica.com
Scan Status Ok
Last Scan2024-10-29T23:28:23+00:00
Next Scan 2024-11-05T23:28:23+00:00

Last Scan

Scanned2024-10-29T23:28:23+00:00
URL https://mallsinamerica.com/robots.txt
Redirect https://www.mallsinamerica.com/robots.txt
Redirect Domain www.mallsinamerica.com
Redirect Base mallsinamerica.com
Domain IPs 52.15.101.156
Redirect IPs 13.226.2.101, 13.226.2.28, 13.226.2.34, 13.226.2.82, 2600:9000:2795:1400:4:cb9b:2700:93a1, 2600:9000:2795:1600:4:cb9b:2700:93a1, 2600:9000:2795:5200:4:cb9b:2700:93a1, 2600:9000:2795:8000:4:cb9b:2700:93a1, 2600:9000:2795:8a00:4:cb9b:2700:93a1, 2600:9000:2795:ca00:4:cb9b:2700:93a1, 2600:9000:2795:cc00:4:cb9b:2700:93a1, 2600:9000:2795:d600:4:cb9b:2700:93a1
Response IP 13.226.2.82
Found Yes
Hash dfe6a80296d45224d12367376b3a423632c6eace8e16403a2626a77d53e61a81
SimHash 7f5c90c38191

Groups

*

Rule Path
Disallow /ajax/

neevabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.mallsinamerica.com/Sitemap_index.xml