mallsinamerica.com
robots.txt

Robots Exclusion Standard data for mallsinamerica.com

Resource Scan

Scan Details

Site Domain mallsinamerica.com
Base Domain mallsinamerica.com
Scan Status Ok
Last Scan2024-09-17T22:24:53+00:00
Next Scan 2024-09-24T22:24:53+00:00

Last Scan

Scanned2024-09-17T22:24:53+00:00
URL https://mallsinamerica.com/robots.txt
Redirect https://www.mallsinamerica.com/robots.txt
Redirect Domain www.mallsinamerica.com
Redirect Base mallsinamerica.com
Domain IPs 52.15.101.156
Redirect IPs 2600:9000:2795:3a00:4:cb9b:2700:93a1, 2600:9000:2795:4e00:4:cb9b:2700:93a1, 2600:9000:2795:9400:4:cb9b:2700:93a1, 2600:9000:2795:b400:4:cb9b:2700:93a1, 2600:9000:2795:be00:4:cb9b:2700:93a1, 2600:9000:2795:cc00:4:cb9b:2700:93a1, 2600:9000:2795:d400:4:cb9b:2700:93a1, 2600:9000:2795:f400:4:cb9b:2700:93a1, 3.164.85.10, 3.164.85.125, 3.164.85.80, 3.164.85.82
Response IP 13.226.2.101
Found Yes
Hash dfe6a80296d45224d12367376b3a423632c6eace8e16403a2626a77d53e61a81
SimHash 7f5c90c38191

Groups

*

Rule Path
Disallow /ajax/

neevabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.mallsinamerica.com/Sitemap_index.xml