marawaresearch.com
robots.txt

Robots Exclusion Standard data for marawaresearch.com

Resource Scan

Scan Details

Site Domain marawaresearch.com
Base Domain marawaresearch.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-10T01:51:40+00:00
Next Scan 2024-11-08T01:51:40+00:00

Last Successful Scan

Scanned2024-04-13T01:44:44+00:00
URL https://marawaresearch.com/robots.txt
Domain IPs 104.21.62.65, 172.67.221.11, 2606:4700:3030::ac43:dd0b, 2606:4700:3037::6815:3e41
Response IP 172.67.221.11
Found Yes
Hash 818d8ead9c949d90c158bed98706ad9b64a7f2188aae1c7d1dfa7effd1b6a1b6
SimHash 5b44df656f94

Groups

*

Rule Path
Disallow */page*.php$
Disallow /map*.php$
Disallow /sitemap*.php$

Other Records

Field Value
sitemap https://marawaresearch.com/sitemap.xml
sitemap https://marawaresearch.com/c1/sitemap.xml
sitemap https://marawaresearch.com/c2/sitemap.xml
sitemap https://marawaresearch.com/c3/sitemap.xml
sitemap https://marawaresearch.com/c4/sitemap.xml
sitemap https://marawaresearch.com/c5/sitemap.xml
sitemap https://marawaresearch.com/c6/sitemap.xml

Warnings

  • `host` is not a known field.