srch.ae
robots.txt

Robots Exclusion Standard data for srch.ae

Resource Scan

Scan Details

Site Domain srch.ae
Base Domain srch.ae
Scan Status Ok
Last Scan2024-09-23T01:37:00+00:00
Next Scan 2024-09-30T01:37:00+00:00

Last Scan

Scanned2024-09-23T01:37:00+00:00
URL https://srch.ae/robots.txt
Domain IPs 54.156.227.213
Response IP 54.156.227.213
Found Yes
Hash 83cbe45890e3eac8c7f7ff2a9c8e0b5edc4b49fa7288912195a34337fb90bdad
SimHash f07ec540ec7b

Groups

ahrefsbot

Rule Path
Disallow /

ucrawlr

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

metauri

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru/

Rule Path
Disallow /

mozilla/5.0+(compatible;+megaindex.ru/2.0;++http://megaindex.com/crawler)

Rule Path
Disallow /

mozilla/5.0+(compatible;+megaindex.ru/2.0;++http://megaindex.com/crawler)

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Comments

  • Ahrefs Backlink Analysis

Warnings

  • 4 invalid lines.