2gis.ae
robots.txt

Robots Exclusion Standard data for 2gis.ae

Resource Scan

Scan Details

Site Domain 2gis.ae
Base Domain 2gis.ae
Scan Status Ok
Last Scan2024-09-16T06:31:46+00:00
Next Scan 2024-09-30T06:31:46+00:00

Last Scan

Scanned2024-09-16T06:31:46+00:00
URL https://2gis.ae/robots.txt
Domain IPs 104.21.64.148, 172.67.152.30
Response IP 104.21.64.148
Found Yes
Hash 54a52b099626485d9d20f3d595ea22c4c534320cd4e201e25f5292f38cca21f5
SimHash 61024dc2a6b3

Groups

*

Rule Path
Disallow /_/*
Disallow /maps_action
Disallow /*printmode%3D
Disallow /*login_token%3D
Disallow /*reference%3D
Disallow /*stat%3D
Disallow */my$
Disallow */my?*
Disallow */my/*
Disallow */user*
Disallow *?refHash*
Disallow /geo/70030076128110973

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.2

Other Records

Field Value
sitemap https://2gis.ae/sitemap.xml

Comments

  • Yandex-only

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.