gisearch.com
robots.txt

Robots Exclusion Standard data for gisearch.com

Resource Scan

Scan Details

Site Domain gisearch.com
Base Domain gisearch.com
Scan Status Ok
Last Scan2025-12-13T06:25:47+00:00
Next Scan 2025-12-20T06:25:47+00:00

Last Scan

Scanned2025-12-13T06:25:47+00:00
URL https://gisearch.com/robots.txt
Redirect https://www.gisearch.com/robots.txt
Redirect Domain www.gisearch.com
Redirect Base gisearch.com
Domain IPs 198.58.106.199
Redirect IPs 198.58.106.199
Response IP 198.58.106.199
Found Yes
Hash 8d2b38ae8dbf44975e1476a7df9113a9743db73f888bd6f6c2238f28f9ffc542
SimHash b098d596ee08

Groups

ahrefsbot
dotbot
exabot
gigabot
mj12bot
rogerbot
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
seokicks
dataforseobot

Rule Path
Disallow /

winkbot/0.06

Rule Path
Disallow /

winkbot/1.0

Rule Path
Disallow /

spock

Rule Path
Disallow /

spokespider/1.0

Rule Path
Disallow /

spokespider

Rule Path
Disallow /

disco/nutch-1.0-dev

Rule Path
Disallow /

iab

Rule Path
Disallow /

houxoucrawler/nutch-0.9

Rule Path
Disallow /

zibber-v0.1(www.zibb.com/crawler/)

Rule Path
Disallow /

netinfobot/1.0/nutch-0.9

Rule Path
Disallow /

rapleafbot

Rule Path
Disallow /

puf/1.0.0

Rule Path
Disallow /

Warnings

  • 2 invalid lines.