gother.com
robots.txt

Robots Exclusion Standard data for gother.com

Resource Scan

Scan Details

Site Domain gother.com
Base Domain gother.com
Scan Status Ok
Last Scan2024-10-20T23:04:36+00:00
Next Scan 2024-11-03T23:04:36+00:00

Last Scan

Scanned2024-10-20T23:04:36+00:00
URL https://gother.com/robots.txt
Redirect https://www.gother.com/robots.txt
Redirect Domain www.gother.com
Redirect Base gother.com
Domain IPs 18.155.68.110, 18.155.68.15, 18.155.68.61, 18.155.68.75, 2600:9000:23d2:1c00:12:7744:60c0:93a1, 2600:9000:23d2:8400:12:7744:60c0:93a1, 2600:9000:23d2:8600:12:7744:60c0:93a1, 2600:9000:23d2:8c00:12:7744:60c0:93a1, 2600:9000:23d2:9000:12:7744:60c0:93a1, 2600:9000:23d2:9600:12:7744:60c0:93a1, 2600:9000:23d2:a400:12:7744:60c0:93a1, 2600:9000:23d2:c800:12:7744:60c0:93a1
Redirect IPs 18.155.68.110, 18.155.68.15, 18.155.68.61, 18.155.68.75, 2600:9000:23d2:4200:12:7744:60c0:93a1, 2600:9000:23d2:7e00:12:7744:60c0:93a1, 2600:9000:23d2:9600:12:7744:60c0:93a1, 2600:9000:23d2:9800:12:7744:60c0:93a1, 2600:9000:23d2:b400:12:7744:60c0:93a1, 2600:9000:23d2:d200:12:7744:60c0:93a1, 2600:9000:23d2:e800:12:7744:60c0:93a1, 2600:9000:23d2:f600:12:7744:60c0:93a1
Response IP 18.155.68.75
Found Yes
Hash ea50f9bc802074089506926c21cdd52750767104b181a3d59c1d95690a242dbe
SimHash ef7cdcc1e620

Groups

*

Rule Path
Disallow /_next/*

dataforseobot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mozilla/5.0 (compatible; rsiteauditor)

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.gother.com/sitemap.xml

Comments

  • *
  • DataForSeoBot
  • MegaIndex.ru
  • megaindex.com
  • BLEXBot
  • Mozilla/5.0 (compatible; RSiteAuditor)
  • AhrefsBot
  • Sitemaps