gotobus.com
robots.txt

Robots Exclusion Standard data for gotobus.com

Resource Scan

Scan Details

Site Domain gotobus.com
Base Domain gotobus.com
Scan Status Ok
Last Scan2024-09-16T17:27:38+00:00
Next Scan 2024-09-23T17:27:38+00:00

Last Scan

Scanned2024-09-16T17:27:38+00:00
URL https://gotobus.com/robots.txt
Redirect https://www.gotobus.com/robots.txt
Redirect Domain www.gotobus.com
Redirect Base gotobus.com
Domain IPs 104.26.8.70, 104.26.9.70, 172.67.71.144, 2606:4700:20::681a:846, 2606:4700:20::681a:946, 2606:4700:20::ac43:4790
Redirect IPs 104.26.8.70, 104.26.9.70, 172.67.71.144, 2606:4700:20::681a:846, 2606:4700:20::681a:946, 2606:4700:20::ac43:4790
Response IP 104.26.9.70
Found Yes
Hash bdafe4f18f12ae787fd1ee1d50f7cdf9fa1f7f76a5dbaab29e798461a2278f40
SimHash 000cc855cd13

Groups

*

Rule Path
Disallow /xsl/
Disallow /goto/
Disallow /app/do/
Disallow /products/
Disallow /redirect/
Disallow /homepage/
Disallow /cart/
Disallow /cs/
Disallow /cgi-bin/ivycontent
Disallow /cgi-bin/ce
Disallow /cgi-bin/ivyu
Disallow /cgi-bin/ajax
Disallow /cgi-bin/v
Disallow /cgi-bin/o
Disallow /cgi-bin/ivyecom

Other Records

Field Value
sitemap https://www.gotobus.com/sitemap.xml