freshbus.com
robots.txt

Robots Exclusion Standard data for freshbus.com

Resource Scan

Scan Details

Site Domain freshbus.com
Base Domain freshbus.com
Scan Status Ok
Last Scan2026-02-23T22:45:31+00:00
Next Scan 2026-03-09T22:45:31+00:00

Last Scan

Scanned2026-02-23T22:45:31+00:00
URL https://freshbus.com/robots.txt
Redirect https://www.freshbus.com/robots.txt
Redirect Domain www.freshbus.com
Redirect Base freshbus.com
Domain IPs 104.18.16.237, 104.18.17.237, 2606:4700::6812:10ed, 2606:4700::6812:11ed
Redirect IPs 104.18.16.237, 104.18.17.237, 2606:4700::6812:10ed, 2606:4700::6812:11ed
Response IP 104.18.17.237
Found Yes
Hash 691ba74eda552e780948b0c3cf48f03fb1952eaac4380d748241e636669efaac
SimHash 69449d52c731

Groups

*

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.freshbus.com/sitemap.xml