metrotransit.org
robots.txt

Robots Exclusion Standard data for metrotransit.org

Resource Scan

Scan Details

Site Domain metrotransit.org
Base Domain metrotransit.org
Scan Status Ok
Last Scan2024-09-28T09:44:31+00:00
Next Scan 2024-10-28T09:44:31+00:00

Last Scan

Scanned2024-09-28T09:44:31+00:00
URL https://metrotransit.org/robots.txt
Redirect https://www.metrotransit.org/robots.txt
Redirect Domain www.metrotransit.org
Redirect Base metrotransit.org
Domain IPs 104.18.22.117, 104.18.23.117, 2606:4700::6812:1675, 2606:4700::6812:1775
Redirect IPs 104.18.22.117, 104.18.23.117, 2606:4700::6812:1675, 2606:4700::6812:1775
Response IP 104.18.23.117
Found Yes
Hash 08b2653b47f8c6d5ae3df2c5382bc3c9cd9bedd36bf08ce95dab8d23a4e44ace
SimHash 61c676e45392

Groups

*

Rule Path
Disallow /*.axd
Disallow /*.axd$
Disallow /CaptchaImage.ashx*
Disallow /*.csshandler.ashx
Disallow /*.csshandler.ashx$
Disallow /*.csshandler.ashx*
Disallow /?skin=
Disallow /ScriptResource.axd$
Disallow /ScriptResource.axd*
Disallow /Admin/
Disallow /App_Browsers/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_Themes/
Disallow /aspnet_client/
Disallow /bin/
Disallow /Blog/ViewCategory.aspx$
Disallow /Blog/ViewArchive.aspx$
Disallow /ClientScript/
Disallow /MyPage.aspx
Disallow /MyPage.aspx$
Disallow /MyPage.aspx*
Disallow /NeatHtml/
Disallow /NeatUpload/
Disallow /nofollow/
Disallow /nf/
Disallow /Secure/
Disallow /Services/TinyMCETemplates.ashx$
Disallow /SearchResults.aspx$
Disallow /SearchResults.aspx*
Disallow /SiteMap.aspx
Disallow /SiteOffice/
Disallow /Setup/
Disallow /WebStore/CartAdd.aspx$
Disallow /WebStore/CartAdd.aspx*
Disallow /WebStore/Cart.aspx$
Disallow /WebStore/Cart.aspx*
Disallow /Error.htm
Disallow /NexTripBadge.aspx*
Disallow /NextripBadge.aspx*
Disallow /nextripbadge.aspx*
Disallow /mobile/
Disallow /Mobile/
Disallow /nextrip/
Disallow /NexTrip/
Disallow /ADATools/
Disallow /adatools/
Disallow /M/
Disallow /m/
Disallow /schedules
Disallow /schedules/

baiduspider

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Allow /drive
Allow /drive/

Comments

  • robots.txt

Warnings

  • 2 invalid lines.