bikeroar.com
robots.txt
Robots Exclusion Standard data for bikeroar.com
Resource Scan
Scan Details
Site Domain | bikeroar.com |
Base Domain | bikeroar.com |
Scan Status | Ok |
Last Scan | 2024-05-31T10:58:28+00:00 |
Next Scan | 2024-06-07T10:58:28+00:00 |
Last Scan
Scanned | 2024-05-31T10:58:28+00:00 |
URL | https://bikeroar.com/robots.txt |
Redirect | https://www.bikeroar.com/robots.txt |
Redirect Domain | www.bikeroar.com |
Redirect Base | bikeroar.com |
Domain IPs | 104.26.4.113, 104.26.5.113, 172.67.72.224 |
Redirect IPs | 104.26.4.113, 104.26.5.113, 172.67.72.224 |
Response IP | 104.26.5.113 |
Found | Yes |
Hash | c9d7fb57924e2aae65b0acaeb9997c1c652362cf647f602d946640524a4dfd07 |
SimHash | f875aa074810 |
Groups
*
Rule | Path |
---|---|
Disallow | /buy/ |
Disallow | /cdn-cgi/ |
Disallow | /members/29 |
Disallow | /strores/ |
Disallow | /admin/ |
Disallow | /local_bike_stores/ |
Disallow | /local_bike_store/ |
Disallow | /product_categories/ |
Disallow | /charity |
Disallow | /captcha |
Disallow | /captcha/ |
Disallow | /product_categories |
Disallow | /article_categories |
Disallow | /tip_categories |
Disallow | /events |
Disallow | /a4cac43bb231cdb5e22d31eaf82ceacb.html |
Disallow | /__export/ |
Disallow | /_arke3/ |
Disallow | /_bundles/ |
Disallow | /_common/ |
Disallow | /_inc/ |
Disallow | /_js/ |
Disallow | /_layouts/ |
Disallow | /_public/ |
Disallow | /_public/ |
Disallow | /adm/ |
Disallow | /administration/ |
Disallow | /ajx/ |
Disallow | /anyoneking/ |
Disallow | /App_Themes/ |
Disallow | /assets/js/ |
Disallow | /backbone/ |
Disallow | /bidincl/ |
Disallow | /build/ |
Disallow | /bundles/ |
Disallow | /cache/ |
Disallow | /cci_new_v3/ |
Disallow | /cfs-file/ |
Disallow | /common/ |
Disallow | /company/ |
Disallow | /csp/ |
Disallow | /css/ |
Disallow | /deals/ |
Disallow | /design/ |
Disallow | /DesktopModules/ |
Disallow | /dev/ |
Disallow | /es/ |
Disallow | /etc/ |
Disallow | /f/ |
Disallow | /fd/ |
Disallow | /files/ |
Disallow | /finance/ |
Disallow | /global/ |
Disallow | /handler/ |
Disallow | /head/ |
Disallow | /HTML/ |
Disallow | /imgs/ |
Disallow | /includes/ |
Disallow | /js/ |
Disallow | /JS/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /lightbox/ |
Disallow | /mediafile/ |
Disallow | /mianfeilunwen/ |
Disallow | /minify/ |
Disallow | /modules/ |
Disallow | /oracle_smp_chronos/ |
Disallow | /pics/ |
Disallow | /plugin/ |
Disallow | /Portals/ |
Disallow | /profile_async/ |
Disallow | /queens/ |
Disallow | /queens_korea/ |
Disallow | /Resources/ |
Disallow | /s/ |
Disallow | /script/ |
Disallow | /Script/ |
Disallow | /scripts/ |
Disallow | /Scripts/ |
Disallow | /Services/ |
Disallow | /site/ |
Disallow | /skin/ |
Disallow | /Skin/ |
Disallow | /sso/ |
Disallow | /static/ |
Disallow | /static_media/ |
Disallow | /Styles/ |
Disallow | /templates/ |
Disallow | /themes/ |
Disallow | /tplimg/ |
Disallow | /tracking/ |
Disallow | /user_data/ |
Disallow | /utility/ |
Disallow | /var/ |
Disallow | /w/ |
Disallow | /webdata/ |
Disallow | /wikipedia_en_wp1/ |
Disallow | /wp-admin/ |
Disallow | /wp-content/ |
Disallow | /wp-includes/ |
Disallow | /wyoming-and-northern-colorado/ |
Disallow | /pages.rss |
Other Records
Field | Value |
---|---|
sitemap | https://www.bikeroar.com/sitemap.xml.gz |
Comments