gorollick.com
robots.txt
Robots Exclusion Standard data for gorollick.com
Resource Scan
Scan Details
Site Domain | gorollick.com |
Base Domain | gorollick.com |
Scan Status | Ok |
Last Scan | 2024-09-24T10:48:41+00:00 |
Next Scan | 2024-10-01T10:48:41+00:00 |
Last Scan
Scanned | 2024-09-24T10:48:41+00:00 |
URL | https://gorollick.com/robots.txt |
Domain IPs | 52.159.106.128 |
Response IP | 52.159.106.128 |
Found | Yes |
Hash | 365dd43a9a5c74b617c59c7bbf0bde363c34eec8e2f1385c4cbb9f10e8b9c5a8 |
SimHash | 630767630ba7 |
Groups
*
Rule | Path |
---|---|
Disallow | /suggest/?* |
Disallow | /wp-admin/* |
Allow | /wp-admin/admin-ajax.php |
googlebot
Rule | Path |
---|---|
Disallow | /suggest/?* |
Disallow | /wp-admin/* |
Disallow | /relatedvehicle/* |
Disallow | /css/* |
Disallow | /scripts/* |
Disallow | /r/dealeroffers/* |
Disallow | /abenity/* |
Disallow | /beneplace/* |
Disallow | /lifemart/* |
Disallow | /benefithub/* |
Disallow | /samsclub/* |
Disallow | /nextjump/* |
Disallow | /perkspot/* |
Disallow | /lovemycreditunion/* |
Disallow | /aaa/* |
Disallow | /aca/* |
Disallow | /progressive/* |
Disallow | /statefarm/* |
Disallow | /sheerid/* |
Disallow | /sparkfly/* |
Disallow | /access/* |
Disallow | /EBG/* |
Disallow | /ebg/* |
Disallow | /eplee/* |
Disallow | /allstate/* |
Disallow | /nada/* |
Disallow | /jdp/* |
Disallow | /usnews/* |
Disallow | /ultimatemotorcycling/* |
Disallow | /ridermagazine/* |
Disallow | /rvblogger/* |
Disallow | /corestream/* |
Disallow | /r/*partner%3Djdp |
Disallow | /r/forms/lead |
Allow | /r/* |
Allow | /sitemaps/* |
Allow | /articles/* |
Allow | /robots.txt |
bingbot
Rule | Path |
---|---|
Disallow | /suggest/?* |
Disallow | /wp-admin/* |
Disallow | /relatedvehicle/* |
Disallow | /css/* |
Disallow | /scripts/* |
Disallow | /r/dealeroffers/* |
Disallow | /abenity/* |
Disallow | /beneplace/* |
Disallow | /lifemart/* |
Disallow | /benefithub/* |
Disallow | /samsclub/* |
Disallow | /nextjump/* |
Disallow | /perkspot/* |
Disallow | /lovemycreditunion/* |
Disallow | /aaa/* |
Disallow | /aca/* |
Disallow | /progressive/* |
Disallow | /statefarm/* |
Disallow | /sheerid/* |
Disallow | /sparkfly/* |
Disallow | /access/* |
Disallow | /EBG/* |
Disallow | /ebg/* |
Disallow | /eplee/* |
Disallow | /allstate/* |
Disallow | /nada/* |
Disallow | /jdp/* |
Disallow | /usnews/* |
Disallow | /ultimatemotorcycling/* |
Disallow | /ridermagazine/* |
Disallow | /rvblogger/* |
Disallow | /corestream/* |
Disallow | /r/*partner%3Djdp |
Disallow | /r/forms/lead |
Allow | /r/* |
Allow | /sitemaps/* |
Allow | /articles/* |
Allow | /robots.txt |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://gorollick.com/sitemaps/sitemap-index-atvs.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-boats.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-golfcarts.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-motorcycles.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-rvs.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-scooters.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-snowmobiles.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-watercrafts.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-utvs.xml |
sitemap | https://gorollick.com/articles/post-sitemap.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-usaa.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-atvs.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-boats.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-golfcarts.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-motorcycles.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-rvs.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-scooters.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-snowmobiles.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-watercrafts.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-utvs.xml |
sitemap | https://gorollick.com/articles/post-sitemap.xml |
sitemap | https://gorollick.com/sitemaps/sitemap-index-usaa.xml |
Warnings
- 10 invalid lines.
Comments