cricwaves.com
robots.txt
Robots Exclusion Standard data for cricwaves.com
Resource Scan
Scan Details
Site Domain | cricwaves.com |
Base Domain | cricwaves.com |
Scan Status | Ok |
Last Scan | 2024-09-23T03:42:13+00:00 |
Next Scan | 2024-09-30T03:42:13+00:00 |
Last Scan
Scanned | 2024-09-23T03:42:13+00:00 |
URL | https://cricwaves.com/robots.txt |
Redirect | https://www.cricwaves.com/robots.txt |
Redirect Domain | www.cricwaves.com |
Redirect Base | cricwaves.com |
Domain IPs | 104.21.88.225, 172.67.153.178, 2606:4700:3034::6815:58e1, 2606:4700:3035::ac43:99b2 |
Redirect IPs | 104.21.88.225, 172.67.153.178, 2606:4700:3034::6815:58e1, 2606:4700:3035::ac43:99b2 |
Response IP | 172.67.153.178 |
Found | Yes |
Hash | cf3fbc9aefcfb72c774626aa8c1db29c69ed7b7b1a6c68d5c5255f32749db0d5 |
SimHash | 68549855c715 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
googlebot
Rule | Path |
---|---|
Allow | /cricket/ |
Allow | /cricket/mobile/ |
Allow | /cricket/news/ |
Disallow | /fav/ |
Disallow | /admin/ |
Disallow | /xml |
Allow | /images |
Allow | /widget/ |
Allow | /tour/ |
Allow | /news/articles/ |
Allow | /player/ |
Allow | /flags/ |
Allow | /widgets |
Allow | /ratings/ |
Allow | /sitemap |
Allow | /mobile/ |
Allow | /cricket/stylesheets |
Allow | /cricket/js |
Allow | /cricket/images |
Allow | /cricket/static/widget/js |
Allow | /cricket/tour/ |
Allow | /cricket/news/articles/ |
Allow | /cricket/player/ |
Allow | /cricket/flags/ |
Allow | /cricket/widgets |
Allow | /cricket/widgets/ |
Allow | /cricket/ratings/ |
Disallow | /cricket/cpanel/ |
Disallow | /blogs/stylesheets |
Disallow | /blogs/js |
Disallow | /blogs/images |
Disallow | /blogs/editor |
Disallow | /blogs/ |
Disallow | /img_gallary/css |
Disallow | /dashboard/img_gallary/media |
Allow | /img_gallary/ |
Allow | /cricket/pages/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.cricwaves.com/sitemap-series.xml |
sitemap | http://www.cricwaves.com/sitemap.xml |