clevescene.com
robots.txt
Robots Exclusion Standard data for clevescene.com
Resource Scan
Scan Details
| Site Domain | clevescene.com |
| Base Domain | clevescene.com |
| Scan Status | Ok |
| Last Scan | 2024-04-22T18:25:24+00:00 |
| Next Scan | 2024-04-29T18:25:24+00:00 |
Last Scan
| Scanned | 2024-04-22T18:25:24+00:00 |
| URL | https://clevescene.com/robots.txt |
| Redirect | https://www.clevescene.com/robots.txt |
| Redirect Domain | www.clevescene.com |
| Redirect Base | clevescene.com |
| Domain IPs | 104.21.29.21, 172.67.171.67, 2606:4700:3035::6815:1d15, 2606:4700:3035::ac43:ab43 |
| Redirect IPs | 104.21.29.21, 172.67.171.67, 2606:4700:3035::6815:1d15, 2606:4700:3035::ac43:ab43 |
| Response IP | 172.67.171.67 |
| Found | Yes |
| Hash | 96b430fb1ac57eaa32ca64ad1a2af5dc37fd3db439d13033f537468c063e6515 |
| SimHash | 7848fcac9bf0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /gyrobase/ |
| Disallow | /cleveland/ArticleArchives |
| Disallow | /cleveland/CommentArchives |
| Disallow | /cleveland/EventSearch |
| Disallow | /cleveland/ImageArchives |
| Disallow | /cleveland/FilmSearch |
| Disallow | /cleveland/LocationSearch |
| Disallow | /cleveland/MemberSearch |
| Disallow | /cleveland/MovieTimes |
| Disallow | /cleveland/Search |
| Disallow | /cleveland/SlideshowArchives |
| Disallow | /cleveland/VideoArchives |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.clevescene.com/cleveland/Sitemap.xml |