m.clevescene.com
robots.txt
Robots Exclusion Standard data for m.clevescene.com
Resource Scan
Scan Details
| Site Domain | m.clevescene.com |
| Base Domain | clevescene.com |
| Scan Status | Ok |
| Last Scan | 2024-05-08T11:35:17+00:00 |
| Next Scan | 2024-05-22T11:35:17+00:00 |
Last Scan
| Scanned | 2024-05-08T11:35:17+00:00 |
| URL | https://m.clevescene.com/robots.txt |
| Redirect | https://www.clevescene.com/robots.txt |
| Redirect Domain | www.clevescene.com |
| Redirect Base | clevescene.com |
| Domain IPs | 104.21.29.21, 172.67.171.67, 2606:4700:3035::6815:1d15, 2606:4700:3035::ac43:ab43 |
| Redirect IPs | 104.21.29.21, 172.67.171.67, 2606:4700:3035::6815:1d15, 2606:4700:3035::ac43:ab43 |
| Response IP | 172.67.171.67 |
| Found | Yes |
| Hash | f8869600dbc99e71cd01a36d3c55548a75df46321e47b84d15c0291d7909eb3d |
| SimHash | 70485d2491d0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cleveland/ArticleArchives |
| Disallow | /cleveland/CommentArchives |
| Disallow | /cleveland/EventSearch |
| Disallow | /cleveland/ImageArchives |
| Disallow | /cleveland/FilmSearch |
| Disallow | /cleveland/LocationSearch |
| Disallow | /cleveland/MemberSearch |
| Disallow | /cleveland/MovieTimes |
| Disallow | /cleveland/Search |
| Disallow | /cleveland/SlideshowArchives |
| Disallow | /cleveland/VideoArchives |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.clevescene.com/cleveland/Sitemap.xml |