roccitymag.com
robots.txt
Robots Exclusion Standard data for roccitymag.com
Resource Scan
Scan Details
Site Domain | roccitymag.com |
Base Domain | roccitymag.com |
Scan Status | Ok |
Last Scan | 2024-05-23T16:10:51+00:00 |
Next Scan | 2024-05-30T16:10:51+00:00 |
Last Scan
Scanned | 2024-05-23T16:10:51+00:00 |
URL | https://roccitymag.com/robots.txt |
Redirect | https://www.roccitymag.com/robots.txt |
Redirect Domain | www.roccitymag.com |
Redirect Base | roccitymag.com |
Domain IPs | 104.21.64.204, 172.67.136.55, 2606:4700:3032::6815:40cc, 2606:4700:3033::ac43:8837 |
Redirect IPs | 104.21.64.204, 172.67.136.55, 2606:4700:3032::6815:40cc, 2606:4700:3033::ac43:8837 |
Response IP | 172.67.136.55 |
Found | Yes |
Hash | ae58288e784c3b17e2735a898913e0026af58eeb770f7ff0b573ebe308e12190 |
SimHash | 61663b016e72 |
Groups
*
Rule | Path |
---|---|
Disallow | /gyrobase/ArticleArchives |
Disallow | /gyrobase/CommentArchives |
Disallow | /gyrobase/EventSearch |
Disallow | /gyrobase/FilmSearch |
Disallow | /gyrobase/LocationSearch |
Disallow | /gyrobase/MovieTimes |
Disallow | /gyrobase/Search |
Disallow | /rochester/ArticleArchives |
Disallow | /rochester/CommentArchives |
Disallow | /rochester/EventSearch |
Disallow | /rochester/FilmSearch |
Disallow | /rochester/LocationSearch |
Disallow | /rochester/MovieTimes |
Disallow | /rochester/Search |
Other Records
Field | Value |
---|---|
sitemap | https://www.rochestercitynewspaper.com/rochester/Sitemap.xml |