roccitynews.com
robots.txt
Robots Exclusion Standard data for roccitynews.com
Resource Scan
Scan Details
Site Domain | roccitynews.com |
Base Domain | roccitynews.com |
Scan Status | Ok |
Last Scan | 2024-05-22T08:07:34+00:00 |
Next Scan | 2024-05-29T08:07:34+00:00 |
Last Scan
Scanned | 2024-05-22T08:07:34+00:00 |
URL | https://roccitynews.com/robots.txt |
Redirect | https://www.roccitymag.com/robots.txt |
Redirect Domain | www.roccitymag.com |
Redirect Base | roccitymag.com |
Domain IPs | 104.21.61.25, 172.67.205.45, 2606:4700:3032::ac43:cd2d, 2606:4700:3033::6815:3d19 |
Redirect IPs | 104.21.64.204, 172.67.136.55, 2606:4700:3032::6815:40cc, 2606:4700:3033::ac43:8837 |
Response IP | 104.21.64.204 |
Found | Yes |
Hash | ae58288e784c3b17e2735a898913e0026af58eeb770f7ff0b573ebe308e12190 |
SimHash | 61663b016e72 |
Groups
*
Rule | Path |
---|---|
Disallow | /gyrobase/ArticleArchives |
Disallow | /gyrobase/CommentArchives |
Disallow | /gyrobase/EventSearch |
Disallow | /gyrobase/FilmSearch |
Disallow | /gyrobase/LocationSearch |
Disallow | /gyrobase/MovieTimes |
Disallow | /gyrobase/Search |
Disallow | /rochester/ArticleArchives |
Disallow | /rochester/CommentArchives |
Disallow | /rochester/EventSearch |
Disallow | /rochester/FilmSearch |
Disallow | /rochester/LocationSearch |
Disallow | /rochester/MovieTimes |
Disallow | /rochester/Search |
Other Records
Field | Value |
---|---|
sitemap | https://www.rochestercitynewspaper.com/rochester/Sitemap.xml |