thephoto-news.com
robots.txt
Robots Exclusion Standard data for thephoto-news.com
Resource Scan
Scan Details
Site Domain | thephoto-news.com |
Base Domain | thephoto-news.com |
Scan Status | Ok |
Last Scan | 2024-11-16T06:05:26+00:00 |
Next Scan | 2024-11-23T06:05:26+00:00 |
Last Scan
Scanned | 2024-11-16T06:05:26+00:00 |
URL | https://thephoto-news.com/robots.txt |
Redirect | https://www.thephoto-news.com/robots.txt |
Redirect Domain | www.thephoto-news.com |
Redirect Base | thephoto-news.com |
Domain IPs | 129.213.199.43, 129.213.77.43 |
Redirect IPs | 129.213.199.43, 129.213.77.43 |
Response IP | 129.213.77.43 |
Found | Yes |
Hash | 6ac004b49cdc24520106bd15fd221f8f6ec3f0b14a67ebaa5c5c0ecae5073801 |
SimHash | b85b78da8493 |
Groups
*
Rule | Path |
---|---|
Disallow | /news-portlet/metalocator/ |
Disallow | /news-portlet/html/teaser-viewer-portlet/teaser_page.jsp |
Disallow | /news-portlet/html/teaser-viewer-portlet/teaser_filter.jsp |
Disallow | /news-portlet/filterteaser/ |
Disallow | /news-portlet/getfilteropts/ |
Disallow | /tracking-portlet/html/ranking-viewer/ranking_details.jsp |
Disallow | /user-portlet/login-with/ |
Disallow | /user-portlet/edit-user-profile/ |
Disallow | /user-portlet/reset-credentials/ |
Disallow | /user-portlet/confirm-email/ |
Disallow | /user-portlet/refreshuserentitlements/ |
Disallow | /user-portlet/getEntitlements/ |
Disallow | /group/ |
Disallow | /user/ |
Disallow | /web/ |
Disallow | /image/ |
*
Rule | Path |
---|---|
Disallow | /news/police-fire |
Other Records
Field | Value |
---|---|
sitemap | https://www.thephoto-news.com/sitemap.xml |
sitemap | https://www.thephoto-news.com/sitemapforgoogle.xml |
sitemap | https://www.thephoto-news.com/megasitemap.xml |
Comments