photo2.weddinggawker.com
robots.txt
Robots Exclusion Standard data for photo2.weddinggawker.com
Resource Scan
Scan Details
Site Domain | photo2.weddinggawker.com |
Base Domain | weddinggawker.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-08-14T09:49:56+00:00 |
Next Scan | 2024-10-13T09:49:56+00:00 |
Last Successful Scan
Scanned | 2024-05-24T09:48:35+00:00 |
URL | https://photo2.weddinggawker.com/robots.txt |
Domain IPs | 108.156.133.55, 108.156.133.61, 108.156.133.69, 108.156.133.73 |
Response IP | 108.156.133.61 |
Found | Yes |
Hash | 509323c840461b03f1f92ddd1ffbb1f05d4b758d71d1da0ef1ef6a3828b8805a |
SimHash | 311ed595eef9 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/* |
Disallow | */cgi-bin/* |
Disallow | /scripts/* |
Disallow | */scripts/* |
Disallow | /wp-admin/* |
Disallow | */wp-admin/* |
Disallow | /wp-includes/* |
Disallow | */wp-includes/* |
Disallow | /feed/* |
Disallow | */feed/* |
Disallow | /trackback/* |
Disallow | */trackback/* |
Disallow | /xmlrpc.php |
Disallow | */xmlrpc.php |
Disallow | /install.php |
Disallow | */install.php |
Disallow | /wp-login.php |
Disallow | */wp-login.php |
Disallow | /wp-register.php |
Disallow | */wp-register.php |
Disallow | /wp-comments-post.php |
Disallow | */wp-comments-post.php |
Disallow | /*.php$ |
Disallow | */*.php$ |
Disallow | /submissions/* |
Disallow | */submissions/* |
Disallow | /submit/* |
Disallow | */submit/* |
Disallow | /login/* |
Disallow | */login/* |
Disallow | */register/* |
Disallow | */share/* |
Disallow | /wp-rss2.php |
Other Records
Field | Value |
---|---|
sitemap | http://weddinggawker.com/sitemap-may-16-2016.xml.gz |
sitemap | http://weddinggawker.com/sitemap-wg-search.xml |
sitemap | http://weddinggawker.com/sitemap.xml.gz |
Warnings
- 2 invalid lines.
Comments