weddinggawker.com
robots.txt

Robots Exclusion Standard data for weddinggawker.com

Resource Scan

Scan Details

Site Domain weddinggawker.com
Base Domain weddinggawker.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-21T17:55:03+00:00
Next Scan 2024-11-19T17:55:03+00:00

Last Successful Scan

Scanned2024-04-24T17:19:11+00:00
URL https://weddinggawker.com/robots.txt
Domain IPs 66.55.84.236
Response IP 66.55.84.236
Found Yes
Hash 509323c840461b03f1f92ddd1ffbb1f05d4b758d71d1da0ef1ef6a3828b8805a
SimHash 311ed595eef9

Groups

twitterbot

Rule Path
Allow /wp-content/*
Allow */wp-content/*

*

Rule Path
Disallow /cgi-bin/*
Disallow */cgi-bin/*
Disallow /scripts/*
Disallow */scripts/*
Disallow /wp-admin/*
Disallow */wp-admin/*
Disallow /wp-includes/*
Disallow */wp-includes/*
Disallow /feed/*
Disallow */feed/*
Disallow /trackback/*
Disallow */trackback/*
Disallow /xmlrpc.php
Disallow */xmlrpc.php
Disallow /install.php
Disallow */install.php
Disallow /wp-login.php
Disallow */wp-login.php
Disallow /wp-register.php
Disallow */wp-register.php
Disallow /wp-comments-post.php
Disallow */wp-comments-post.php
Disallow /*.php$
Disallow */*.php$
Disallow /submissions/*
Disallow */submissions/*
Disallow /submit/*
Disallow */submit/*
Disallow /login/*
Disallow */login/*
Disallow */register/*
Disallow */share/*
Disallow /wp-rss2.php

msnbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://weddinggawker.com/sitemap-may-16-2016.xml.gz
sitemap http://weddinggawker.com/sitemap-wg-search.xml
sitemap http://weddinggawker.com/sitemap.xml.gz

Comments

  • Disallow: /wp-content/*
  • Disallow: */wp-content/*

Warnings

  • 2 invalid lines.