thepurepolitics.com
robots.txt
Robots Exclusion Standard data for thepurepolitics.com
Resource Scan
Scan Details
Site Domain | thepurepolitics.com |
Base Domain | thepurepolitics.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-11-01T03:03:12+00:00 |
Next Scan | 2025-01-30T03:03:12+00:00 |
Last Successful Scan
Scanned | 2024-04-06T03:01:03+00:00 |
URL | https://thepurepolitics.com/robots.txt |
Domain IPs | 162.241.191.186 |
Response IP | 162.241.191.186 |
Found | Yes |
Hash | 960696905f1ae3622a059758872cd4548704918074e5f11f27b17129f7d57ffa |
SimHash | 2190abe39870 |
Groups
*
Rule | Path |
---|---|
Disallow | /this-day-in-history/ |
Disallow | /cgi-bin |
Disallow | /? |
Disallow | /wp- |
Disallow | *?s= |
Disallow | *%26s%3D |
Disallow | *?attachment_id= |
Disallow | */embed |
Disallow | */page/ |
Allow | */uploads |
Allow | /*/*.js |
Allow | /*/*.css |
Allow | /wp-*.png |
Allow | /wp-*.jpg |
Allow | /wp-*.jpeg |
Allow | /wp-*.gif |
Allow | /wp-*.svg |
Allow | /wp-*.pdf |
Allow | */feed |
Allow | */rss |
Comments