afterdawn.net
robots.txt
Robots Exclusion Standard data for afterdawn.net
Resource Scan
Scan Details
Site Domain | afterdawn.net |
Base Domain | afterdawn.net |
Scan Status | Ok |
Last Scan | 2024-09-14T18:36:28+00:00 |
Next Scan | 2024-09-21T18:36:28+00:00 |
Last Scan
Scanned | 2024-09-14T18:36:28+00:00 |
URL | http://afterdawn.net/robots.txt |
Redirect | https://www.afterdawn.com/robots.txt |
Redirect Domain | www.afterdawn.com |
Redirect Base | afterdawn.com |
Domain IPs | 94.237.124.239 |
Redirect IPs | 94.237.124.239 |
Response IP | 94.237.124.239 |
Found | Yes |
Hash | 18cce3d5581ba4c5604a8849f3a44ca8b3f55a3d25db86d769a0c0cd22156496 |
SimHash | 6314d07ae896 |
Groups
*
Rule | Path |
---|---|
Disallow | /software/general/notify_when_updated.cfm |
Disallow | /software/general/download.cfm |
Disallow | /software/general/add_review.cfm |
Disallow | /software/general/delete_review.cfm |
Disallow | /software/general/report_offensive_post.cfm |
Disallow | /software/general/report_offensive_post_2.cfm |
Disallow | /software/general/submit_new_2.cfm |
Disallow | /software/general/submit_screenshot.cfm |
Disallow | /software/general/submit_screenshot_2.cfm |
Disallow | /software/general/submit_software_description_change.cfm |
Disallow | /software/general/submit_software_description_change_2.cfm |
Disallow | /products/ |
Disallow | /tech_support/ |
Disallow | /ajax/ |
Disallow | /test_nick_availability.cfm |
Disallow | /skins/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.afterdawn.com/news_sitemap.cfm |
sitemap | http://www.afterdawn.com/sitemap_index.cfm |