codeproject.global.ssl.fastly.net
robots.txt

Robots Exclusion Standard data for codeproject.global.ssl.fastly.net

Resource Scan

Scan Details

Site Domain codeproject.global.ssl.fastly.net
Base Domain codeproject.global.ssl.fastly.net
Scan Status Ok
Last Scan2024-06-15T23:42:15+00:00
Next Scan 2024-06-22T23:42:15+00:00

Last Scan

Scanned2024-06-15T23:42:15+00:00
URL https://codeproject.global.ssl.fastly.net/robots.txt
Domain IPs 151.101.1.194, 151.101.129.194, 151.101.193.194, 151.101.65.194
Response IP 199.232.45.194
Found Yes
Hash aa4f643a19b3530f5858bc1f59281d751a1e120bb3488a6e4cefdc9b374b5148
SimHash 792e06594cd0

Groups

*

Rule Path
Disallow /Redir.aspx
Disallow /script/AdServe/Redir.aspx
Disallow /script/Catalog/Redir.aspx
Disallow /script/News/Redir.aspx
Disallow /search.aspx
Disallow /script/Membership/SendPassword.aspx
Disallow /script/Forums/SetOptions.aspx
Disallow /script/Membership/LogOn.aspx
Disallow /script/Membership/OAuthLogOn.aspx
Disallow /script/Articles/ArticleVersion.aspx
Disallow /script/Articles/ListVersions.aspx
Disallow /script/Articles/Download.aspx
Disallow /script/Articles/Delete.aspx
Disallow /script/Articles/Preview.aspx
Disallow /script/Articles/ViewHtml.aspx
Disallow /script/Articles/SubmissionWizard.aspx
Disallow /WebServices/
Disallow /Api/
Disallow /ResearchLibrary/

Other Records

Field Value
sitemap https://www.codeproject.com/SiteMap.xml

Comments

  • CodeProject.com
  • Robot Exclusion File - robots.txt
  • Author: Chris Maunder
  • Last Updated: 7 Jun 2019
  • Visit-Time: 1200-1700 # Only visit between 5pm and 10pm US EST
  • Ad links: Only Real Humans(tm) should be following these
  • These mostly redirect outside the site so don't bother
  • General Don't Bother pages
  • Discontinued so don't bother, please