aopa.org
robots.txt

Robots Exclusion Standard data for aopa.org

Resource Scan

Scan Details

Site Domain aopa.org
Base Domain aopa.org
Scan Status Ok
Last Scan2024-10-16T14:45:45+00:00
Next Scan 2024-11-15T14:45:45+00:00

Last Scan

Scanned2024-10-16T14:45:45+00:00
URL https://aopa.org/robots.txt
Domain IPs 104.20.67.64, 104.20.68.64, 172.67.17.109, 2606:4700:10::6814:4340, 2606:4700:10::6814:4440, 2606:4700:10::ac43:116d
Response IP 172.67.17.109
Found Yes
Hash c0e836723741d06f25cf4b17333e2e5832819646d3c5526b287acd9becaad40e
SimHash 74257663c515

Groups

*

Rule Path Comment
Disallow /admin/ this will exclude all AOPA administered folders
Disallow /webadmin/ this will exclude all AOPA administered folders
Disallow /test this will exclude all folders AND files named test
Disallow /authentication/ this will exclude all authentication folders
Disallow /cfide/ this will disallow the ColdFusion administration
Disallow /CFIDE/ this will disallow the ColdFusion administration
Disallow /includes/ this will disallow CFIncludes
Disallow /templates/ this will disallow CF templates
Disallow /cgi-bin/ this will exclude any cgi scripts
Disallow /members/airports/ustprocs.cfm this will disallow all terminal procedures
Disallow /online_gallery/ this will disallow the vspider from creating virtual pages for every db entry
Disallow /asf/ntsb/searchResults.cfm this will disallow the vspider from creating virtual pages for every db entry
Disallow /members/ disallow members for everyone but us
Disallow /weatheraero this will exclude hits to the weatheraero proxy
Disallow /sitecore/ Prevents indexing of sitecore content
Disallow /Lightboxes/ this will prevent lightboxes from being indexed
Disallow /ExternalPages/ -
Disallow /pic-archive/ Prevents indexing of everything PIC uses as reference material
Disallow /training-and-safety/pic-archive/ Prevents indexing of everything PIC Uses as reference material

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.aopa.org/sitemap.xml

Comments

  • Allowing login to be indexed to show in Organic Search results
  • Disallow: /login/ #disallow all hits to login