Log In Sign Up

afa.net
robots.txt

Robots Exclusion Standard data for afa.net

Resource Scan

Scan Details

Site Domain afa.net
Base Domain afa.net
Scan Status Ok
Last Scan2025-12-28T01:55:52+00:00
Next Scan 2026-01-11T01:55:52+00:00

Last Scan

Scanned2025-12-28T01:55:52+00:00
URL https://afa.net/robots.txt
Domain IPs 104.21.31.47, 172.67.174.248, 2606:4700:3031::6815:1f2f, 2606:4700:3037::ac43:aef8
Response IP 172.67.174.248
Found Yes
Hash 178231e584fd84a9afa7d9aa18b1c5258b06e2ac631f5f0726f81b37a1a578fd
SimHash 3a127143ad31

Groups

*

Rule Path
Disallow /bin/
Disallow /config/
Disallow /umbraco/
Disallow /views/
Back to top

Other Records

Field Value
sitemap https://afa.net/sitemap/
Back to top

Comments

  • To add a comment to the file, start the line with the # character.
  • User-Agent is used to target a particular web crawler.
  • Any rules declared below it will apply to that User-Agent.
  • To hide a file or folder from the User-Agent, type the word 'Disallow' followed by a semi-colon.
Back to top