Log In Sign Up

avstarnews.com
robots.txt

Robots Exclusion Standard data for avstarnews.com

Resource Scan

Scan Details

Site Domain avstarnews.com
Base Domain avstarnews.com
Scan Status Ok
Last Scan2026-02-20T06:04:56+00:00
Next Scan 2026-03-22T06:04:56+00:00

Last Scan

Scanned2026-02-20T06:04:56+00:00
URL https://avstarnews.com/robots.txt
Domain IPs 104.21.34.104, 172.67.159.25, 2606:4700:3034::6815:2268, 2606:4700:3034::ac43:9f19
Response IP 172.67.159.25
Found Yes
Hash c0efe1ce62623ba5eb90e18e0c0ae30795c6d3fee4f23112f51be332342e5f81
SimHash 4d5cc880e08b

Groups

googlebot

Rule Path
Disallow /our-favourite-websites-2021/
Disallow /contacts/

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /$

ahrefssiteaudit

Rule Path
Disallow /$
Back to top

Other Records

Field Value
sitemap https://avstarnews.com/sitemap.xml
sitemap https://avstarnews.com/sitemap.rss
sitemap https://avstarnews.com/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top