newsroom.ap.org
robots.txt

Robots Exclusion Standard data for newsroom.ap.org

Resource Scan

Scan Details

Site Domain newsroom.ap.org
Base Domain ap.org
Scan Status Ok
Last Scan2024-05-08T04:16:32+00:00
Next Scan 2024-06-07T04:16:32+00:00

Last Scan

Scanned2024-05-08T04:16:32+00:00
URL https://newsroom.ap.org/robots.txt
Domain IPs 125.252.230.127
Response IP 184.27.21.241
Found Yes
Hash 92e8fe5dc9a5175521b684df0263d22385c8f86d5369bfb494b3c859b11757e4
SimHash 231c195db6d1

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://newsroom.ap.org/sitemap.xml

Comments

  • NR robots.txt file
  • list directories robots are not allowed to index
  • list specific files robots are not allowed to index
  • Disallow: /startup?page=2
  • End of robots.txt file