Log In Sign Up

ap.no
robots.txt

Robots Exclusion Standard data for ap.no

Resource Scan

Scan Details

Site Domain ap.no
Base Domain ap.no
Scan Status Ok
Last Scan2024-10-27T13:12:39+00:00
Next Scan 2024-11-03T13:12:39+00:00

Last Scan

Scanned2024-10-27T13:12:39+00:00
URL https://ap.no/robots.txt
Redirect https://www.aftenposten.no/robots.txt
Redirect Domain www.aftenposten.no
Redirect Base aftenposten.no
Domain IPs 2600:9000:2250:3c00:16:d1b9:fbc0:93a1, 2600:9000:2250:4000:16:d1b9:fbc0:93a1, 2600:9000:2250:5c00:16:d1b9:fbc0:93a1, 2600:9000:2250:6c00:16:d1b9:fbc0:93a1, 2600:9000:2250:800:16:d1b9:fbc0:93a1, 2600:9000:2250:9a00:16:d1b9:fbc0:93a1, 2600:9000:2250:9e00:16:d1b9:fbc0:93a1, 2600:9000:2250:b200:16:d1b9:fbc0:93a1, 3.164.182.110, 3.164.182.21, 3.164.182.71, 3.164.182.95
Redirect IPs 195.88.54.137, 195.88.55.137, 2001:67c:21e0::ab0
Response IP 195.88.54.137
Found Yes
Hash 8ec3bfc048cc1bbcbcf8e3ba37db6172f091d073ef0e288f2dbd341d7ea14adb
SimHash 8e75416bcff7

Groups

*

Rule Path
Disallow /config/
Disallow /template/
Disallow /incoming/
Disallow /WEB-INF/
Disallow /META-INF/
Disallow /feed/externalheader/
Disallow /feed/externalfooter/
Disallow /adtest/
Disallow /henvisninger/div/
Disallow /sok
Disallow /kampanje/
Disallow /widgets/
Disallow /personalized-frontpage-feed

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Comments

  • Aftenposten does not permit unlicensed use of our content for training large language models or other
  • artificial intelligence technology. All use, reproductions and extractions of our content for
  • such purposes require specific # approval by Aftenposten. We explicitly disallow text and data mining and
  • all other technical means desig# ned to or with the effect that they enable unlicensed use,
  • reproduction or extraction of o# ur content for training AI models.
Back to top