qa11.weekendavisen-testing.dk
robots.txt

Robots Exclusion Standard data for qa11.weekendavisen-testing.dk

Resource Scan

Scan Details

Site Domain qa11.weekendavisen-testing.dk
Base Domain weekendavisen-testing.dk
Scan Status Ok
Last Scan2024-09-11T16:43:38+00:00
Next Scan 2024-10-11T16:43:38+00:00

Last Scan

Scanned2024-09-11T16:43:38+00:00
URL https://qa11.weekendavisen-testing.dk/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bd2, 2600:1413:b000:6::17d5:2bda, 96.17.96.16, 96.17.96.5
Response IP 23.44.5.65
Found Yes
Hash ac4170f7f423f9bad1d9057466b6a5d7c774cc3a80d2aa5c21ad104cbe497c3d
SimHash 9804d0028b33

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449