legacy.biblegateway.com
robots.txt

Robots Exclusion Standard data for legacy.biblegateway.com

Resource Scan

Scan Details

Site Domain legacy.biblegateway.com
Base Domain biblegateway.com
Scan Status Ok
Last Scan2024-05-10T15:56:33+00:00
Next Scan 2024-05-17T15:56:33+00:00

Last Scan

Scanned2024-05-10T15:56:33+00:00
URL https://legacy.biblegateway.com/robots.txt
Redirect https://www.biblegateway.com/robots.txt
Redirect Domain www.biblegateway.com
Redirect Base biblegateway.com
Domain IPs 44.198.12.123, 54.225.140.133
Redirect IPs 108.156.133.41, 108.156.133.66, 108.156.133.84, 108.156.133.97, 2600:9000:2755:1400:1f:9383:73c0:93a1, 2600:9000:2755:1800:1f:9383:73c0:93a1, 2600:9000:2755:4800:1f:9383:73c0:93a1, 2600:9000:2755:4e00:1f:9383:73c0:93a1, 2600:9000:2755:5c00:1f:9383:73c0:93a1, 2600:9000:2755:8000:1f:9383:73c0:93a1, 2600:9000:2755:b200:1f:9383:73c0:93a1, 2600:9000:2755:b800:1f:9383:73c0:93a1
Response IP 108.156.133.41
Found Yes
Hash bdfe24fdff5487ae562443ed1c91b5f9cb84487c93a955106b46e13b157a5859
SimHash 09050c090d93

Groups

*

Rule Path
Disallow /cgi-bin/guestbook
Disallow /feedback
Disallow /user
Disallow /6177/
Disallow /12741980/

Other Records

Field Value
sitemap https://www.biblegateway.com/site-map/map-index.xml