Log In Sign Up

beta.biblegateway.com
robots.txt

Robots Exclusion Standard data for beta.biblegateway.com

Resource Scan

Scan Details

Site Domain beta.biblegateway.com
Base Domain biblegateway.com
Scan Status Ok
Last Scan2024-05-09T22:22:09+00:00
Next Scan 2024-05-16T22:22:09+00:00

Last Scan

Scanned2024-05-09T22:22:09+00:00
URL https://beta.biblegateway.com/robots.txt
Redirect https://www.biblegateway.com/robots.txt
Redirect Domain www.biblegateway.com
Redirect Base biblegateway.com
Domain IPs 18.155.68.10, 18.155.68.22, 18.155.68.72, 18.155.68.73, 2600:9000:23d2:1400:2:cabc:e000:93a1, 2600:9000:23d2:2c00:2:cabc:e000:93a1, 2600:9000:23d2:3c00:2:cabc:e000:93a1, 2600:9000:23d2:5000:2:cabc:e000:93a1, 2600:9000:23d2:8a00:2:cabc:e000:93a1, 2600:9000:23d2:a000:2:cabc:e000:93a1, 2600:9000:23d2:b000:2:cabc:e000:93a1, 2600:9000:23d2:d400:2:cabc:e000:93a1
Redirect IPs 108.156.133.41, 108.156.133.66, 108.156.133.84, 108.156.133.97, 2600:9000:2755:1200:1f:9383:73c0:93a1, 2600:9000:2755:1a00:1f:9383:73c0:93a1, 2600:9000:2755:6400:1f:9383:73c0:93a1, 2600:9000:2755:7800:1f:9383:73c0:93a1, 2600:9000:2755:8a00:1f:9383:73c0:93a1, 2600:9000:2755:c800:1f:9383:73c0:93a1, 2600:9000:2755:e400:1f:9383:73c0:93a1, 2600:9000:2755:ec00:1f:9383:73c0:93a1
Response IP 108.156.133.84
Found Yes
Hash bdfe24fdff5487ae562443ed1c91b5f9cb84487c93a955106b46e13b157a5859
SimHash 09050c090d93

Groups

*

Rule Path
Disallow /cgi-bin/guestbook
Disallow /feedback
Disallow /user
Disallow /6177/
Disallow /12741980/
Back to top

Other Records

Field Value
sitemap https://www.biblegateway.com/site-map/map-index.xml
Back to top