Log In Sign Up

biblegateway.com
robots.txt

Robots Exclusion Standard data for biblegateway.com

Resource Scan

Scan Details

Site Domain biblegateway.com
Base Domain biblegateway.com
Scan Status Ok
Last Scan2024-05-01T04:41:19+00:00
Next Scan 2024-05-08T04:41:19+00:00

Last Scan

Scanned2024-05-01T04:41:19+00:00
URL https://biblegateway.com/robots.txt
Redirect https://www.biblegateway.com/robots.txt
Redirect Domain www.biblegateway.com
Redirect Base biblegateway.com
Domain IPs 108.156.133.41, 108.156.133.66, 108.156.133.84, 108.156.133.97, 2600:9000:2755:2000:1f:9383:73c0:93a1, 2600:9000:2755:4200:1f:9383:73c0:93a1, 2600:9000:2755:5800:1f:9383:73c0:93a1, 2600:9000:2755:7a00:1f:9383:73c0:93a1, 2600:9000:2755:800:1f:9383:73c0:93a1, 2600:9000:2755:8a00:1f:9383:73c0:93a1, 2600:9000:2755:8c00:1f:9383:73c0:93a1, 2600:9000:2755:9c00:1f:9383:73c0:93a1
Redirect IPs 108.156.133.41, 108.156.133.66, 108.156.133.84, 108.156.133.97, 2600:9000:2755:1e00:1f:9383:73c0:93a1, 2600:9000:2755:5400:1f:9383:73c0:93a1, 2600:9000:2755:6200:1f:9383:73c0:93a1, 2600:9000:2755:7600:1f:9383:73c0:93a1, 2600:9000:2755:8200:1f:9383:73c0:93a1, 2600:9000:2755:9200:1f:9383:73c0:93a1, 2600:9000:2755:9c00:1f:9383:73c0:93a1, 2600:9000:2755:b600:1f:9383:73c0:93a1
Response IP 108.156.133.66
Found Yes
Hash bdfe24fdff5487ae562443ed1c91b5f9cb84487c93a955106b46e13b157a5859
SimHash 09050c090d93

Groups

*

Rule Path
Disallow /cgi-bin/guestbook
Disallow /feedback
Disallow /user
Disallow /6177/
Disallow /12741980/
Back to top

Other Records

Field Value
sitemap https://www.biblegateway.com/site-map/map-index.xml
Back to top