Log In Sign Up

sermonlab.org
robots.txt

Robots Exclusion Standard data for sermonlab.org

Resource Scan

Scan Details

Site Domain sermonlab.org
Base Domain sermonlab.org
Scan Status Ok
Last Scan2025-09-15T14:45:48+00:00
Next Scan 2025-10-15T14:45:48+00:00

Last Scan

Scanned2025-09-15T14:45:48+00:00
URL https://sermonlab.org/robots.txt
Domain IPs 2a02:4780:15:a695:1f27:9475:7e2b:8f7c, 2a02:4780:16:1ca7:7ed8:1bc9:5c50:fb35, 84.32.84.135, 84.32.84.184
Response IP 77.37.115.124
Found Yes
Hash 076a858e6e44aa4d1b0168e7d7bb9e3cc2966cdb987934a92b32430691c0a33b
SimHash 38101558c9e1

Groups

*
twitterbot

Rule Path
Allow /images

facebookexternalhit

Rule Path
Allow /images
Back to top

Comments

  • Disallow everything.
  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared.
Back to top