Log In Sign Up

iesf.org
robots.txt

Robots Exclusion Standard data for iesf.org

Resource Scan

Scan Details

Site Domain iesf.org
Base Domain iesf.org
Scan Status Ok
Last Scan2024-06-12T21:18:18+00:00
Next Scan 2024-07-12T21:18:18+00:00

Last Scan

Scanned2024-06-12T21:18:18+00:00
URL https://iesf.org/robots.txt
Domain IPs 104.26.0.151, 104.26.1.151, 172.67.69.61, 2606:4700:20::681a:197, 2606:4700:20::681a:97, 2606:4700:20::ac43:453d
Response IP 104.26.1.151
Found Yes
Hash 91e8253508f5f350a62954f1e9ad6a1ed7d742697954f847077f7d84d69d30b2
SimHash 3c10b519e9e5

Groups

twitterbot

Rule Path
Allow /images

facebookexternalhit

Rule Path
Allow /images
Back to top

Comments

  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared.
Back to top