geekwisdom.org
robots.txt

Robots Exclusion Standard data for geekwisdom.org

Resource Scan

Scan Details

Site Domain geekwisdom.org
Base Domain geekwisdom.org
Scan Status Ok
Last Scan2024-06-15T10:57:56+00:00
Next Scan 2024-07-15T10:57:56+00:00

Last Scan

Scanned2024-06-15T10:57:56+00:00
URL https://geekwisdom.org/robots.txt
Domain IPs 2607:f1c0:100f:f000::269, 74.208.236.224
Response IP 74.208.236.224
Found Yes
Hash 411954e15fbe2c4eb9c47d6d4db56cbd631f08865db9a6236714c060b72f8edb
SimHash e0314813d3d9

Groups

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

*

Rule Path
Allow /quotes/*
Allow /quotes/
Disallow /services/*
Disallow /services/*
Disallow /

twitterbot

Rule Path
Allow /quotes/*
Allow /quotes

facebookexternalhit

Rule Path
Allow /quotes/*
Allow /quotes