readgeek.com
robots.txt

Robots Exclusion Standard data for readgeek.com

Resource Scan

Scan Details

Site Domain readgeek.com
Base Domain readgeek.com
Scan Status Ok
Last Scan2025-10-26T12:19:23+00:00
Next Scan 2025-11-25T12:19:23+00:00

Last Scan

Scanned2025-10-26T12:19:23+00:00
URL https://readgeek.com/robots.txt
Redirect https://www.readgeek.com/robots.txt
Redirect Domain www.readgeek.com
Redirect Base readgeek.com
Domain IPs 104.21.3.42, 172.67.130.56
Redirect IPs 104.21.3.42, 172.67.130.56
Response IP 172.67.130.56
Found Yes
Hash e4e54e01468d0d1dd8b4d1f333be9acde65a43f8db0942cce3666645d6bdc0ff
SimHash b955d984c492

Groups

*

Rule Path
Disallow /user/
Disallow /pgsqlsearch/
Disallow /search/

Other Records

Field Value
sitemap http://www.readgeek.com/siteindex.xml