topfreebooks.org
robots.txt

Robots Exclusion Standard data for topfreebooks.org

Resource Scan

Scan Details

Site Domain topfreebooks.org
Base Domain topfreebooks.org
Scan Status Ok
Last Scan2025-11-18T07:43:35+00:00
Next Scan 2025-11-25T07:43:35+00:00

Last Scan

Scanned2025-11-18T07:43:35+00:00
URL https://topfreebooks.org/robots.txt
Redirect https://www.topfreebooks.org/robots.txt
Redirect Domain www.topfreebooks.org
Redirect Base topfreebooks.org
Domain IPs 2001:41d0:1:1b00:213:186:33:18, 46.105.204.7
Redirect IPs 2001:41d0:1:1b00:213:186:33:18, 46.105.204.7
Response IP 46.105.204.7
Found Yes
Hash 12973d25c412d2d76ae7147365a9f2586100fbb893c48e1ed641c722bb5c2ac0
SimHash 6900604f1e53

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json
Disallow /wp-includes/
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Allow /wp-content/cache/*.js
Allow /wp-content/cache/*.css
Disallow /wp-login.php
Disallow /cgi-bin/
Disallow /*.inc$
Disallow /*.cgi
Disallow /xmlrpc.php

Other Records

Field Value
sitemap https://www.topfreebooks.org/sitemap.xml
sitemap https://www.topfreebooks.org/sitemap.rss