4readlib.com
robots.txt

Robots Exclusion Standard data for 4readlib.com

Resource Scan

Scan Details

Site Domain 4readlib.com
Base Domain 4readlib.com
Scan Status Ok
Last Scan2025-11-11T06:58:46+00:00
Next Scan 2025-11-18T06:58:46+00:00

Last Scan

Scanned2025-11-11T06:58:46+00:00
URL https://4readlib.com/robots.txt
Redirect http://www.4readlib.com/Robots.txt
Redirect Domain www.4readlib.com
Redirect Base 4readlib.com
Domain IPs 104.21.87.88, 172.67.169.46, 2606:4700:3032::6815:5758, 2606:4700:3035::ac43:a92e
Redirect IPs 45.87.43.74
Response IP 45.87.43.74
Found Yes
Hash 3808550f3e0aceb8ec939784aff468807d73198a44cfb1ca0f1a83e954f7a9db
SimHash 64515c95d951

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /admin
Disallow /wp-admin

Other Records

Field Value
sitemap https://www.4readlib.com/sitemap/books1.xml
sitemap https://www.4readlib.com/sitemap/books2.xml
sitemap https://www.4readlib.com/sitemap/books3.xml
sitemap https://www.4readlib.com/sitemap/reads1.xml
sitemap https://www.4readlib.com/sitemap/reads2.xml
sitemap https://www.4readlib.com/sitemap/reads3.xml
sitemap https://www.4readlib.com/sitemap/authors.xml
sitemap https://www.4readlib.com/sitemap/sitemap.xml