booktoread.net
robots.txt

Robots Exclusion Standard data for booktoread.net

Resource Scan

Scan Details

Site Domain booktoread.net
Base Domain booktoread.net
Scan Status Ok
Last Scan2024-09-16T15:48:24+00:00
Next Scan 2024-09-23T15:48:24+00:00

Last Scan

Scanned2024-09-16T15:48:24+00:00
URL https://booktoread.net/robots.txt
Domain IPs 104.21.53.238, 172.67.220.5, 2606:4700:3037::6815:35ee, 2606:4700:3037::ac43:dc05
Response IP 104.21.53.238
Found Yes
Hash ea28932fab4c9115aa32ad5e3310d5b4d2cfd7d3feccf3fbad02eca77ce18d73
SimHash 580c5960c993

Groups

*

Rule Path
Disallow /api
Disallow /logs/

*

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://booktoread.net/sitemap-index.xml