novelebook.com
robots.txt

Robots Exclusion Standard data for novelebook.com

Resource Scan

Scan Details

Site Domain novelebook.com
Base Domain novelebook.com
Scan Status Ok
Last Scan2024-06-07T23:06:09+00:00
Next Scan 2024-06-14T23:06:09+00:00

Last Scan

Scanned2024-06-07T23:06:09+00:00
URL https://novelebook.com/robots.txt
Domain IPs 104.21.8.169, 172.67.139.204, 2606:4700:3033::ac43:8bcc, 2606:4700:3035::6815:8a9
Response IP 104.21.8.169
Found Yes
Hash f54bd649cbd2a38673aa8913e94ff48606b8ecdc53492ff36cd23c53f55afb64
SimHash 080489604711

Groups

*

Rule Path
Allow /
Disallow /auth/*

Other Records

Field Value
sitemap https://en.booktrk.com/sitemap.xml