novelfreepdf.com
robots.txt

Robots Exclusion Standard data for novelfreepdf.com

Resource Scan

Scan Details

Site Domain novelfreepdf.com
Base Domain novelfreepdf.com
Scan Status Ok
Last Scan2024-06-28T11:30:45+00:00
Next Scan 2024-07-05T11:30:45+00:00

Last Scan

Scanned2024-06-28T11:30:45+00:00
URL https://novelfreepdf.com/robots.txt
Domain IPs 104.21.70.176, 172.67.138.11, 2606:4700:3033::6815:46b0, 2606:4700:3035::ac43:8a0b
Response IP 104.21.70.176
Found Yes
Hash a3c269653c5243ab476a20da036f9f9035d6c01ca1f19b9dd502d6e07bc3bc5b
SimHash 08008075c713

Groups

*

Rule Path
Allow /
Disallow /auth/*

Other Records

Field Value
sitemap https://novelfreepdf.com/sitemap.xml