novelhistory.net
robots.txt

Robots Exclusion Standard data for novelhistory.net

Resource Scan

Scan Details

Site Domain novelhistory.net
Base Domain novelhistory.net
Scan Status Ok
Last Scan2024-05-30T08:04:24+00:00
Next Scan 2024-06-06T08:04:24+00:00

Last Scan

Scanned2024-05-30T08:04:24+00:00
URL https://novelhistory.net/robots.txt
Domain IPs 104.21.53.228, 172.67.219.122, 2606:4700:3031::6815:35e4, 2606:4700:3031::ac43:db7a
Response IP 172.67.219.122
Found Yes
Hash 9c4e69fe7862a15a185356d60de7b67e695d58d55db4e7e6e2ff64acf237cf98
SimHash 480ccf604d13

Groups

*

Rule Path
Disallow /api
Disallow /logs/

*

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://novelhistory.net/sitemap-index.xml