Log In Sign Up

novel.bar
robots.txt

Robots Exclusion Standard data for novel.bar

Resource Scan

Scan Details

Site Domain novel.bar
Base Domain novel.bar
Scan Status Ok
Last Scan2024-09-22T17:19:10+00:00
Next Scan 2024-09-29T17:19:10+00:00

Last Scan

Scanned2024-09-22T17:19:10+00:00
URL https://novel.bar/robots.txt
Domain IPs 104.21.17.191, 172.67.178.49, 2606:4700:3030::6815:11bf, 2606:4700:3036::ac43:b231
Response IP 104.21.17.191
Found Yes
Hash 52980779583e837d6751a9194cdf36ddccb634c71449ee92188253c1e60960cf
SimHash 580c4d704993

Groups

*

Rule Path
Disallow /api
Disallow /logs/

*

Rule Path
Allow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://novel.bar/sitemap-index.xml
Back to top