thornight.in
robots.txt

Robots Exclusion Standard data for thornight.in

Resource Scan

Scan Details

Site Domain thornight.in
Base Domain thornight.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/14/2025, 7:31:39 AM
Next Scan 4/15/2025, 7:31:39 AM

Last Successful Scan

Scanned3/15/2025, 7:31:20 AM
URL https://thornight.in/robots.txt
Domain IPs 104.21.2.244, 172.67.129.215, 2606:4700:3031::6815:2f4, 2606:4700:3033::ac43:81d7
Response IP 172.67.129.215
Found Yes
Hash 42e0747b119aa378a5f9adc8e61e3a94fc900293795a35c61223c771a96e4151
SimHash 88088022cab2

Groups

*

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://thornight.in/sitemap.xml