themainline.top
robots.txt

Robots Exclusion Standard data for themainline.top

Resource Scan

Scan Details

Site Domain themainline.top
Base Domain themainline.top
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-18T16:55:22+00:00
Next Scan 2025-12-17T16:55:22+00:00

Last Successful Scan

Scanned2024-11-23T16:36:17+00:00
URL https://themainline.top/robots.txt
Domain IPs 79.98.108.212
Response IP 79.98.108.212
Found Yes
Hash f732f121c92e73f33c7a9986f4771f6bdce4bda46ceda78e5dc5a3cbc54da1b1
SimHash 6d14d05046b1

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap http://themainline.bg/sitemap.xml