themainline.bg
robots.txt

Robots Exclusion Standard data for themainline.bg

Resource Scan

Scan Details

Site Domain themainline.bg
Base Domain themainline.bg
Scan Status Ok
Last Scan2024-06-28T03:09:37+00:00
Next Scan 2024-07-05T03:09:37+00:00

Last Scan

Scanned2024-06-28T03:09:37+00:00
URL https://themainline.bg/robots.txt
Domain IPs 79.98.108.212
Response IP 79.98.108.212
Found Yes
Hash f732f121c92e73f33c7a9986f4771f6bdce4bda46ceda78e5dc5a3cbc54da1b1
SimHash 6d14d05046b1

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap http://themainline.bg/sitemap.xml