haskovo.net
robots.txt

Robots Exclusion Standard data for haskovo.net

Resource Scan

Scan Details

Site Domain haskovo.net
Base Domain haskovo.net
Scan Status Ok
Last Scan2024-10-04T20:31:51+00:00
Next Scan 2024-10-11T20:31:51+00:00

Last Scan

Scanned2024-10-04T20:31:51+00:00
URL https://haskovo.net/robots.txt
Redirect https://www.haskovo.net/robots.txt
Redirect Domain www.haskovo.net
Redirect Base haskovo.net
Domain IPs 195.24.88.66
Redirect IPs 195.24.88.66
Response IP 195.24.88.66
Found Yes
Hash 3cdf99b1e21c94f6c39048bef930156d8f313b314d081397199517b987f4abdd
SimHash a849fb6387d2

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Allow /

facebot

Rule Path
Allow /

slurp

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.haskovo.net/sitemap.xml
sitemap https://www.dimitrovgrad.bgvesti.net/sitemap.xml
sitemap https://www.kardjali.bgvesti.net/sitemap.xml
sitemap https://www.parvomai.net/sitemap.xml
sitemap https://www.asenovgrad.net/sitemap.xml
sitemap https://www.smolyan.bgvesti.net/sitemap.xml
sitemap https://www.parvomai.net/sitemap.xml
sitemap https://www.perunik.com/sitemap.xml