hivadata.com
robots.txt

Robots Exclusion Standard data for hivadata.com

Resource Scan

Scan Details

Site Domain hivadata.com
Base Domain hivadata.com
Scan Status Ok
Last Scan2025-10-10T11:43:40+00:00
Next Scan 2025-11-09T11:43:40+00:00

Last Scan

Scanned2025-10-10T11:43:40+00:00
URL https://hivadata.com/robots.txt
Domain IPs 104.21.32.150, 172.67.186.236, 2606:4700:3033::6815:2096, 2606:4700:3037::ac43:baec
Response IP 172.67.186.236
Found Yes
Hash 64f6b188806a19cfc9681f22c30c274fc6bdab9ac850510415124fef3d0b50f9
SimHash 4d0c8867e23e

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://hivadata.com/index.php/sitemap.xml
sitemap https://hivadata.com/index.php/sitemap-1.xml
sitemap https://hivadata.com/index.php/sitemap-2.xml
sitemap https://hivadata.com/index.php/sitemap-3.xml
sitemap https://hivadata.com/index.php/sitemap-4.xml
sitemap https://hivadata.com/index.php/sitemap-5.xml