il.bee.deals
robots.txt

Robots Exclusion Standard data for il.bee.deals

Resource Scan

Scan Details

Site Domain il.bee.deals
Base Domain bee.deals
Scan Status Ok
Last Scan2024-11-08T10:27:59+00:00
Next Scan 2024-11-22T10:27:59+00:00

Last Scan

Scanned2024-11-08T10:27:59+00:00
URL https://il.bee.deals/robots.txt
Domain IPs 104.26.0.205, 104.26.1.205, 172.67.74.91, 2606:4700:20::681a:1cd, 2606:4700:20::681a:cd, 2606:4700:20::ac43:4a5b
Response IP 172.67.74.91
Found Yes
Hash 3918142c7cde65cea44ea0ab68c86b2ea65cad3ba394a0437b4cb0a12c424e7a
SimHash 8e095804eb52

Groups

*

Rule Path
Disallow /go/

Other Records

Field Value
sitemap https://il.bee.deals/sitemap/sitemap
sitemap https://il.bee.deals/sitemap/sitemap_deals?page=0
sitemap https://il.bee.deals/sitemap/sitemap_deals?page=1
sitemap https://il.bee.deals/sitemap/sitemap_deals?page=2
sitemap https://il.bee.deals/sitemap/sitemap_deals?page=3
sitemap https://il.bee.deals/sitemap/sitemap_deals?page=4