pollentree.com
robots.txt

Robots Exclusion Standard data for pollentree.com

Resource Scan

Scan Details

Site Domain pollentree.com
Base Domain pollentree.com
Scan Status Ok
Last Scan2024-11-19T06:17:48+00:00
Next Scan 2024-11-26T06:17:48+00:00

Last Scan

Scanned2024-11-19T06:17:48+00:00
URL https://pollentree.com/robots.txt
Domain IPs 185.182.91.119
Response IP 185.182.91.119
Found Yes
Hash 4fc5715a2a05f4e2aa21292e6f377b001198a32a6d803fc63228bbae8c58b92c
SimHash 0a2c9560dcb0

Groups

*

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

socialradarbot

Rule Path
Disallow /

cognitiveseo.com

Rule Path
Disallow /

linkdexbot/2.0

Rule Path
Disallow /

komodiabot/1.0

Rule Path
Disallow /

spbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bl.uk_lddc_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow

yandeximages

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

semrushbot-si

Rule Path
Disallow

ccbot

Rule Path
Disallow

radar

Rule Path
Disallow

Other Records

Field Value
sitemap http://www.pollentree.com/sitemap.xml

Warnings

  • 2 invalid lines.