assets.findation.com
robots.txt

Robots Exclusion Standard data for assets.findation.com

Resource Scan

Scan Details

Site Domain assets.findation.com
Base Domain findation.com
Scan Status Ok
Last Scan2024-10-11T23:55:46+00:00
Next Scan 2024-11-10T23:55:46+00:00

Last Scan

Scanned2024-10-11T23:55:46+00:00
URL https://assets.findation.com/robots.txt
Domain IPs 108.156.133.116, 108.156.133.29, 108.156.133.35, 108.156.133.57, 2600:9000:2755:2200:1b:132b:4980:93a1, 2600:9000:2755:4200:1b:132b:4980:93a1, 2600:9000:2755:4c00:1b:132b:4980:93a1, 2600:9000:2755:7800:1b:132b:4980:93a1, 2600:9000:2755:800:1b:132b:4980:93a1, 2600:9000:2755:b600:1b:132b:4980:93a1, 2600:9000:2755:ea00:1b:132b:4980:93a1, 2600:9000:2755:fc00:1b:132b:4980:93a1
Response IP 108.156.133.35
Found Yes
Hash 5de3e22ac0569cbe4e9e8a122b136f804fe6b52d0c39e0433c0145c562b9ae67
SimHash 801d3d45cc75

Groups

*

Rule Path
Disallow /searches
Disallow /pdfs
Disallow /merchants
Disallow /widget_searches

Other Records

Field Value
sitemap https://findation.com/sitemap_index.xml.gz

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file