matterofform.com
robots.txt

Robots Exclusion Standard data for matterofform.com

Resource Scan

Scan Details

Site Domain matterofform.com
Base Domain matterofform.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-13T15:31:08+00:00
Next Scan 2025-11-11T15:31:08+00:00

Last Successful Scan

Scanned2025-03-24T10:23:31+00:00
URL https://matterofform.com/robots.txt
Redirect https://www.matterofform.com/robots.txt
Redirect Domain www.matterofform.com
Redirect Base matterofform.com
Domain IPs 104.26.8.33, 104.26.9.33, 172.67.72.254, 2606:4700:20::681a:821, 2606:4700:20::681a:921, 2606:4700:20::ac43:48fe
Redirect IPs 51.141.45.207
Response IP 51.141.45.207
Found Yes
Hash 1f00e253968af555526a150d2a131136ae0116089427edf2a9374b2c8484aa3c
SimHash 4812d891c7d2

Groups

*

Rule Path
Disallow /umbraco
Disallow /modules-listing
Disallow /modules

alexibot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /modules
Disallow /modules-listing

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.matterofform.com/sitemap.xml
sitemap https://www.matterofform.com/imagessitemap.xml

Comments

  • Block not wanted search engines
  • Setting up crawl-delay for specific user-agents