builtformars.com
robots.txt

Robots Exclusion Standard data for builtformars.com

Resource Scan

Scan Details

Site Domain builtformars.com
Base Domain builtformars.com
Scan Status Ok
Last Scan2025-09-09T16:36:05+00:00
Next Scan 2025-09-16T16:36:05+00:00

Last Scan

Scanned2025-09-09T16:36:05+00:00
URL https://builtformars.com/robots.txt
Domain IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash 1eb0ed0d09b2fe10f214747f1854bad4e1d326ecc241413636f7dbb6742b4057
SimHash 180e09f7c3fb

Groups

*

Rule Path
Allow /
Allow /ux-bites$
Allow /case-studies$
Allow /cheatsheets$
Allow /ux-glossary$
Allow /insights$
Disallow /audit*
Disallow /account*
Disallow /_next/*
Disallow /preview*
Disallow /uploads*
Disallow /admin*
Disallow /tooltips*
Disallow /api*
Disallow /search*
Disallow /subscribe*
Disallow /ux-bites?*
Disallow /case-studies?*
Disallow /cheatsheets?*
Disallow /ux-glossary?*
Disallow /insights/*
Disallow /mgmt

baiduspider

Rule Path
Disallow /*

haosouspider

Rule Path
Disallow /*

sogou web spider

Rule Path
Disallow /*

sogou inst spider

Rule Path
Disallow /*

sogou spider2

Rule Path
Disallow /*

screaming frog seo spider

Rule Path
Disallow /*

seo powersuite

Rule Path
Disallow /*

wget

Rule Path
Disallow /*

httrack

Rule Path
Disallow /*

ccbot

Rule Path
Disallow /*

yandexbot

Rule Path
Disallow /*

phantomjs

Rule Path
Disallow /*

puppeteer

Rule Path
Disallow /*

headlesschrome

Rule Path
Disallow /*

Other Records

Field Value
sitemap https://builtformars.com/sitemap.xml