Log In Sign Up

format.com
robots.txt

Robots Exclusion Standard data for format.com

Resource Scan

Scan Details

Site Domain format.com
Base Domain format.com
Scan Status Ok
Last Scan2025-12-29T02:17:16+00:00
Next Scan 2026-01-12T02:17:16+00:00

Last Scan

Scanned2025-12-29T02:17:16+00:00
URL https://format.com/robots.txt
Redirect https://www.format.com/robots.txt
Redirect Domain www.format.com
Redirect Base format.com
Domain IPs 104.18.132.62, 104.18.133.62, 104.18.134.62, 104.18.135.62, 104.18.136.62
Redirect IPs 104.18.132.62, 104.18.133.62, 104.18.134.62, 104.18.135.62, 104.18.136.62
Response IP 104.18.136.62
Found Yes
Hash aeef78f3c255fae65e57696d131da01c6dfb3cde3899630b4c4d880a4ba113fd
SimHash 6068cf0009f2

Groups

*

Rule Path
Allow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/
Disallow /site/dns_help_request/new
Disallow /site/dashboard
Disallow /site/settings
Disallow /site/pages
Disallow /site/design
Disallow /site/themes
Disallow /site/themes/
Disallow /subscription
Disallow /invites
Disallow /login
Disallow /magazine/articles/profile/*
Disallow /magazine/articles/onhand/*
Disallow /magazine/search/show_more
Disallow /magazine/articles/radar/*
Disallow /magazine/articles/homepage/*
Disallow /magazine/articles/dialog/*
Disallow /magazine/articles/seo/*
Disallow /magazine/articles/features/*
Disallow /magazine/articles/galleries/*
Disallow /magazine/articles/news/*
Disallow /magazine/articles/video/*
Disallow /magazine/articles/guides/*
Disallow /magazine/articles/resources/*
Disallow /magazine/articles/homepage/*
Disallow /magazine/search?q=*
Disallow /*?magazine_page=
Disallow /*%26magazine_page%3D
Disallow /*?*illustration_page=
Disallow /*%26*illustration_page%3D
Disallow /*?*design_page=
Disallow /*%26*design_page%3D
Disallow /*?*photography_page=
Disallow /*%26*photography_page%3D
Disallow /*?*galleries%2Fillustration_page=
Disallow /*?*galleries%2Fdesign_page=
Disallow /*?*galleries%2Fphotography_page=
Disallow /*?*resources%2Fillustration_page=
Disallow /*?*resources%2Fdesign_page=
Disallow /*?*resources%2Fphotography_page=
Disallow /*?*features%2Fdesign_page=
Disallow /*?*magazine%2F*
Disallow /*%26*magazine%2F*

nerdybot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.format.com/sitemap_index.xml
sitemap https://www.format.com/sitemap.index.xml
Back to top

Comments

  • Hello robots
  • Cloudflare crawl control rules
  • Block magazine pagination parameters to prevent duplicate content indexing
  • Block malformed URLs with encoded slashes in parameters
Back to top

Warnings

  • `content-signal` is not a known field.
Back to top