Log In Sign Up

phoronix.com
robots.txt

Robots Exclusion Standard data for phoronix.com

Resource Scan

Scan Details

Site Domain phoronix.com
Base Domain phoronix.com
Scan Status Ok
Last Scan2025-10-19T12:06:44+00:00
Next Scan 2025-10-26T12:06:44+00:00

Last Scan

Scanned2025-10-19T12:06:44+00:00
URL https://phoronix.com/robots.txt
Redirect https://www.phoronix.com/robots.txt
Redirect Domain www.phoronix.com
Redirect Base phoronix.com
Domain IPs 104.26.6.230, 104.26.7.230, 172.67.75.54, 172.67.75.57, 172.67.75.60, 172.67.75.80, 2606:4700:20::681a:6e6, 2606:4700:20::681a:7e6, 2606:4700:20::ac43:4b36, 2606:4700:20::ac43:4b39, 2606:4700:20::ac43:4b3c, 2606:4700:20::ac43:4b50
Redirect IPs 104.26.6.230, 104.26.7.230, 172.67.75.54, 172.67.75.57, 172.67.75.60, 172.67.75.80, 2606:4700:20::681a:6e6, 2606:4700:20::681a:7e6, 2606:4700:20::ac43:4b36, 2606:4700:20::ac43:4b39, 2606:4700:20::ac43:4b3c, 2606:4700:20::ac43:4b50
Response IP 104.26.7.230
Found Yes
Hash 518526df308bc103fc61a5b2f896da41b4f600ffe61242a82d1c90e4537cecc2
SimHash 69595054aa92

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /phxcms-admin/
Disallow /xml/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /
Disallow /

claudebot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.phoronix.com/sitemap.php
Back to top

Warnings

  • `‍user-agent` is not a known field.
Back to top