reagent.com
robots.txt

Robots Exclusion Standard data for reagent.com

Resource Scan

Scan Details

Site Domain reagent.com
Base Domain reagent.com
Scan Status Ok
Last Scan2025-10-19T03:15:47+00:00
Next Scan 2025-11-18T03:15:47+00:00

Last Scan

Scanned2025-10-19T03:15:47+00:00
URL https://reagent.com/robots.txt
Domain IPs 104.160.240.21
Response IP 104.160.240.21
Found Yes
Hash 440d9b0143ea1a36c790d16688e2ab92a8d1481aab0618f0573a63bcdd4c6eb2
SimHash 52281a92e193

Groups

*

Rule Path Comment
Disallow /wp-login.php -
Disallow /wp-admin/* -
Disallow /wp-register.php -
Disallow /search/ block access to internal search result pages
Disallow *?s=* block access to internal search result pages
Disallow *?p=* block access to pages for which permalinks fails
Disallow *%26p%3D* block access to pages for which permalinks fails

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /