Log In Sign Up

stellarcontent.com
robots.txt

Robots Exclusion Standard data for stellarcontent.com

Resource Scan

Scan Details

Site Domain stellarcontent.com
Base Domain stellarcontent.com
Scan Status Ok
Last Scan2025-11-06T21:45:32+00:00
Next Scan 2025-12-06T21:45:32+00:00

Last Scan

Scanned2025-11-06T21:45:32+00:00
URL https://stellarcontent.com/robots.txt
Redirect https://www.stellarcontent.com/robots.txt
Redirect Domain www.stellarcontent.com
Redirect Base stellarcontent.com
Domain IPs 104.26.4.214, 104.26.5.214, 172.67.74.120, 2606:4700:20::681a:4d6, 2606:4700:20::681a:5d6, 2606:4700:20::ac43:4a78
Redirect IPs 162.159.134.42, 162.159.135.42, 2606:4700:7::a29f:862a, 2606:4700:7::a29f:872a
Response IP 162.159.135.42
Found Yes
Hash ecb89f3ae887be019bf93971d5f86cb901a5da90c14f121f6f985e3b83d691f5
SimHash 7d399820ece9

Groups

*
googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

gptbot

Rule Path
Disallow /wp-json/
Disallow /wp-admin/

chatgpt-user

Rule Path
Disallow /wp-json/
Disallow /wp-admin/

perplexitybot

Rule Path
Disallow /wp-json/
Disallow /wp-admin/

amazonbot

Rule Path
Disallow /wp-json/
Disallow /wp-admin/
Disallow /wp-json/
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /app/cache/
Disallow /trackback/
Disallow /archives/
Disallow /feed/
Disallow /services/review-writing-2/attachment/
Allow /wp-admin/admin-ajax.php
Allow */uploads
Disallow /author/orders/
Back to top

Other Records

Field Value
sitemap https://www.stellarcontent.com/sitemap_index.xml
sitemap https://www.stellarcontent.com/blog/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
  • --- AI / other crawlers: can read public content,
  • but should not touch API/admin
Back to top