step-og.com
robots.txt

Robots Exclusion Standard data for step-og.com

Resource Scan

Scan Details

Site Domain step-og.com
Base Domain step-og.com
Scan Status Ok
Last Scan2025-09-02T01:47:03+00:00
Next Scan 2025-10-02T01:47:03+00:00

Last Scan

Scanned2025-09-02T01:47:03+00:00
URL https://step-og.com/robots.txt
Domain IPs 104.21.45.246, 172.67.221.39, 2606:4700:3030::6815:2df6, 2606:4700:3030::ac43:dd27
Response IP 104.21.45.246
Found Yes
Hash ea8bed0309da4487a8b3b80e1e44040e30c9451162c24183dd58ae79f8eb0544
SimHash 0beec9433cb3

Groups

*

Rule Path
Disallow /.well-known/
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/litespeed/
Disallow /wp-content/themes/
Disallow /search/
Disallow /archive/
Disallow /cdn-cgi/
Disallow /?nonamp=1
Disallow /*?comments
Disallow /wp-comments-post.php
Disallow /wp-login.php
Disallow /tag/
Disallow /*/page/
Disallow /*/feed/
Disallow /*/comments/
Disallow /*?s=*
Disallow /*?p=*
Disallow /license.txt
Allow /?display=wide
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/*.txt
Disallow /*.swf
Disallow /*.pdf

googlebot-news

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

chatgpt-user

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://step-og.com/sitemap_index.xml

Comments

  • All robots
  • remova os diretorios
  • permite os diretorios
  • Remove file extensions
  • Google News
  • Adsense
  • Moz