Log In Sign Up

rpgnext.com.br
robots.txt

Robots Exclusion Standard data for rpgnext.com.br

Resource Scan

Scan Details

Site Domain rpgnext.com.br
Base Domain rpgnext.com.br
Scan Status Ok
Last Scan2025-11-21T18:23:29+00:00
Next Scan 2025-11-28T18:23:29+00:00

Last Scan

Scanned2025-11-21T18:23:29+00:00
URL https://rpgnext.com.br/robots.txt
Domain IPs 173.236.215.192
Response IP 173.236.215.192
Found Yes
Hash 290a5fecf7c4b2d5ccf2eda4b24921b5d1309e325f4550f3b0421a072fa5cf7a
SimHash 431cd080e404

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • Bloquear ferramentas que consomem muitos recursos
  • Bots principais com crawl-delay
Back to top