Log In Sign Up

speakrj.com
robots.txt

Robots Exclusion Standard data for speakrj.com

Resource Scan

Scan Details

Site Domain speakrj.com
Base Domain speakrj.com
Scan Status Ok
Last Scan2024-11-13T00:49:44+00:00
Next Scan 2024-11-20T00:49:44+00:00

Last Scan

Scanned2024-11-13T00:49:44+00:00
URL https://speakrj.com/robots.txt
Redirect https://www.speakrj.com/robots.txt
Redirect Domain www.speakrj.com
Redirect Base speakrj.com
Domain IPs 172.214.72.205
Redirect IPs 172.214.72.205
Response IP 172.214.72.205
Found Yes
Hash f6eaec4d1484f0c45bb41538633bfe0f6f808e66aeee05185e9729db8add6ec8
SimHash 4da849677cf2

Groups

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seo spider

Rule Path
Disallow /

*

Rule Path
Disallow /*?refresh
Disallow /*?redirect
Disallow /*summary
Disallow /tag/
Disallow /audit/json/
Disallow /audit/tools
Disallow /activity_item/
Disallow /activity_quiz/
Disallow /*/feed/
Disallow /audit/compare/
Disallow /*/listicle-template
Disallow /*?q=
Disallow /*?language=
Disallow /audit/report/*/youtube/
Disallow /audit/report/*/twitter/
Disallow /audit/report/*/instagram/
Disallow /audit/report/*/facebook/
Disallow /audit/report/*/*/media-stats/
Disallow /audit/report/*/*/live/
Disallow /audit/report/*/youtube/live/
Disallow /audit/report/*/*/future-projections/
Disallow /audit/report/*/*/engagement-stats/
Disallow /audit/report/*/*/income-stats/
Disallow /audit/report/*/*/influence-stats/
Disallow /audit/report/*/*/mentions-hashtags/
Disallow /audit/report/*/*/similar-accounts/
Allow /audit/report/*/youtube
Allow /audit/report/*/twitter
Allow /audit/report/*/instagram
Allow /audit/report/*/facebook
Allow /audit/report/*/*/media-stats
Allow /audit/report/*/*/live
Allow /audit/report/*/youtube/live
Allow /audit/report/*/*/future-projections
Allow /audit/report/*/*/engagement-stats
Allow /audit/report/*/*/income-stats
Allow /audit/report/*/*/influence-stats
Allow /audit/report/*/*/mentions-hashtags
Allow /audit/report/*/*/similar-accounts
Back to top

Other Records

Field Value
sitemap https://www.speakrj.com/sitemap.xml
Back to top

Comments

  • Disallow URLs with trailing slashes for any dynamic value
Back to top