rcgroups.com
robots.txt

Robots Exclusion Standard data for rcgroups.com

Resource Scan

Scan Details

Site Domain rcgroups.com
Base Domain rcgroups.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-05T16:28:47+00:00
Next Scan 2025-12-12T16:28:47+00:00

Last Successful Scan

Scanned2023-09-26T13:47:51+00:00
URL https://rcgroups.com/robots.txt
Redirect https://www.rcgroups.com/robots.txt
Redirect Domain www.rcgroups.com
Redirect Base rcgroups.com
Domain IPs 104.16.248.51, 104.16.249.51
Redirect IPs 104.17.97.5, 104.17.98.5, 2606:4700::6811:6105, 2606:4700::6811:6205
Response IP 104.17.97.5
Found Yes
Hash c214871083f86fa1a1213ab1f5aa01d085dbe0aaf99d3d634673f64be4204a85
SimHash eb5d92f2a22a

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /forums/stream.php
Disallow /forums/usermap.php
Disallow /forums/lastposter.php
Disallow /forums/editpost.php
Disallow /forums/moderator.php
Disallow /forums/newreply.php
Disallow /forums/newthread.php
Disallow /forums/online.php
Disallow /forums/poll.php
Disallow /forums/postings.php
Disallow /forums/printthread.php
Disallow /forums/private.php
Disallow /forums/report.php
Disallow /forums/search.php
Disallow /forums/threadrate.php
Disallow /forums/usercp.php
Disallow /forums/memberlist.php
Disallow /forums/login.php
Disallow /forums/misc.php
Disallow /forums/member.php?find=lastposter
Disallow /forums/showpost.php
Disallow /forums/register.php
Disallow /forums/profile.php
Disallow /forums/sendmessage.php
Disallow /forums/joinrequests.php
Disallow /forums/newattachment.php
Disallow /forums/reputation.php
Disallow /forums/showthread.php?goto=
Disallow /forums/showthread.php?*goto=
Disallow /forums/subscription.php
Disallow /forums/subscriptions.php
Disallow /forums/usernote.php
Disallow /forums/traderratings.php
Disallow /forums/itrader.php
Disallow /forums/recentwarnings.php
Disallow /forums/spy.php
Disallow /forums/setlocation.php
Disallow /forums/thumbgallery.php
Disallow /forums/videogallery.php
Disallow /forums/modstats.php
Disallow /forums/newcheckout.php
Disallow /forums/newpaypal.php
Disallow /forums/NetGeo/
Disallow /forums/*admincp/
Disallow /forums/*modcp/
Disallow /forums/*forumdisplay.php?f=257
Disallow /forums/*forumdisplay.php?f=252
Disallow /forums/*archive/index.php/f-257
Disallow /forums/*archive/index.php/f-252
Disallow /bit-bucket-252/
Disallow /other-websites-257/
Disallow /forums/contact_form
Disallow /gallery/showmembers.php
Disallow /gallery/search.php
Disallow /gallery/comments.php
Disallow /gallery/slideshow.php
Disallow /ads/
Disallow /pages/contacts/
Disallow /pages/authors/
Disallow /pages/amps/
Disallow /pages/advertising/
Disallow /pages/splist/
Disallow /forums/*external.php?*forumid371*
Disallow /forums/*do%3Dmarkread
Disallow /shared/
Disallow /links/action.php
Disallow /www.rcgroups.com/
Disallow /forums/www.rcgroups.com/
Disallow /*sort%3D*
Disallow /*order%3D*
Disallow /*prefixid%3D*

boardtracker

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

boardpulse

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

scoutjet

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mandalay

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.