Log In Sign Up

corolland.com
robots.txt

Robots Exclusion Standard data for corolland.com

Resource Scan

Scan Details

Site Domain corolland.com
Base Domain corolland.com
Scan Status Ok
Last Scan2024-11-09T15:35:27+00:00
Next Scan 2024-11-16T15:35:27+00:00

Last Scan

Scanned2024-11-09T15:35:27+00:00
URL https://www.corolland.com/robots.txt
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Response IP 52.221.42.138
Found Yes
Hash b609d34cdea5c7a66d44515b8b3bbfb19cadbb93564feded17c913b079b5d19a
SimHash b404e6558552

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /forums/admin/
Disallow /forums/cache/
Disallow /forums/hooks/
Disallow /forums/?showuser=
Disallow /forums/index.php?%2Fuser%2F
Disallow /forums/index.php?%2Fuser%2F
Disallow /forums/retail/
Disallow /forums/public/style_captcha/
Disallow /forums/index.php?app=core&module=task
Disallow /forums/index.php?app=forums&module=moderate&section=moderate
Disallow /forums/index.php?app=forums&module=extras&section=forward
Disallow /forums/index.php?app=members&module=chat
Disallow /forums/index.php?&unlockUserAgent=1
Disallow /forums/*%26module%3Dsearch
Disallow /forums/*app%3Dcore%26module%3Dglobal%26section%3Dreputation
Disallow /forums/*app%3Dcore%26module%3Dusercp
Disallow /forums/*app%3Dmembers%26module%3Dmessaging
Disallow /forums/*%26p%3D
Disallow /forums/*%26pid%3D
Disallow /forums/*%26hl%3D
Disallow /forums/*%26start%3D
Disallow /forums/*view__getnewpost$
Disallow /forums/*view__getlastpost$
Disallow /forums/*view__old$
Disallow /forums/*view__new$
Disallow /forums/*view__getfirst$
Disallow /forums/*view__getprevious$
Disallow /forums/*view__getnext$
Disallow /forums/*view__getlast$
Disallow /forums/*%26view%3Dgetnewpost$
Disallow /forums/*%26view%3Dgetlastpost$
Disallow /forums/*%26view%3Dold$
Disallow /forums/*%26view%3Dnew$
Disallow /forums/*%26view%3Dgetfirst$
Disallow /forums/*%26view%3Dgetprevious$
Disallow /forums/*%26view%3Dgetnext$
Disallow /forums/*%26view%3Dgetlast$
Disallow /forums/*?s=
Disallow /forums/*%26s%3D
Disallow /forums/index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /forums/index.php?app=forums&module=extras&section=rating
Disallow /forums/index.php?app=forums&module=forums&section=markasread
Disallow /forums/*%26do%3Dwho
Disallow /forums/*%26section%3Ddname
Disallow /forums/cache/lang_cache/*
Disallow /forums/index.php?app=core&module=editor&do=preview&editor_id=report_message
Disallow /forums/index.php?app=core&module=system&controller=editor&do=preview&editor_id=report_message
Disallow /forums/index.php?%2Fnotifications%2F&do=followers&follow_app=forums&follow_area=forum&follow_id=*
Disallow /forums/index.php?app=core&module=system&controller=poll&do=voters*
Disallow /forums/?app=core&module=system&controller=content&do=find*
Disallow /forums/index.php?%2Fprofile%2F*
Disallow /forums/index.php?%2Ftopic%2F*%2F&do=findComment&comment=
Disallow /forums/index.php?%2Ftopic%2F*%2F&do=getNewComment

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bing

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 22

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 22

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 72
Back to top

Comments

  • slow down Yahoo
Back to top