Log In Sign Up

carls-sims-3-guide.com
robots.txt

Robots Exclusion Standard data for carls-sims-3-guide.com

Resource Scan

Scan Details

Site Domain carls-sims-3-guide.com
Base Domain carls-sims-3-guide.com
Scan Status Ok
Last Scan2024-05-19T02:38:57+00:00
Next Scan 2024-05-26T02:38:57+00:00

Last Scan

Scanned2024-05-19T02:38:57+00:00
URL https://carls-sims-3-guide.com/robots.txt
Redirect https://www.carls-sims-3-guide.com/robots.txt
Redirect Domain www.carls-sims-3-guide.com
Redirect Base carls-sims-3-guide.com
Domain IPs 172.66.40.207, 172.66.43.49, 2606:4700:3108::ac42:28cf, 2606:4700:3108::ac42:2b31
Redirect IPs 172.66.40.207, 172.66.43.49, 2606:4700:3108::ac42:28cf, 2606:4700:3108::ac42:2b31
Response IP 172.66.40.207
Found Yes
Hash 93db12c93d81d2aaabec7bf3ecd636709eb40685cb471213d12d5d984710f8a9
SimHash 6d58bd512736

Groups

yandex

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sogou

Rule Path
Disallow /

docomo

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

googlebot

Rule Path
Allow /
Disallow /forum/gallery/

googlebot-mobile

Rule Path
Allow /
Disallow /forum/gallery/

msnbot

Rule Path
Allow /
Disallow /forum/gallery/

bingbot

Rule Path
Allow /
Disallow /forum/gallery/

Other Records

Field Value
crawl-delay 200

mediapartners-google

Rule Path
Allow /
Disallow /forum/gallery/

scoutjet

Rule Path
Allow /
Disallow /forum/gallery/

baiduspider

Rule Path
Allow /
Disallow /forum/gallery/

duckduckbot

Rule Path
Allow /
Disallow /forum/gallery/

ccbot

Rule Path
Allow /
Disallow /forum/gallery/

*

Rule Path
Disallow /
Disallow /forum/gallery/
Disallow /forum/index.php?action=activate*
Disallow /forum/index.php?action=arcade*
Disallow /forum/index.php?action=collapse*
Disallow /forum/index.php?action=deletemsg*
Disallow /forum/index.php?action=editpoll*
Disallow /forum/index.php?action=help*
Disallow /forum/index.php?action=helpadmin*
Disallow /forum/index.php?action=lock*
Disallow /forum/index.php?action=logout*
Disallow /forum/index.php?action=markasread*
Disallow /forum/index.php?action=mergetopics*
Disallow /forum/index.php?action=mlist*
Disallow /forum/index.php?action=modifykarma*
Disallow /forum/index.php?action=movetopic*
Disallow /forum/index.php?action=notify*
Disallow /forum/index.php?action=notifyboard*
Disallow /forum/index.php?action=pm*
Disallow /forum/index.php?action=post*
Disallow /forum/index.php?action=removetopic2*
Disallow /forum/index.php?action=reporttm*
Disallow /forum/index.php?action=sendtopic*
Disallow /forum/index.php?action=splittopics*
Disallow /forum/index.php?action=sticky*
Disallow /forum/index.php?action=trackip*
Disallow /forum/index.php?action=unread*
Disallow /forum/index.php?action=unreadreplies*
Disallow /forum/index.php?action=admin*
Disallow /forum/index.php?action=calendar*
Disallow /forum/index.php?action=login*
Disallow /forum/index.php?action=printpage*
Disallow /forum/index.php?action=profile*
Disallow /forum/index.php?action=register*
Disallow /forum/index.php?action=search*
Disallow /forum/index.php?action=stats*
Disallow /forum/index.php?PHPSESSID=*
Disallow /forum/*sort%3D*
Disallow /forum/*msg*
Disallow /forum/*prev_next*
Disallow /forum/*index.php?PHPSESSID=*
Disallow /forum/*index.php?*rss*
Disallow /forum/*index.php?*wap*
Disallow /forum/*index.php?*wap2*
Disallow /forum/*index.php?*imode*
Disallow /forum/Themes/*
Disallow /forum/*%3Ball
Back to top

Other Records

Field Value
sitemap http://www.carls-sims-3-guide.com/sitemap.xml
Back to top

Comments

  • Adsense
  • Blekko
  • CommonCrawl
Back to top

Warnings

  • 1 invalid line.
Back to top