forum.toribash.com
robots.txt

Robots Exclusion Standard data for forum.toribash.com

Resource Scan

Scan Details

Site Domain forum.toribash.com
Base Domain toribash.com
Scan Status Ok
Last Scan2025-09-23T00:38:09+00:00
Next Scan 2025-10-07T00:38:09+00:00

Last Scan

Scanned2025-09-23T00:38:09+00:00
URL https://forum.toribash.com/robots.txt
Domain IPs 104.21.14.184, 172.67.160.36, 2606:4700:3036::ac43:a024, 2606:4700:3037::6815:eb8
Response IP 172.67.160.36
Found Yes
Hash 225996571b26d3d8acc6075c30b22c1ed3e9280ea2b27413a1dc76bd099b6dd0
SimHash 204acbe94295

Groups

mediapartners-google*

Rule Path
Disallow

crazywebcrawler-spider

Rule Path
Disallow /

*

Rule Path
Allow /$
Allow /index.php
Allow /forumdisplay.php
Allow /showthread.php
Allow /showpost.php
Disallow /
Disallow /admincp/
Disallow /archive/
Disallow /backup/
Disallow /calendar.php
Disallow /cron.php
Disallow /editpost.php
Disallow /joinrequests.php
Disallow /login.php
Disallow /member.php
Disallow /misc.php
Disallow /modcp/
Disallow /moderator.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /search.php
Disallow /sendmessage.php
Disallow /showgroups.php
Disallow /showpost.php
Disallow /subscription.php
Disallow /subscriptions.php
Disallow /threadrate.php
Disallow /usercp.php
Disallow /market
Disallow /replay.php
Disallow /replay_add.php

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10