frogforum.net
robots.txt

Robots Exclusion Standard data for frogforum.net

Resource Scan

Scan Details

Site Domain frogforum.net
Base Domain frogforum.net
Scan Status Ok
Last Scan2026-01-18T19:03:17+00:00
Next Scan 2026-01-25T19:03:17+00:00

Last Scan

Scanned2026-01-18T19:03:17+00:00
URL https://frogforum.net/robots.txt
Redirect https://www.frogforum.net/robots.txt
Redirect Domain www.frogforum.net
Redirect Base frogforum.net
Domain IPs 207.7.82.41
Redirect IPs 207.7.82.41
Response IP 207.7.82.41
Found Yes
Hash 4be8e4f2079c1b67bceffd9bd5e49caa242b01f3d7e6d8cbf16d1b1c479eebf3
SimHash 25364b680346

Groups

mediapartners-google

Rule Path
Disallow

surveybot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow /clientscript/
Disallow /cpstyles/
Disallow /customavatars/
Disallow /customprofilepics/
Disallow /ajax.php
Disallow /arcade.php
Disallow /attachment.php
Disallow /awards.php
Disallow /calendar.php
Disallow /cron.php
Disallow /editpost.php
Disallow /faq.php
Disallow /global.php
Disallow /image.php
Disallow /inlinemod.php
Disallow /joinrequests.php
Disallow /login.php
Disallow /market.php
Disallow /market_bank.php
Disallow /market_convert.php
Disallow /member.php
Disallow /memberlist.php
Disallow /misc.php
Disallow /moderator.php
Disallow /newattachment.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /poll.php
Disallow /postings.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /report.php
Disallow /reputation.php
Disallow /sendmessage.php
Disallow /showgroups.php
Disallow /subscription.php
Disallow /threadrate.php
Disallow /usercp.php
Disallow /usernote.php
Disallow /vbactivity.php
Disallow *.js
Disallow /includes/
Disallow /install/
Disallow /customavatars/
Disallow /css/