atheistforums.org
robots.txt

Robots Exclusion Standard data for atheistforums.org

Resource Scan

Scan Details

Site Domain atheistforums.org
Base Domain atheistforums.org
Scan Status Ok
Last Scan2025-10-08T17:16:02+00:00
Next Scan 2025-11-07T17:16:02+00:00

Last Scan

Scanned2025-10-08T17:16:02+00:00
URL https://atheistforums.org/robots.txt
Domain IPs 104.21.2.25, 172.67.128.156, 2606:4700:3030::6815:219, 2606:4700:3037::ac43:809c
Response IP 172.67.128.156
Found Yes
Hash 2918e560c581e522c2cd3fd437ec87311ebfde383dc18364b4940fd0a9a5c150
SimHash 301fc068c292

Groups

*

Rule Path
Disallow /archive
Disallow /archive/
Disallow /index.php/
Disallow /captcha.php
Disallow /calendar.php
Disallow /editpost.php
Disallow /misc.php
Disallow /modcp.php
Disallow /moderation.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /printthread.php
Disallow /private.php
Disallow /ratethread.php
Disallow /report.php
Disallow /sendthread.php
Disallow /task.php
Disallow /usercp.php
Disallow /usercp2.php
Disallow /user-*
Disallow /member.php*
Disallow /calendar*
Disallow /cell
Disallow /cell/
Disallow /thread-*-lastpost.html
Disallow /thread-*-newpost.html
Disallow /thread-*-nextoldest.html
Disallow /thread-*-nextnewest.html

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /