forums.sf-fandom.com
robots.txt
Robots Exclusion Standard data for forums.sf-fandom.com
Resource Scan
Scan Details
| Site Domain | forums.sf-fandom.com |
| Base Domain | sf-fandom.com |
| Scan Status | Ok |
| Last Scan | 2025-12-11T05:48:19+00:00 |
| Next Scan | 2026-01-10T05:48:19+00:00 |
Last Scan
| Scanned | 2025-12-11T05:48:19+00:00 |
| URL | https://forums.sf-fandom.com/robots.txt |
| Domain IPs | 192.96.218.77 |
| Response IP | 192.96.218.77 |
| Found | Yes |
| Hash | 4c39d868cbee7949f8d7fc4e9735c4b952ab096d5fea441905553a566d4459ad |
| SimHash | 211c4af94655 |
Groups
baiduspider
bingbot
duckduckbot
chatgpt-user
claude-searchbot
claude-user
exabot
facebookexternalhit
feedfetcher-google
google-inspectiontool
google-site-verification
google-speakr
googlebot
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
msnbot
gptbot
linkedinbot
oai-searchbot
perplexitybot
schemabot/1.2
twitterbot
facebookexternalhit
qwantify
speedyspider
twitterbot
yandexantivirus/2.0
yandexbot/3.0
yandeximageresizer/2.0
yandeximages/3.0
yandexmedia/3.0
yandexpagechecker/1.0
yandexwebmaster/2.0
yandexzakladki/3.0
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /admin/ |
| Disallow | /archive/ |
| Disallow | /cache/ |
| Disallow | /documentation/ |
| Disallow | /inc/ |
| Disallow | /install/ |
| Disallow | /merge/ |
| Disallow | /upload/ |
| Disallow | /uploads/ |
| Disallow | /vbulletin/ |
| Disallow | /attachment.php |
| Disallow | /calendar.php |
| Disallow | /calendar* |
| Disallow | /captcha.php |
| Disallow | /contact.php |
| Disallow | /css.php |
| Disallow | /editpost.php |
| Disallow | /global.php |
| Disallow | /member.php?* |
| Disallow | /memberlist.php |
| Disallow | /misc.php?* |
| Disallow | /modcp.php |
| Disallow | /moderation.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /portal.php |
| Disallow | /printthread.php |
| Disallow | /private.php |
| Disallow | /ratethread.php |
| Disallow | /report.php |
| Disallow | /reputation.php |
| Disallow | /search.php |
| Disallow | /sendthread.php |
| Disallow | /stats.php |
| Disallow | /task.php |
| Disallow | /usercp.php |
| Disallow | /warnings.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://forums.sf-fandom.com/forums-sitemap-8.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-7.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-6.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-5.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-4.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-3.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-2.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-1.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-0.xml |
| sitemap | https://forums.sf-fandom.com/forums-sitemap-index.xml |
Comments