sf-fandom.com
robots.txt
Robots Exclusion Standard data for sf-fandom.com
Resource Scan
Scan Details
| Site Domain | sf-fandom.com |
| Base Domain | sf-fandom.com |
| Scan Status | Ok |
| Last Scan | 2025-06-23T03:39:24+00:00 |
| Next Scan | 2025-06-24T03:39:24+00:00 |
Last Scan
| Scanned | 2025-06-23T03:39:24+00:00 |
| URL | https://www.sf-fandom.com/robots.txt |
| Domain IPs | 192.96.218.77 |
| Response IP | 192.96.218.77 |
| Found | Yes |
| Hash | 6499adcb767819f5d12018cdc1ccffebde9a02b9fa1c7e484417afbe83c51c29 |
| SimHash | 532c5bd27655 |
Groups
baiduspider
bingbot
duckduckbot
exabot
facebookexternalhit
feedfetcher-google
google-inspectiontool
google-site-verification
google-speakr
googlebot
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
msnbot
qwantify
speedyspider
twitterbot
yandexantivirus/2.0
yandexbot/3.0
yandeximageresizer/2.0
yandeximages/3.0
yandexmedia/3.0
yandexpagechecker/1.0
yandexwebmaster/2.0
yandexzakladki/3.0
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /get/ |
| Disallow | /go/ |
| Disallow | /wp-admin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sf-fandom.com/main-sitemap.txt |
Comments