sameteem.com
robots.txt
Robots Exclusion Standard data for sameteem.com
Resource Scan
Scan Details
| Site Domain | sameteem.com |
| Base Domain | sameteem.com |
| Scan Status | Ok |
| Last Scan | 2024-05-27T21:38:35+00:00 |
| Next Scan | 2024-06-03T21:38:35+00:00 |
Last Scan
| Scanned | 2024-05-27T21:38:35+00:00 |
| URL | https://sameteem.com/robots.txt |
| Domain IPs | 104.26.6.118, 104.26.7.118, 172.67.69.79, 2606:4700:20::681a:676, 2606:4700:20::681a:776, 2606:4700:20::ac43:454f |
| Response IP | 104.26.6.118 |
| Found | Yes |
| Hash | 0f84c40af505d155a95e162a9d0a2cb8cf26abad7594473491ca7988faea8e6a |
| SimHash | a45b5ae2e6b1 |
Groups
aspiegelbot
blexbot
bubing
cliqzbot
dataforseobot
dotbot
download ninja
fast
fetch
grub-client
gptbot
httrack
k2spider
larbin
libwww
linko
mauibot
microsoft.url.control
mj12bot
msiecrawler
npbot
offline explorer
petalbot
sitecheck.internetseer.com
sitesnagger
teleport
teleportpro
voltron
webcopier
webreaper
webstripper
webzip
xenu
zealbot
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /whats-new/ |
| Disallow | /account/ |
| Disallow | /attachments/ |
| Disallow | /goto/ |
| Disallow | /posts/ |
| Disallow | /login/ |
| Disallow | /admin.php |
| Disallow | /hlstatsx/hlstats.php?mode=search* |
| Disallow | /hlstatsx/hlstats.php?mode=chathistory* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sameteem.com/sitemap.php |
| sitemap | http://cdn.attracta.com/sitemap/3190214.xml.gz |
Warnings
- 1 invalid line.
Comments