topgold.forum
robots.txt
Robots Exclusion Standard data for topgold.forum
Resource Scan
Scan Details
| Site Domain | topgold.forum |
| Base Domain | topgold.forum |
| Scan Status | Ok |
| Last Scan | 2024-09-28T13:15:24+00:00 |
| Next Scan | 2024-10-05T13:15:24+00:00 |
Last Scan
| Scanned | 2024-09-28T13:15:24+00:00 |
| URL | https://topgold.forum/robots.txt |
| Domain IPs | 104.21.33.37, 172.67.158.131, 2606:4700:3030::6815:2125, 2606:4700:3035::ac43:9e83 |
| Response IP | 104.21.33.37 |
| Found | Yes |
| Hash | 866c8496e2af22d08780b691d37d3baf1e28a697e7e66134cf1240b9d48f619b |
| SimHash | 3a320116c838 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cache/ |
| Disallow | /converge_local/ |
| Disallow | /hooks/ |
| Disallow | /ips_kernel/ |
| Disallow | /retail/ |
| Disallow | /public/style_captcha/ |
| Disallow | /index.php?app=core&module=task |
| Disallow | /index.php?app=forums&module=moderate§ion=moderate |
| Disallow | /index.php?app=forums&module=extras§ion=forward |
| Disallow | /index.php?app=members&module=chat |
| Disallow | /index.php?&unlockUserAgent=1 |
| Disallow | /*%26module%3Dsearch |
| Allow | /*%26search_tags%3D |
| Disallow | /*app%3Dcore%26module%3Dglobal%26section%3Dreputation |
| Disallow | /*app%3Dcore%26module%3Dusercp |
| Disallow | /*app%3Dmembers%26module%3Dmessaging |
| Disallow | /*%26p%3D |
| Disallow | /*%26pid%3D |
| Disallow | /*%26hl%3D |
| Disallow | /*%26start%3D |
| Disallow | /*view__getnewpost$ |
| Disallow | /*view__getlastpost$ |
| Disallow | /*view__old$ |
| Disallow | /*view__new$ |
| Disallow | /*view__getfirst$ |
| Disallow | /*view__getprevious$ |
| Disallow | /*view__getnext$ |
| Disallow | /*view__getlast$ |
| Disallow | /*%26view%3Dgetnewpost$ |
| Disallow | /*%26view%3Dgetlastpost$ |
| Disallow | /*%26view%3Dold$ |
| Disallow | /*%26view%3Dnew$ |
| Disallow | /*%26view%3Dgetfirst$ |
| Disallow | /*%26view%3Dgetprevious$ |
| Disallow | /*%26view%3Dgetnext$ |
| Disallow | /*%26view%3Dgetlast$ |
| Disallow | /*?s= |
| Disallow | /*%26s%3D |
| Disallow | /index.php?app=core&module=global§ion=login&do=deleteCookies |
| Disallow | /index.php?app=forums&module=extras§ion=rating |
| Disallow | /index.php?app=forums&module=forums§ion=markasread |
| Disallow | /*%26do%3Dwho |
| Disallow | /*%26section%3Ddname |
| Disallow | /profile/ |
compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://topgoldforum.com/sitemap.xml |
Comments