refundo.hu
robots.txt
Robots Exclusion Standard data for refundo.hu
Resource Scan
Scan Details
| Site Domain | refundo.hu |
| Base Domain | refundo.hu |
| Scan Status | Ok |
| Last Scan | 2024-09-27T04:41:02+00:00 |
| Next Scan | 2024-10-04T04:41:02+00:00 |
Last Scan
| Scanned | 2024-09-27T04:41:02+00:00 |
| URL | https://refundo.hu/robots.txt |
| Redirect | https://www.refundo.hu:443/robots.txt |
| Redirect Domain | www.refundo.hu |
| Redirect Base | refundo.hu |
| Domain IPs | 185.178.174.213, 2a0a:6580:16::b9b2:aed5 |
| Redirect IPs | 185.178.174.213, 2a0a:6580:16::b9b2:aed5 |
| Response IP | 185.178.174.213 |
| Found | Yes |
| Hash | a5637807888cb9d302c3f5a460d8c45c4ad78780e0d1a5f1b787c34df4967e22 |
| SimHash | 38dc40d2a1e2 |
Groups
proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
blexbot
ccbot
tencenttraveler
timpibot
cookiebot
| Rule | Path |
|---|---|
| Disallow | / |
mj12bot
ahrefsbot
seokicks-robot
dotbot
dotbot
semrushbot
semrushbot-sa
megaindex.ru
spbot
dataforseobot
| Rule | Path |
|---|---|
| Disallow | / |
yandex
yandexbot
yandexmobilebot
yandeximageresizer
coccocbot
coccocbot-web
coccocbot-image
yeti
baiduspider
sogou web spider
sogou
seekbot
seekport
seekport crawler
amazonbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*?do=* |
| Disallow | /*?*&do=* |
| Disallow | /?orderby=* |
| Disallow | /*?orderby=* |
| Disallow | /*?*&orderby=* |
| Disallow | /?order=* |
| Disallow | /*?order=* |
| Disallow | /*?*&order=* |
| Disallow | /exit/* |
| Disallow | /json/* |
| Disallow | /facebook/* |
| Disallow | /sign/facebook-authorize |
| Disallow | /*/undefined |
| Disallow | /*/*q%3A*/* |
| Disallow | /*/*%3A*%2C*/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.refundo.hu/sitemap.xml |
Warnings
- 1 invalid line.
Comments