refurb.me
robots.txt
Robots Exclusion Standard data for refurb.me
Resource Scan
Scan Details
| Site Domain | refurb.me |
| Base Domain | refurb.me |
| Scan Status | Ok |
| Last Scan | 2025-12-15T04:29:04+00:00 |
| Next Scan | 2026-01-14T04:29:04+00:00 |
Last Scan
| Scanned | 2025-12-15T04:29:04+00:00 |
| URL | https://refurb.me/robots.txt |
| Redirect | https://www.refurb.me/robots.txt |
| Redirect Domain | www.refurb.me |
| Redirect Base | refurb.me |
| Domain IPs | 172.66.41.6, 172.66.42.250, 2606:4700:3108::ac42:2906, 2606:4700:3108::ac42:2afa |
| Redirect IPs | 172.66.41.6, 172.66.42.250, 2606:4700:3108::ac42:2906, 2606:4700:3108::ac42:2afa |
| Response IP | 172.66.42.250 |
| Found | Yes |
| Hash | f1f1ed6406553db37bd149c82392f4fad9bb23723c9b19e81d6a700b883f27ec |
| SimHash | eb09a4cbcd96 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/alerts/* |
| Disallow | /*/dataset |
| Disallow | /*/rss/* |
| Disallow | /*/redirect/* |
| Disallow | /redirect/* |
| Disallow | /*/go/* |
| Disallow | /unsubscribe/* |
| Disallow | /*/unsubscribe/* |
| Disallow | /admin/* |
| Disallow | /api/* |
| Disallow | /plsb/* |
| Disallow | /iub/* |
| Disallow | /*?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.refurb.me/sitemap/index.xml |