nationalfloorsdirect.com
robots.txt
Robots Exclusion Standard data for nationalfloorsdirect.com
Resource Scan
Scan Details
| Site Domain | nationalfloorsdirect.com |
| Base Domain | nationalfloorsdirect.com |
| Scan Status | Ok |
| Last Scan | 2024-05-30T06:25:54+00:00 |
| Next Scan | 2024-06-29T06:25:54+00:00 |
Last Scan
| Scanned | 2024-05-30T06:25:54+00:00 |
| URL | https://nationalfloorsdirect.com/robots.txt |
| Redirect | https://www.nationalfloorsdirect.com/robots.txt |
| Redirect Domain | www.nationalfloorsdirect.com |
| Redirect Base | nationalfloorsdirect.com |
| Domain IPs | 3.228.226.181 |
| Redirect IPs | 18.164.154.107, 18.164.154.119, 18.164.154.2, 18.164.154.3 |
| Response IP | 108.157.60.77 |
| Found | Yes |
| Hash | 1b2722e4a0e9d38f41c8a12ac38614961c85ac17ad39579cef2bdb70647ff133 |
| SimHash | 351445456553 |
Groups
dotbot disallow: / user-agent: semrushbot disallow: / user-agent: semrushbot-sa disallow: / user-agent: semrushbot-ba disallow: / user-agent: semrushbot-si disallow: / user-agent: semrushbot-swa disallow: / user-agent: semrushbot-ct disallow: / user-agent: semrushbot-bm disallow: / user-agent: semrushbot-seoab disallow: / user-agent: petalbot disallow: / user-agent: serpstatbot disallow: / user-agent: zoominfobot disallow: / user-agent: mj12bot disallow: / user-agent: barkrowler disallow: / user-agent: baiduspider user-agent: 360spider user-agent: yisouspider disallow: / user-agent: bytespider disallow: / user-agent: sogou web spider disallow: / user-agent: sogou inst spider disallow: / user-agent: adsbot disallow: / user-agent: ahrefsbot crawl-delay: 10 user-agent: * allow: / crawl-delay: 10 disallow: /dataproxy/ disallow: /?disable_pc_preview=true disallow: /scenario.aspx disallow: /render.ashx sitemap: /sitemap.xml
No rules defined. All paths allowed.