ynboilers.com
robots.txt
Robots Exclusion Standard data for ynboilers.com
Resource Scan
Scan Details
Site Domain | ynboilers.com |
Base Domain | ynboilers.com |
Scan Status | Ok |
Last Scan | 2025-09-03T00:07:43+00:00 |
Next Scan | 2025-10-03T00:07:43+00:00 |
Last Scan
Scanned | 2025-09-03T00:07:43+00:00 |
URL | https://www.ynboilers.com/robots.txt |
Domain IPs | 138.113.114.153, 138.113.53.41 |
Response IP | 138.113.114.153 |
Found | Yes |
Hash | 9cea59eca0d522e24bfa32435bda89ed56f9228e3179f20600ce1c8d695cf82f |
SimHash | 0b04d3250713 |
Groups
duckduckgo-favicons-bot
Rule | Path |
---|---|
Disallow | /success.html |
Disallow | /privacy.html |
Disallow | /404.html |
Disallow | /?s= |
baiduspider
Rule | Path |
---|---|
Disallow | /success.html |
Disallow | /privacy.html |
Disallow | /404.html |
Disallow | /?s= |
yahoo! slurp
Rule | Path |
---|---|
Disallow | /success.html |
Disallow | /privacy.html |
Disallow | /404.html |
Disallow | /?s= |
sogou spider
Rule | Path |
---|---|
Disallow | /success.html |
Disallow | /privacy.html |
Disallow | /404.html |
Disallow | /?s= |
Other Records
Field | Value |
---|---|
sitemap | https://www.ynboilers.com/sitemap.txt |
sitemap | https://www.ynboilers.com/sitemap.html |