nyb.com
robots.txt
Robots Exclusion Standard data for nyb.com
Resource Scan
Scan Details
| Site Domain | nyb.com |
| Base Domain | nyb.com |
| Scan Status | Ok |
| Last Scan | 2025-08-04T18:43:49+00:00 |
| Next Scan | 2025-09-03T18:43:49+00:00 |
Last Scan
| Scanned | 2025-08-04T18:43:49+00:00 |
| URL | https://nyb.com/robots.txt |
| Redirect | https://www.nyb.com/robots.txt |
| Redirect Domain | www.nyb.com |
| Redirect Base | nyb.com |
| Domain IPs | 104.19.232.38, 104.19.233.38 |
| Redirect IPs | 104.19.232.38, 104.19.233.38, 2606:4700::6813:e826, 2606:4700::6813:e926 |
| Response IP | 104.19.232.38 |
| Found | Yes |
| Hash | 99e6aacb32fb7435acfe7dc64d50b669df70fb060ba358fdb5ae16b805f3f2f0 |
| SimHash | 42675c11a151 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /token/ |
| Disallow | /core/ |
| Disallow | /manager/ |
| Disallow | /manager-nyb/ |
| Disallow | /search-results/ |
| Disallow | /pdf-viewer/ |
| Disallow | /cn/pdf-viewer/ |
| Disallow | /es/pdf-viewer/ |
| Disallow | *?r=false |
| Disallow | /request-for-quote/?pdf=* |
| Disallow | /modified-radial/ |
| Disallow | /straight-radial/ |
| Disallow | /heavy-duty-radial/ |
| Disallow | /suppliers/nybpoterms.pdf |
| Disallow | /latest-news/?arc_author= |
| Disallow | /latest-news/?page= |
| Disallow | /latest-news/author/ |
| Disallow | /all-products-guide/ |
| Disallow | /ajax-territory/ |
| Disallow | *?pdf=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.nyb.com/sitemap.xml |