411ny.org
robots.txt
Robots Exclusion Standard data for 411ny.org
Resource Scan
Scan Details
| Site Domain | 411ny.org |
| Base Domain | 411ny.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 4/17/2025, 5:53:03 PM |
| Next Scan | 7/16/2025, 5:53:03 PM |
Last Successful Scan
| Scanned | 9/19/2023, 3:40:14 PM |
| URL | https://411ny.org/robots.txt |
| Redirect | https://bitly.com/robots.txt |
| Redirect Domain | bitly.com |
| Redirect Base | bitly.com |
| Domain IPs | 70.32.25.86 |
| Redirect IPs | 67.199.248.14, 67.199.248.15 |
| Response IP | 67.199.248.14 |
| Found | Yes |
| Hash | d91cb4a1f2ea14ba0b6bcb4e1f692f767097ff7b35cb3c1061097497efdd12b7 |
| SimHash | 261cc1c9edd3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pages/landing$ |
| Disallow | /pages/es$ |
| Disallow | /pages/pt$ |
| Disallow | /pages/it$ |
| Disallow | /pages/de$ |
| Disallow | /pages/fr$ |
| Disallow | /pages/home |
| Disallow | /pages/thank-you |
| Disallow | /pages/free-plan-refresh-faqs |
| Disallow | /blog/*? |
| Disallow | /blog/?p= |
| Disallow | /blog/page/*/?p= |
| Disallow | /pages/*?preview%5B |
| Disallow | /pages/*%26preview%5B |
| Disallow | /pages/*%5B |
| Disallow | /pages/*%7B |
| Disallow | /pages/*%3B |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bitly.com/pages/sitemap_index.xml |
| sitemap | https://bitly.com/blog/sitemap_index.xml |
Comments