beerme.nyc
robots.txt
Robots Exclusion Standard data for beerme.nyc
Resource Scan
Scan Details
| Site Domain | beerme.nyc |
| Base Domain | beerme.nyc |
| Scan Status | Ok |
| Last Scan | 2025-10-08T16:57:00+00:00 |
| Next Scan | 2025-10-22T16:57:00+00:00 |
Last Scan
| Scanned | 2025-10-08T16:57:00+00:00 |
| URL | https://beerme.nyc/robots.txt |
| Domain IPs | 104.16.36.105, 104.16.42.105, 104.19.240.93, 104.19.241.93 |
| Response IP | 104.16.42.105 |
| Found | Yes |
| Hash | c4a4e77aba402dcca1621e35cbc65522dd8ef20c6214b8d1720840a3f9925d40 |
| SimHash | 22054872d553 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /private/ | Prevents crawling of the 'private' directory (if applicable) |
| Allow | / | Allows crawling of the entire site |
Other Records
| Field | Value |
|---|---|
| sitemap | https://beerme.nyc/sitemap.xml |
Comments