lickingtoday.com
robots.txt
Robots Exclusion Standard data for lickingtoday.com
Resource Scan
Scan Details
| Site Domain | lickingtoday.com |
| Base Domain | lickingtoday.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-24T15:39:43+00:00 |
| Next Scan | 2026-02-23T15:39:43+00:00 |
Last Successful Scan
| Scanned | 2025-12-26T14:55:45+00:00 |
| URL | https://lickingtoday.com/robots.txt |
| Domain IPs | 104.21.80.214, 172.67.154.91, 2606:4700:3031::6815:50d6, 2606:4700:3036::ac43:9a5b |
| Response IP | 172.67.154.91 |
| Found | Yes |
| Hash | 9cd421f017b9d786be2d07d7bc937ce3d42769664b5efa4d1a1fbd014264280a |
| SimHash | 6e5ed145cf25 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /*.json |
| Disallow | /v.js |
| Disallow | /ad.js |
Other Records
| Field | Value |
|---|---|
| sitemap | https://lickingtoday.com/sitemaps/lickingtoday/sitemap.xml.gz |
| sitemap | https://lickingtoday.com/sitemaps/lickingtoday/sitemap_news.xml.gz |
Comments