myspecialdates.com
robots.txt
Robots Exclusion Standard data for myspecialdates.com
Resource Scan
Scan Details
Site Domain | myspecialdates.com |
Base Domain | myspecialdates.com |
Scan Status | Ok |
Last Scan | 2024-05-20T08:32:38+00:00 |
Next Scan | 2024-06-19T08:32:38+00:00 |
Last Scan
Scanned | 2024-05-20T08:32:38+00:00 |
URL | https://myspecialdates.com/robots.txt |
Domain IPs | 104.26.8.44, 104.26.9.44, 172.67.69.226, 2606:4700:20::681a:82c, 2606:4700:20::681a:92c, 2606:4700:20::ac43:45e2 |
Response IP | 172.67.69.226 |
Found | Yes |
Hash | 904474aa0120a55e320dd65b7d3247d73f8a54bae264ee8f23032ec434bd6634 |
SimHash | 2c690840aa93 |
Groups
*
Rule | Path |
---|---|
Disallow | /lnd* |
Disallow | /page* |
Disallow | /privacy-policy* |
Disallow | /not-found$ |
Other Records
Field | Value |
---|---|
sitemap | https://myspecialdates.com/sitemap.xml |