smileypete.com
robots.txt
Robots Exclusion Standard data for smileypete.com
Resource Scan
Scan Details
Site Domain | smileypete.com |
Base Domain | smileypete.com |
Scan Status | Ok |
Last Scan | 2024-09-28T20:44:00+00:00 |
Next Scan | 2024-10-05T20:44:00+00:00 |
Last Scan
Scanned | 2024-09-28T20:44:00+00:00 |
URL | https://smileypete.com/robots.txt |
Domain IPs | 75.101.132.169 |
Response IP | 75.101.132.169 |
Found | Yes |
Hash | 8f51e632ec87d2d1c1907af31e71f36a14078f02820f6f7e281e98703f2bc9c9 |
SimHash | 611c1a40e193 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/search |
Other Records
Field | Value |
---|---|
sitemap | https://smileypete.com/sitemap.xml |
sitemap | https://smileypete.com/sitemap_news.xml |