maemequer.pt
robots.txt
Robots Exclusion Standard data for maemequer.pt
Resource Scan
Scan Details
Site Domain | maemequer.pt |
Base Domain | maemequer.pt |
Scan Status | Ok |
Last Scan | 2024-06-04T11:16:40+00:00 |
Next Scan | 2024-06-11T11:16:40+00:00 |
Last Scan
Scanned | 2024-06-04T11:16:40+00:00 |
URL | https://maemequer.pt/robots.txt |
Domain IPs | 104.21.59.191, 172.67.182.235, 2606:4700:3033::6815:3bbf, 2606:4700:3035::ac43:b6eb |
Response IP | 104.21.59.191 |
Found | Yes |
Hash | d1fe11ceab5289932f11d48048dd5da55fffeb674eecc52551d195976e519306 |
SimHash | 6e0dd804c391 |
Groups
*
Rule | Path |
---|---|
Disallow | /?attachment_id |
Disallow | /attachment/ |
Disallow | /attachment/* |
Disallow | /members/ |
Disallow | /membros/ |
Disallow | /readme.html |
Disallow | /refer/ |
Disallow | /page/ |
Disallow | /page/* |
Disallow | /undefined/* |
Disallow | /undefined/ |
Disallow | /*.php$ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://maemequer.pt/sitemap_index.xml |
Comments