kidsareatrip.com
robots.txt
Robots Exclusion Standard data for kidsareatrip.com
Resource Scan
Scan Details
Site Domain | kidsareatrip.com |
Base Domain | kidsareatrip.com |
Scan Status | Ok |
Last Scan | 2024-11-15T14:18:07+00:00 |
Next Scan | 2024-11-22T14:18:07+00:00 |
Last Scan
Scanned | 2024-11-15T14:18:07+00:00 |
URL | https://kidsareatrip.com/robots.txt |
Domain IPs | 104.18.37.69, 172.64.150.187, 2606:4700:4400::6812:2545, 2606:4700:4400::ac40:96bb |
Response IP | 172.64.150.187 |
Found | Yes |
Hash | d6e41dd26417227ebd50db57e647ea5f0705a1cb424c672a3386c389f6ca2a80 |
SimHash | 65085cc601f1 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /trackback |
Disallow | /*/trackback |
Disallow | /comment |
Disallow | /comments |
Disallow | /wp-login.php |
Disallow | /xmlrpc.php |
*
Rule | Path |
---|---|
Disallow | /*.php$ |
Disallow | /*.inc$ |
Disallow | /*.cgi$ |
Disallow | /*.xhtml$ |
Disallow | /*.xlsx$ |
Disallow | /*.doc$ |
Disallow | /*.pdf$ |
Disallow | /*.zip$ |
Other Records
Field | Value |
---|---|
sitemap | https://kidsareatrip.com/sitemap_index.xml |