travmarket.com
robots.txt
Robots Exclusion Standard data for travmarket.com
Resource Scan
Scan Details
Site Domain | travmarket.com |
Base Domain | travmarket.com |
Scan Status | Ok |
Last Scan | 2024-04-30T14:07:49+00:00 |
Next Scan | 2024-05-30T14:07:49+00:00 |
Last Scan
Scanned | 2024-04-30T14:07:49+00:00 |
URL | https://travmarket.com/robots.txt |
Redirect | https://www.travmarket.com/robots.txt |
Redirect Domain | www.travmarket.com |
Redirect Base | travmarket.com |
Domain IPs | 199.34.228.77 |
Redirect IPs | 199.34.228.77 |
Response IP | 199.34.228.77 |
Found | Yes |
Hash | 37a6f46554287b1e772c3fb034762416e4afd07a101769728a8b0e0ba78bd2fa |
SimHash | 0045d84c6f93 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /apps/ |
Disallow | /https%3A//register.travmarket.com |
Other Records
Field | Value |
---|---|
sitemap | https://www.travmarket.com/sitemap.xml |