travmarket.com
robots.txt

Robots Exclusion Standard data for travmarket.com

Resource Scan

Scan Details

Site Domain travmarket.com
Base Domain travmarket.com
Scan Status Ok
Last Scan2024-04-30T14:07:49+00:00
Next Scan 2024-05-30T14:07:49+00:00

Last Scan

Scanned2024-04-30T14:07:49+00:00
URL https://travmarket.com/robots.txt
Redirect https://www.travmarket.com/robots.txt
Redirect Domain www.travmarket.com
Redirect Base travmarket.com
Domain IPs 199.34.228.77
Redirect IPs 199.34.228.77
Response IP 199.34.228.77
Found Yes
Hash 37a6f46554287b1e772c3fb034762416e4afd07a101769728a8b0e0ba78bd2fa
SimHash 0045d84c6f93

Groups

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /https%3A//register.travmarket.com

Other Records

Field Value
sitemap https://www.travmarket.com/sitemap.xml