thaivapes.com
robots.txt
Robots Exclusion Standard data for thaivapes.com
Resource Scan
Scan Details
Site Domain | thaivapes.com |
Base Domain | thaivapes.com |
Scan Status | Ok |
Last Scan | 2024-06-13T15:34:28+00:00 |
Next Scan | 2024-07-13T15:34:28+00:00 |
Last Scan
Scanned | 2024-06-13T15:34:28+00:00 |
URL | https://thaivapes.com/robots.txt |
Redirect | https://www.thai-vapes.com/robots.txt |
Redirect Domain | www.thai-vapes.com |
Redirect Base | thai-vapes.com |
Domain IPs | 104.21.79.244, 172.67.150.80, 2606:4700:3033::ac43:9650, 2606:4700:3035::6815:4ff4 |
Redirect IPs | 52.76.165.2, 54.255.145.230 |
Response IP | 54.255.145.230 |
Found | Yes |
Hash | 51cd17df5303357d388ec1513ea74cac7ab804cfb5059409ad6dc43c535163a2 |
SimHash | 1960882cea29 |
Groups
*
Rule | Path |
---|---|
Disallow | */ajax* |
Disallow | */ipn* |
Disallow | */mpay* |
Disallow | */payment_callback* |
Disallow | */payment-callback* |
Disallow | */test* |
Disallow | */third_party* |
Disallow | */third-party* |
Disallow | */redis* |
Disallow | */cart* |
Disallow | */fake* |
Comments