tag-walk.com
robots.txt
Robots Exclusion Standard data for tag-walk.com
Resource Scan
Scan Details
Site Domain | tag-walk.com |
Base Domain | tag-walk.com |
Scan Status | Ok |
Last Scan | 2024-09-19T03:36:13+00:00 |
Next Scan | 2024-09-26T03:36:13+00:00 |
Last Scan
Scanned | 2024-09-19T03:36:13+00:00 |
URL | https://tag-walk.com/robots.txt |
Redirect | https://www.tag-walk.com/robots.txt |
Redirect Domain | www.tag-walk.com |
Redirect Base | tag-walk.com |
Domain IPs | 108.156.133.106, 108.156.133.55, 108.156.133.56, 108.156.133.75 |
Redirect IPs | 184.87.193.81, 184.87.193.85, 2600:1413:b000:13::b857:c190, 2600:1413:b000:13::b857:c197 |
Response IP | 23.52.171.121 |
Found | Yes |
Hash | 7630eb547502cf07ca983468be1afce926727910924efd1ea56983eb8658e724 |
SimHash | f259dce6a6b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /en/look/666666 |
Disallow | /es/look/666666 |
Disallow | /fr/look/666666 |
Disallow | /it/look/666666 |
Disallow | /zh/look/666666 |
Disallow | /en/street/666666 |
Disallow | /es/street/666666 |
Disallow | /fr/street/666666 |
Disallow | /it/street/666666 |
Disallow | /zh/street/666666 |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |