tweettunnel.com
robots.txt

Robots Exclusion Standard data for tweettunnel.com

Resource Scan

Scan Details

Site Domain tweettunnel.com
Base Domain tweettunnel.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-27T07:25:52+00:00
Next Scan 2024-08-25T07:25:52+00:00

Last Successful Scan

Scanned2023-08-02T07:23:52+00:00
URL https://tweettunnel.com/robots.txt
Domain IPs 2600:1f13:520:c400:84dd:f41a:ec90:55ef, 52.88.248.157
Response IP 52.88.248.157
Found Yes
Hash 1847ee930e40f4894bb7ba12dff0dad706f737e82051bbbdb24197ec5db643b3
SimHash 0c16d8a0e2b3

Groups

baiduspider

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3