tndeer.com
robots.txt

Robots Exclusion Standard data for tndeer.com

Resource Scan

Scan Details

Site Domain tndeer.com
Base Domain tndeer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-09T00:37:23+00:00
Next Scan 2024-06-07T00:37:23+00:00

Last Successful Scan

Scanned2023-08-13T00:10:33+00:00
URL https://tndeer.com/robots.txt
Redirect https://www.tndeer.com/robots.txt
Redirect Domain www.tndeer.com
Redirect Base tndeer.com
Domain IPs 104.26.4.233, 104.26.5.233, 172.67.71.224, 2606:4700:20::681a:4e9, 2606:4700:20::681a:5e9, 2606:4700:20::ac43:47e0
Redirect IPs 104.26.4.233, 104.26.5.233, 172.67.71.224, 2606:4700:20::681a:4e9, 2606:4700:20::681a:5e9, 2606:4700:20::ac43:47e0
Response IP 172.67.71.224
Found Yes
Hash badac53d98cf825265b8994aa6b6c394ce05cd28ba0713701b3bed0c0b7894e1
SimHash 201ed8f08c93

Groups

*

Rule Path
Disallow /account/
Disallow /conversations/
Disallow /find-new/
Disallow /login
Disallow /search/
Disallow /unanswered/

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tndeer.com/sitemap.php