want-that.com
robots.txt

Robots Exclusion Standard data for want-that.com

Resource Scan

Scan Details

Site Domain want-that.com
Base Domain want-that.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-15T02:04:49+00:00
Next Scan 2025-09-13T02:04:49+00:00

Last Successful Scan

Scanned2025-04-23T22:57:41+00:00
URL https://want-that.com/robots.txt
Domain IPs 104.21.0.231, 172.67.128.95, 2606:4700:3033::6815:e7, 2606:4700:3034::ac43:805f
Response IP 172.67.128.95
Found Yes
Hash cd219298d644eb8721f0b9ab526b15ca3dbb12f534181e9e2ee37849654c2b37
SimHash 68354c1a87e2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /trackback/
Disallow /xmlrpc.php

heritrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://want-that.com/sitemap_index.xml