theclunkerjunker.com
robots.txt

Robots Exclusion Standard data for theclunkerjunker.com

Resource Scan

Scan Details

Site Domain theclunkerjunker.com
Base Domain theclunkerjunker.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-09T23:03:36+00:00
Next Scan 2026-03-09T23:03:36+00:00

Last Successful Scan

Scanned2023-04-28T07:21:00+00:00
URL https://theclunkerjunker.com/robots.txt
Domain IPs 104.26.0.41, 104.26.1.41, 172.67.68.219, 2606:4700:20::681a:129, 2606:4700:20::681a:29, 2606:4700:20::ac43:44db
Response IP 172.67.68.219
Found Yes
Hash 132c28b7e55f11592fb653d4479c65675addcefe1001323750aac332cc0b1a69
SimHash 68040e79cf93

Groups

*

Rule Path
Disallow /sellers
Disallow /passwords
Allow /sellers/login

Other Records

Field Value
sitemap https://theclunkerjunker.com/sitemap.txt