wallpapercrafter.com
robots.txt

Robots Exclusion Standard data for wallpapercrafter.com

Resource Scan

Scan Details

Site Domain wallpapercrafter.com
Base Domain wallpapercrafter.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-28T17:04:58+00:00
Next Scan 2024-06-04T17:04:58+00:00

Last Successful Scan

Scanned2023-02-28T23:55:00+00:00
URL https://wallpapercrafter.com/robots.txt
Domain IPs 104.21.17.86, 172.67.175.99
Response IP 172.67.175.99
Found Yes
Hash ef52a6ed62310cc768b05c50246b2a33934f39576dd0342859e67f588dfdfc82
SimHash a911a8002f12

Groups

*

Rule Path
Disallow /uploads/thumb/*
Disallow /crop/*
Disallow /user/*
Disallow /dwn.php*
Disallow /cdn-cgi/*
Disallow /*/rss.xml