bucketlist.net
robots.txt

Robots Exclusion Standard data for bucketlist.net

Resource Scan

Scan Details

Site Domain bucketlist.net
Base Domain bucketlist.net
Scan Status Ok
Last Scan2026-01-11T06:44:20+00:00
Next Scan 2026-02-10T06:44:20+00:00

Last Scan

Scanned2026-01-11T06:44:20+00:00
URL https://bucketlist.net/robots.txt
Redirect https://www.bucketlist.net/robots.txt
Redirect Domain www.bucketlist.net
Redirect Base bucketlist.net
Domain IPs 104.21.45.15, 172.67.207.201, 2606:4700:3031::6815:2d0f, 2606:4700:3033::ac43:cfc9
Redirect IPs 104.21.45.15, 172.67.207.201, 2606:4700:3031::6815:2d0f, 2606:4700:3033::ac43:cfc9
Response IP 172.67.207.201
Found Yes
Hash 0aec44aba61e8b19881d2ab1b87463e335b185ef65332f620abbc7b588bef131
SimHash 851dd826c7d2

Groups

httrack

Rule Path
Disallow /

*

Rule Path
Allow /
Allow /site_media/static/images/
Allow /site_media/static/bootstrap/
Allow /site_media/media/asset/
Allow /site_media/media/thumbnails/
Allow /site_media/media/photologue/
Disallow /site_media
Disallow /about
Disallow /lists/edit_pic/bm1/
Disallow /lists/add
Disallow /avatar
Disallow /test
Disallow /account

Other Records

Field Value
sitemap https://www.bucketlist.net/sitemap.xml