boxden.com
robots.txt

Robots Exclusion Standard data for boxden.com

Resource Scan

Scan Details

Site Domain boxden.com
Base Domain boxden.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-19T03:58:15+00:00
Next Scan 2024-11-17T03:58:15+00:00

Last Successful Scan

Scanned2023-07-27T02:55:53+00:00
URL https://boxden.com/robots.txt
Domain IPs 104.26.0.65, 104.26.1.65, 172.67.72.116, 2606:4700:20::681a:141, 2606:4700:20::681a:41, 2606:4700:20::ac43:4874
Response IP 104.26.0.65
Found Yes
Hash 388e9a70dd0d4f2c4b276e9b72def69e9d3827d7addfcebb132508d64cf22361
SimHash 274703559794

Groups

mediapartners-google

Rule Path
Allow /*

googlebot

Rule Path
Disallow /printthread.php
Disallow /misc.php
Disallow /tags.php
Disallow /member.php
Disallow /register.php
Disallow /newthread.php
Disallow /subscription.php
Disallow /faq.php
Disallow /searchresults.php
Disallow /profile.php
Disallow /reputation.php
Disallow /private.php
Disallow /usercp.php
Disallow /announcement.php
Disallow /editpost.php
Disallow /thanks.php

msnbot

Rule Path
Disallow /printthread.php
Disallow /misc.php
Disallow /tags.php
Disallow /member.php
Disallow /register.php
Disallow /newthread.php
Disallow /subscription.php
Disallow /faq.php
Disallow /searchresults.php
Disallow /profile.php
Disallow /reputation.php
Disallow /private.php
Disallow /usercp.php
Disallow /announcement.php
Disallow /editpost.php
Disallow /thanks.php

bingbot

Rule Path
Disallow /printthread.php
Disallow /misc.php
Disallow /tags.php
Disallow /member.php
Disallow /register.php
Disallow /newthread.php
Disallow /subscription.php
Disallow /faq.php
Disallow /searchresults.php
Disallow /profile.php
Disallow /reputation.php
Disallow /private.php
Disallow /usercp.php
Disallow /announcement.php
Disallow /editpost.php
Disallow /thanks.php

slurp

Rule Path
Disallow /printthread.php
Disallow /misc.php
Disallow /tags.php
Disallow /member.php
Disallow /register.php
Disallow /newthread.php
Disallow /subscription.php
Disallow /faq.php
Disallow /searchresults.php
Disallow /profile.php
Disallow /reputation.php
Disallow /private.php
Disallow /usercp.php
Disallow /announcement.php
Disallow /editpost.php
Disallow /thanks.php

Other Records

Field Value
sitemap https://boxden.com/dbseositemap.php