setdart.com
robots.txt

Robots Exclusion Standard data for setdart.com

Resource Scan

Scan Details

Site Domain setdart.com
Base Domain setdart.com
Scan Status Ok
Last Scan2024-06-23T02:40:36+00:00
Next Scan 2024-07-23T02:40:36+00:00

Last Scan

Scanned2024-06-23T02:40:36+00:00
URL https://setdart.com/robots.txt
Redirect https://www.setdart.com/robots.txt
Redirect Domain www.setdart.com
Redirect Base setdart.com
Domain IPs 104.21.90.33, 172.67.193.200, 2606:4700:3031::ac43:c1c8, 2606:4700:3032::6815:5a21
Redirect IPs 104.21.90.33, 172.67.193.200, 2606:4700:3031::ac43:c1c8, 2606:4700:3032::6815:5a21
Response IP 172.67.193.200
Found Yes
Hash c1f6e9fd102b5d0c6717db1fe47a41c0cfd9cc3eb6e155f503f70ffa65e04da8
SimHash 000dfcb00a01

Groups

semrushbot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

*

Rule Path
Disallow /setdartsubastas/
Disallow /admin.php
Disallow /error.php
Disallow /admin/
Disallow /blocks/
Disallow /cache/
Disallow /language/
Disallow /modules/
Disallow /*?prevtheme=*
Disallow /*file%3Dgetbid2*
Disallow /images/

googlebot

Rule Path
Allow /modules/subasta/albums/
Allow /images/
Allow /themes/threeone/style/
Allow /includes/javascript/*.css

Warnings

  • 2 invalid lines.