dextrosetech.com
robots.txt

Robots Exclusion Standard data for dextrosetech.com

Resource Scan

Scan Details

Site Domain dextrosetech.com
Base Domain dextrosetech.com
Scan Status Ok
Last Scan2025-07-08T02:44:30+00:00
Next Scan 2025-08-07T02:44:30+00:00

Last Scan

Scanned2025-07-08T02:44:30+00:00
URL https://www.dextrosetech.com/robots.txt
Domain IPs 2600:9000:271a:2800:16:b4d0:4640:93a1, 2600:9000:271a:3800:16:b4d0:4640:93a1, 2600:9000:271a:6400:16:b4d0:4640:93a1, 2600:9000:271a:6c00:16:b4d0:4640:93a1, 2600:9000:271a:8000:16:b4d0:4640:93a1, 2600:9000:271a:a400:16:b4d0:4640:93a1, 2600:9000:271a:e00:16:b4d0:4640:93a1, 2600:9000:271a:fe00:16:b4d0:4640:93a1, 54.192.18.117, 54.192.18.25, 54.192.18.37, 54.192.18.79
Response IP 3.165.75.121
Found Yes
Hash 84a3d428a451a6cda8313aeae6d29c3b81fd058e50ec587f3f5d8b52c926296a
SimHash b1559474cf90

Groups

*

Rule Path
Disallow /cart/
Disallow /checkout
Disallow /gmc-and-refund-policy
Disallow /resubscribe
Disallow /securepay
Disallow /transaction-status
Disallow /unsubscribe
Disallow /404
Disallow /500
Disallow /fonts/
Disallow /partial/
Disallow */search/*/2
Disallow */search/*/3
Disallow */search/*/4
Disallow */search/*/5
Disallow */search/*/6
Disallow */search/*/7
Disallow */search/*/8
Disallow */search/*/9
Disallow */search/*/10

builtbottough

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

bytedancespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

alibabacloud

Rule Path
Disallow /

bytespyder

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dextrosetech.com/sitemap.xml

Comments

  • Powered by Boost360