wildoftech.com
robots.txt

Robots Exclusion Standard data for wildoftech.com

Resource Scan

Scan Details

Site Domain wildoftech.com
Base Domain wildoftech.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-15T18:40:54+00:00
Next Scan 2024-07-14T18:40:54+00:00

Last Successful Scan

Scanned2023-12-18T11:34:46+00:00
URL https://wildoftech.com/robots.txt
Domain IPs 104.21.91.199, 172.67.179.52, 2606:4700:3034::ac43:b334, 2606:4700:3037::6815:5bc7
Response IP 104.21.91.199
Found Yes
Hash 795be17542b07b3d94fef29710d5a2b2e6b61265b9ed65921864407f5f1bfcd1
SimHash 511d89c0ef19

Groups

*

Rule Path
Disallow /search/
Disallow /admin/
Disallow /brand/
Disallow /product/
Disallow /detail/
Disallow /redirect?

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /