motoboys.net
robots.txt

Robots Exclusion Standard data for motoboys.net

Resource Scan

Scan Details

Site Domain motoboys.net
Base Domain motoboys.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-05T14:39:56+00:00
Next Scan 2024-12-04T14:39:56+00:00

Last Successful Scan

Scanned2024-05-09T14:19:23+00:00
URL https://motoboys.net/robots.txt
Redirect https://www.motoboys.net/robots.txt
Redirect Domain www.motoboys.net
Redirect Base motoboys.net
Domain IPs 104.21.67.165, 172.67.178.124, 2606:4700:3036::ac43:b27c, 2606:4700:3037::6815:43a5
Redirect IPs 104.21.67.165, 172.67.178.124, 2606:4700:3036::ac43:b27c, 2606:4700:3037::6815:43a5
Response IP 172.67.178.124
Found Yes
Hash 6d5a3001540cbf0c2ee927cdb32aea78fd350a9e084f5f7793db8cc83fc4964d
SimHash 2fd57b6155d0

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wusage
Disallow /cadastro
Disallow /bkcup-BancodeDados
Disallow /000SiteVersao1

bingbot
slurp
googlebot
googlebot-images
adsbot-google
mediapartners-google

Product Comment
bingbot Bing
slurp Yahoo
googlebot Google
googlebot-images Google Imagens
adsbot-google Google Adwords
mediapartners-google Google Partners

No rules defined. All paths allowed.