motoscanosport.com
robots.txt

Robots Exclusion Standard data for motoscanosport.com

Resource Scan

Scan Details

Site Domain motoscanosport.com
Base Domain motoscanosport.com
Scan Status Ok
Last Scan2024-09-09T05:30:49+00:00
Next Scan 2024-10-09T05:30:49+00:00

Last Scan

Scanned2024-09-09T05:30:49+00:00
URL https://motoscanosport.com/robots.txt
Domain IPs 104.21.54.23, 172.67.222.223, 2606:4700:3036::6815:3617, 2606:4700:3036::ac43:dedf
Response IP 172.67.222.223
Found Yes
Hash 616f8a56e15406c4f2594102b1ced6cebbdca9ccadc6dc95edf71fe376277137
SimHash 696dd202a232

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mj12bot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

sistrix optimizer

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

wotbox

Rule Path
Disallow /