marioboards.com
robots.txt

Robots Exclusion Standard data for marioboards.com

Resource Scan

Scan Details

Site Domain marioboards.com
Base Domain marioboards.com
Scan Status Ok
Last Scan2024-09-27T05:17:48+00:00
Next Scan 2024-10-04T05:17:48+00:00

Last Scan

Scanned2024-09-27T05:17:48+00:00
URL https://marioboards.com/robots.txt
Redirect https://www.marioboards.com/robots.txt
Redirect Domain www.marioboards.com
Redirect Base marioboards.com
Domain IPs 66.165.244.154
Redirect IPs 66.165.244.154
Response IP 66.165.244.154
Found Yes
Hash b3676b65ec4b05995ef86db15146f519daf7822dbede109fabf5f69ead205eeb
SimHash eb0ed460eeb0

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

zoomspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.marioboards.com/sitemap.php