mg-jo.com
robots.txt

Robots Exclusion Standard data for mg-jo.com

Resource Scan

Scan Details

Site Domain mg-jo.com
Base Domain mg-jo.com
Scan Status Ok
Last Scan2024-11-04T23:31:46+00:00
Next Scan 2024-11-18T23:31:46+00:00

Last Scan

Scanned2024-11-04T23:31:46+00:00
URL https://www.mg-jo.com/robots.txt
Domain IPs 18.155.68.106, 18.155.68.125, 18.155.68.127, 18.155.68.86, 2600:9000:23d2:0:8:3357:b780:93a1, 2600:9000:23d2:4c00:8:3357:b780:93a1, 2600:9000:23d2:6200:8:3357:b780:93a1, 2600:9000:23d2:6800:8:3357:b780:93a1, 2600:9000:23d2:8000:8:3357:b780:93a1, 2600:9000:23d2:800:8:3357:b780:93a1, 2600:9000:23d2:b000:8:3357:b780:93a1, 2600:9000:23d2:e200:8:3357:b780:93a1
Response IP 18.155.68.127
Found Yes
Hash 7dc19ebe1402eb684bba88b859ef92abf815e9dfdc668a7f2633444f3bc1ea5d
SimHash 8b0dde03edc2

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */site/*
Disallow */enquiry/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mg-jo.com/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk