comoto.imgix.net
robots.txt

Robots Exclusion Standard data for comoto.imgix.net

Resource Scan

Scan Details

Site Domain comoto.imgix.net
Base Domain imgix.net
Scan Status Ok
Last Scan2024-09-28T15:00:43+00:00
Next Scan 2024-10-28T15:00:43+00:00

Last Scan

Scanned2024-09-28T15:00:43+00:00
URL https://comoto.imgix.net/robots.txt
Domain IPs 151.101.130.208, 151.101.194.208, 151.101.2.208, 151.101.66.208, 2a04:4e42:200::720, 2a04:4e42:400::720, 2a04:4e42:600::720, 2a04:4e42::720
Response IP 199.232.46.208
Found Yes
Hash 76c9375982647372fc9c837cf71bfc7edd80880593fb118b453f9896520fd246
SimHash 6c925920d626

Groups

*

Rule Path
Allow /
Disallow /account
Disallow /cart
Disallow /checkout
Disallow /api/
Disallow /auth/identity/callback
Disallow /auth/identity?state=*
Disallow /wish-list
Disallow /feedback$
Disallow /vehicle_selector
Disallow /fitment_notes/
Disallow /mobile_landing*
Disallow /oem/availability
Disallow /oem*ducati*
Disallow /oem-ducati-motorcycle-parts
Disallow /search?
Disallow /videos
Disallow *query%3D
Disallow *rrec%3D
Disallow *state%3D
Allow /oem-motorcycle-parts
Allow /oem*honda*
Allow /oem-honda-motorcycle-parts
Allow /oem*suzuki*
Allow /oem-suzuki-motorcycle-parts
Allow /oem*yamaha*
Allow /oem-yamaha-motorcycle-parts
Allow /oem*kawasaki*
Allow /oem-kawasaki-motorcycle-parts

pinterestbot

Rule Path
Disallow /oem*

Other Records

Field Value
crawl-delay 1.0

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.revzilla.com/sitemap.xml