autocarsindustry.com
robots.txt

Robots Exclusion Standard data for autocarsindustry.com

Resource Scan

Scan Details

Site Domain autocarsindustry.com
Base Domain autocarsindustry.com
Scan Status Ok
Last Scan2024-10-05T11:27:22+00:00
Next Scan 2024-10-12T11:27:22+00:00

Last Scan

Scanned2024-10-05T11:27:22+00:00
URL https://autocarsindustry.com/robots.txt
Domain IPs 162.213.253.67
Response IP 162.213.253.67
Found Yes
Hash 42bbc5988e17fc18e39ed24f30d3d4a473575ed5ba6a9e984e0ac8ecf5774d6b
SimHash 001c9d68ce92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /?feed=xmlsitemap*
Disallow /post-sitemap*.xml
Disallow /*pokies*
Disallow /*casino*
Disallow /*casinos*
Disallow /*gambling*
Disallow /*slot*
Disallow /*slots*
Disallow /*online*
Disallow /*bet*
Disallow /*bonus*
Disallow /*naked*
Disallow /*wheel*
Disallow /*gaming*
Disallow /*games*
Disallow /*app*
Disallow /*pokie*
Disallow /*card*
Disallow /*machine*
Disallow /*spins*
Disallow /*play*

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://autocarsindustry.com/sitemap_index.xml

Warnings

  • 2 invalid lines.