njcarndrive.com
robots.txt

Robots Exclusion Standard data for njcarndrive.com

Resource Scan

Scan Details

Site Domain njcarndrive.com
Base Domain njcarndrive.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-23T10:50:46+00:00
Next Scan 2026-01-21T10:50:46+00:00

Last Successful Scan

Scanned2024-12-03T16:49:38+00:00
URL https://njcarndrive.com/robots.txt
Redirect https://www.njcarndrive.com/robots.txt
Redirect Domain www.njcarndrive.com
Redirect Base njcarndrive.com
Domain IPs 104.21.40.221, 172.67.157.38, 2606:4700:3030::ac43:9d26, 2606:4700:3033::6815:28dd
Redirect IPs 104.21.40.221, 172.67.157.38, 2606:4700:3030::ac43:9d26, 2606:4700:3033::6815:28dd
Response IP 104.21.40.221
Found Yes
Hash 7c87cf255fb194cb5d82eb293fe9804d1ac91474b5d3ca5243d86b9609d91743
SimHash 7124593d2701

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /sitemap.xml
Disallow /

adsbot-google
facebookexternalhit

Rule Path
Disallow /Global.asax
Disallow /images/
Disallow /includes/
Disallow /lib/
Disallow /obj/
Disallow /scripts/
Disallow /js/
Disallow /style/
Disallow /stylesheet/
Disallow /App_Data/
Disallow /bin/
Disallow /0/
Disallow /1/
Disallow /2/aspx/
Disallow /2/bootstrap/
Disallow /2/css/
Disallow /2/images/
Disallow /2/includes/
Disallow /2/js/
Disallow /2/Common/VDP_Print.aspx
Disallow /custom_pages/
Disallow /customer/
Disallow /dealer/
Disallow /ucf/
Disallow */old/
Disallow */mobile/old/
Disallow *.asmx
Disallow /Dealer-Websites/_genericGrayV5.2/
Disallow /privacy.aspx
Disallow /thumb.aspx
Disallow /requestreview
Disallow */thankureview.aspx
Disallow */unhappyreview.aspx
Disallow /Robots.aspx
Disallow /PredictiveTyper.aspx
Disallow /AFVideoXML.aspx
Disallow /PredictiveTyper.aspx
Disallow /inventory.aspx?S=*
Disallow /inventory.aspx

Warnings

  • 1 invalid line.