cdn.classicfirearms.com
robots.txt

Robots Exclusion Standard data for cdn.classicfirearms.com

Resource Scan

Scan Details

Site Domain cdn.classicfirearms.com
Base Domain classicfirearms.com
Scan Status Ok
Last Scan2024-09-15T05:10:24+00:00
Next Scan 2024-10-15T05:10:24+00:00

Last Scan

Scanned2024-09-15T05:10:24+00:00
URL https://cdn.classicfirearms.com/robots.txt
Domain IPs 151.101.130.92, 151.101.194.92, 151.101.2.92, 151.101.66.92, 2a04:4e42:200::604, 2a04:4e42:400::604, 2a04:4e42:600::604, 2a04:4e42::604
Response IP 199.232.46.92
Found Yes
Hash f6fdf0b9a4cc36c883fea11c7dfa9d33d07bc4e2eaff5d9e202e872fcaa1b507
SimHash 880704c0a611

Groups

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /admin/
Disallow /blog/
Disallow /amlist/
Disallow /productalert/
Disallow /_edreamz/
Disallow /shipping/
Disallow /shipment/
Disallow /*_bta_tid%3D*
Disallow /*abc%3D*
Disallow /*arnds%3D*
Disallow /*awt%3D*
Disallow /*blr%3D*
Disallow /*caliber%3D*
Disallow /*dir%3D*
Disallow /*limit%3D*
Disallow /*mag_capacity%3D*
Disallow /*mc_cid%3D*
Disallow /*?order=*
Disallow /*%26order%3D*
Disallow /*PageSpeed%3D*
Disallow /*?stock=*
Disallow /*%26stock%3D*
Disallow /*trk_msg%3D*
Disallow /*utm_campaign%3D*
Disallow /*utm_medium%3D*
Disallow /*utm_source%3D*