safetyunlimited.com
robots.txt

Robots Exclusion Standard data for safetyunlimited.com

Resource Scan

Scan Details

Site Domain safetyunlimited.com
Base Domain safetyunlimited.com
Scan Status Ok
Last Scan2024-09-10T14:45:51+00:00
Next Scan 2024-10-10T14:45:51+00:00

Last Scan

Scanned2024-09-10T14:45:51+00:00
URL https://safetyunlimited.com/robots.txt
Redirect https://www.safetyunlimited.com/robots.txt
Redirect Domain www.safetyunlimited.com
Redirect Base safetyunlimited.com
Domain IPs 72.32.76.251
Redirect IPs 72.32.76.251
Response IP 72.32.76.251
Found Yes
Hash 0328a4c2cb81bf9284e1551f4283cbfc4271bd883b26bd9805e6439629469b34
SimHash 89fa0981e780

Groups

googlebot

Rule Path
Disallow /adovbs.inc
Disallow /Admin/
Disallow /aicc/
Disallow /ajax/
Disallow /api/
Disallow /archived/
Disallow /aspnet_client/
Disallow /cart/
Disallow /CertificatePreview/*
Disallow /cgi-bin/
Disallow /check/
Disallow /cimg/
Disallow /classroom-training/ajax/
Disallow /companyname
Disallow /connections/
Disallow /corporate/
Disallow /custom_show2.asp
Disallow /custom_show2_timer.asp
Disallow /custom_show2_articulate.asp
Disallow /CustomPayment/
Disallow /dotnet/
Disallow /emailtemplate/
Disallow /Emtagreements/
Disallow /errors/
Disallow /fckeditor/
Disallow /FCKeditor2/
Disallow /files/
Disallow /images-email/
Disallow /includes/
Disallow /launch_test_drive.asp
Disallow /launch_test_drive_story.asp
Disallow /logout.asp
Disallow /online-courses/pdf/*
Disallow /certificatepreview/*
Disallow /PDF/
Disallow /pdf/
Disallow /SCORM/
Disallow /scromv2/
Disallow /student/
Disallow /studenthome2/
Disallow /Training-on-CDROM/
Disallow /verification/*
Disallow /vsadmin/

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /adovbs.inc
Disallow /Admin/
Disallow /aicc/
Disallow /ajax/
Disallow /api/
Disallow /archived/
Disallow /aspnet_client/
Disallow /cart/
Disallow /CertificatePreview/*
Disallow /cgi-bin/
Disallow /check/
Disallow /cimg/
Disallow /classroom-training/ajax/
Disallow /companyname
Disallow /connections/
Disallow /corporate/
Disallow /custom_show2.asp
Disallow /custom_show2_timer.asp
Disallow /custom_show2_articulate.asp
Disallow /CustomPayment/
Disallow /dotnet/
Disallow /emailtemplate/
Disallow /Emtagreements/
Disallow /errors/
Disallow /fckeditor/
Disallow /FCKeditor2/
Disallow /files/
Disallow /images-email/
Disallow /includes/
Disallow /launch_test_drive.asp
Disallow /launch_test_drive_story.asp
Disallow /logout.asp
Disallow /online-courses/pdf/*
Disallow /certificatepreview/*
Disallow /PDF/
Disallow /pdf/
Disallow /SCORM/
Disallow /scromv2/
Disallow /student/
Disallow /studenthome2/
Disallow /SSLA/*
Disallow /Training-on-CDROM/
Disallow /verification/*
Disallow /vsadmin/
Disallow /%3E
Disallow /cdn/projects/safetyunlimited.com/menu-catalogs-sidenav_rev1.asp

bingbot

Rule Path
Disallow /States/*

ninjabot

Rule Path
Disallow /api/
Disallow /newsletter/*
Disallow /images/*
Disallow /js/*
Disallow /assets/*
Disallow /CertificatePreview/*

libwww-perl

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.safetyunlimited.com/sitemap_states.xml
sitemap http://www.safetyunlimited.com/sitemap.xml