cambridgelax.com
robots.txt

Robots Exclusion Standard data for cambridgelax.com

Resource Scan

Scan Details

Site Domain cambridgelax.com
Base Domain cambridgelax.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-19T12:44:03+00:00
Next Scan 2024-05-19T12:44:03+00:00

Last Successful Scan

Scanned2024-03-21T12:01:18+00:00
URL http://www.cambridgelax.com/robots.txt
Domain IPs 2600:1413:b000:1f::17d1:2e08, 2600:1413:b000:1f::17d1:2e13, 72.247.127.194, 72.247.127.195, 72.247.127.217, 72.247.127.218, 72.247.127.225, 72.247.127.234, 72.247.127.240, 72.247.127.248, 72.247.127.249
Response IP 72.247.127.208
Found Yes
Hash 5c1e8372b97643bbbe78a1cd9330de9e3f18730772f418027e8c1c1ccdb62939
SimHash 0046044a13d2

Groups

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /Default.asp
Allow /Page.asp
Allow /HP.asp
Disallow /CPanel/
Disallow /FCKeditor/
Disallow /CuteEditor/
Disallow /cuteeditor_files/
Disallow /CKeditor/
Disallow /Cycling/
Disallow /DutySchedule/
Disallow /EditorFiles/
Disallow /Feeds/
Disallow /File/
Disallow /Fly/
Disallow /FlightLog/
Disallow /Report/
Disallow /Store/
Disallow /Survey/
Disallow /Support/
Disallow /SupportTicket/
Disallow /Templates/
Disallow /UserForms/
Disallow /spew/
Disallow /d4bab964-c08e-46cd-b6a5-2bbfabeec2fd/Images/Club/
Disallow /Calendar.asp
Disallow /CalendarOfEvents.asp
Disallow /DivisionSchedule.asp
Disallow /MySchedule.asp
Disallow /MasterGameSchedule.asp
Disallow /TeamNextEvents.asp
Disallow /CPanel/FacilitySchedule.asp
Disallow /ScheduleDetail.asp
Disallow /GameDetails.asp
Disallow /Facility.asp
Disallow /Brackets.asp
Disallow /Picture.asp
Disallow /Pictures.asp
Disallow /Contacts.asp
Disallow /Member.asp
Disallow /TeamContacts.asp
Disallow /Facility.asp
Disallow /StatsTeam.asp
Disallow /StatsPlayer.asp
Disallow /Standings.asp
Disallow /FacilityList.asp
Disallow /Facility.asp
Disallow /teamsselect.asp
Disallow /Favicon.ico
Disallow /teamsselect.asp
Disallow /PagePassword.asp
Disallow /WXForecast.asp
Disallow /UserForm.asp

Other Records

Field Value
crawl-delay 10

Comments

  • robots.txt for http://www.LeagueAthletics.com/