duxburydragonsfootball.com
robots.txt

Robots Exclusion Standard data for duxburydragonsfootball.com

Resource Scan

Scan Details

Site Domain duxburydragonsfootball.com
Base Domain duxburydragonsfootball.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-10T11:59:23+00:00
Next Scan 2024-10-08T11:59:23+00:00

Last Successful Scan

Scanned2024-03-13T11:48:49+00:00
URL http://duxburydragonsfootball.com/robots.txt
Domain IPs 52.207.47.121, 54.82.143.102
Response IP 54.82.143.102
Found Yes
Hash 5c1e8372b97643bbbe78a1cd9330de9e3f18730772f418027e8c1c1ccdb62939
SimHash 0046044a13d2

Groups

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /Default.asp
Allow /Page.asp
Allow /HP.asp
Disallow /CPanel/
Disallow /FCKeditor/
Disallow /CuteEditor/
Disallow /cuteeditor_files/
Disallow /CKeditor/
Disallow /Cycling/
Disallow /DutySchedule/
Disallow /EditorFiles/
Disallow /Feeds/
Disallow /File/
Disallow /Fly/
Disallow /FlightLog/
Disallow /Report/
Disallow /Store/
Disallow /Survey/
Disallow /Support/
Disallow /SupportTicket/
Disallow /Templates/
Disallow /UserForms/
Disallow /spew/
Disallow /d4bab964-c08e-46cd-b6a5-2bbfabeec2fd/Images/Club/
Disallow /Calendar.asp
Disallow /CalendarOfEvents.asp
Disallow /DivisionSchedule.asp
Disallow /MySchedule.asp
Disallow /MasterGameSchedule.asp
Disallow /TeamNextEvents.asp
Disallow /CPanel/FacilitySchedule.asp
Disallow /ScheduleDetail.asp
Disallow /GameDetails.asp
Disallow /Facility.asp
Disallow /Brackets.asp
Disallow /Picture.asp
Disallow /Pictures.asp
Disallow /Contacts.asp
Disallow /Member.asp
Disallow /TeamContacts.asp
Disallow /Facility.asp
Disallow /StatsTeam.asp
Disallow /StatsPlayer.asp
Disallow /Standings.asp
Disallow /FacilityList.asp
Disallow /Facility.asp
Disallow /teamsselect.asp
Disallow /Favicon.ico
Disallow /teamsselect.asp
Disallow /PagePassword.asp
Disallow /WXForecast.asp
Disallow /UserForm.asp

Other Records

Field Value
crawl-delay 10

Comments

  • robots.txt for http://www.LeagueAthletics.com/