neafl.leag1.com
robots.txt

Robots Exclusion Standard data for neafl.leag1.com

Resource Scan

Scan Details

Site Domain neafl.leag1.com
Base Domain leag1.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-20T01:40:58+00:00
Next Scan 2024-05-20T01:40:58+00:00

Last Successful Scan

Scanned2024-03-22T01:39:47+00:00
URL http://neafl.leag1.com/robots.txt
Domain IPs 125.56.219.51, 125.56.219.59, 2600:1417:5e::1731:3c23, 2600:1417:5e::1731:3c2b, 2600:1417:5e::1731:3c40, 2600:1417:5e::adde:9423, 2600:1417:5e::adde:9430, 72.247.127.227, 72.247.127.234, 72.247.127.235, 72.247.127.240, 72.247.127.248, 72.247.127.249, 72.247.127.250
Response IP 72.247.127.187
Found Yes
Hash 5c1e8372b97643bbbe78a1cd9330de9e3f18730772f418027e8c1c1ccdb62939
SimHash 0046044a13d2

Groups

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /Default.asp
Allow /Page.asp
Allow /HP.asp
Disallow /CPanel/
Disallow /FCKeditor/
Disallow /CuteEditor/
Disallow /cuteeditor_files/
Disallow /CKeditor/
Disallow /Cycling/
Disallow /DutySchedule/
Disallow /EditorFiles/
Disallow /Feeds/
Disallow /File/
Disallow /Fly/
Disallow /FlightLog/
Disallow /Report/
Disallow /Store/
Disallow /Survey/
Disallow /Support/
Disallow /SupportTicket/
Disallow /Templates/
Disallow /UserForms/
Disallow /spew/
Disallow /d4bab964-c08e-46cd-b6a5-2bbfabeec2fd/Images/Club/
Disallow /Calendar.asp
Disallow /CalendarOfEvents.asp
Disallow /DivisionSchedule.asp
Disallow /MySchedule.asp
Disallow /MasterGameSchedule.asp
Disallow /TeamNextEvents.asp
Disallow /CPanel/FacilitySchedule.asp
Disallow /ScheduleDetail.asp
Disallow /GameDetails.asp
Disallow /Facility.asp
Disallow /Brackets.asp
Disallow /Picture.asp
Disallow /Pictures.asp
Disallow /Contacts.asp
Disallow /Member.asp
Disallow /TeamContacts.asp
Disallow /Facility.asp
Disallow /StatsTeam.asp
Disallow /StatsPlayer.asp
Disallow /Standings.asp
Disallow /FacilityList.asp
Disallow /Facility.asp
Disallow /teamsselect.asp
Disallow /Favicon.ico
Disallow /teamsselect.asp
Disallow /PagePassword.asp
Disallow /WXForecast.asp
Disallow /UserForm.asp

Other Records

Field Value
crawl-delay 10

Comments

  • robots.txt for http://www.LeagueAthletics.com/