bevgirlslax.com
robots.txt

Robots Exclusion Standard data for bevgirlslax.com

Resource Scan

Scan Details

Site Domain bevgirlslax.com
Base Domain bevgirlslax.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-08T11:52:20+00:00
Next Scan 2025-01-06T11:52:20+00:00

Last Successful Scan

Scanned2024-03-13T10:27:32+00:00
URL http://bevgirlslax.com/robots.txt
Domain IPs 52.207.47.121, 54.82.143.102
Response IP 54.82.143.102
Found Yes
Hash 5c1e8372b97643bbbe78a1cd9330de9e3f18730772f418027e8c1c1ccdb62939
SimHash 0046044a13d2

Groups

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /Default.asp
Allow /Page.asp
Allow /HP.asp
Disallow /CPanel/
Disallow /FCKeditor/
Disallow /CuteEditor/
Disallow /cuteeditor_files/
Disallow /CKeditor/
Disallow /Cycling/
Disallow /DutySchedule/
Disallow /EditorFiles/
Disallow /Feeds/
Disallow /File/
Disallow /Fly/
Disallow /FlightLog/
Disallow /Report/
Disallow /Store/
Disallow /Survey/
Disallow /Support/
Disallow /SupportTicket/
Disallow /Templates/
Disallow /UserForms/
Disallow /spew/
Disallow /d4bab964-c08e-46cd-b6a5-2bbfabeec2fd/Images/Club/
Disallow /Calendar.asp
Disallow /CalendarOfEvents.asp
Disallow /DivisionSchedule.asp
Disallow /MySchedule.asp
Disallow /MasterGameSchedule.asp
Disallow /TeamNextEvents.asp
Disallow /CPanel/FacilitySchedule.asp
Disallow /ScheduleDetail.asp
Disallow /GameDetails.asp
Disallow /Facility.asp
Disallow /Brackets.asp
Disallow /Picture.asp
Disallow /Pictures.asp
Disallow /Contacts.asp
Disallow /Member.asp
Disallow /TeamContacts.asp
Disallow /Facility.asp
Disallow /StatsTeam.asp
Disallow /StatsPlayer.asp
Disallow /Standings.asp
Disallow /FacilityList.asp
Disallow /Facility.asp
Disallow /teamsselect.asp
Disallow /Favicon.ico
Disallow /teamsselect.asp
Disallow /PagePassword.asp
Disallow /WXForecast.asp
Disallow /UserForm.asp

Other Records

Field Value
crawl-delay 10

Comments

  • robots.txt for http://www.LeagueAthletics.com/