trisignup.com
robots.txt

Robots Exclusion Standard data for trisignup.com

Resource Scan

Scan Details

Site Domain trisignup.com
Base Domain trisignup.com
Scan Status Ok
Last Scan2024-10-24T13:47:19+00:00
Next Scan 2024-11-23T13:47:19+00:00

Last Scan

Scanned2024-10-24T13:47:19+00:00
URL https://trisignup.com/robots.txt
Redirect https://www.trisignup.com/robots.txt
Redirect Domain www.trisignup.com
Redirect Base trisignup.com
Domain IPs 3.222.216.205, 34.194.61.140, 54.165.155.11
Redirect IPs 3.222.216.205, 34.194.61.140, 54.165.155.11
Response IP 3.222.216.205
Found Yes
Hash 6280c3ed4cbb0f3fde4bcdb4d4528fddd3aa9afab4cda4b5476d5748d92165cd
SimHash 6c1eef406adb

Groups

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /Race/NJ/Moorestown/InYourFaceScrapper
Disallow /race/nj/moorestown/inyourfacescrapper
Disallow /captcha
Disallow /em/
Disallow /Logout
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /Race/Photos/ViewPhoto/
Disallow /Race/Results/Simple/
Disallow /Race/Results/*/FinishersCert
Disallow /Race/Results/*/FinishersCertImg
Disallow /*?*PHPSESSID*
Disallow /*?*embedId2*
Disallow /*?*embedToken*
Disallow /*?*regToken*
Disallow /*?*RefCode=*
Disallow /*?*err=*
Disallow /*?*smsg=*
Disallow /*?*redirect=*
Disallow /*?*autoLogin*
Disallow /*?*remMeAttempt*

Other Records

Field Value
crawl-delay 1

Comments

  • Place wildcards last since some robots don't know how to parse them