rbchsathletics.bigteams.com
robots.txt

Robots Exclusion Standard data for rbchsathletics.bigteams.com

Resource Scan

Scan Details

Site Domain rbchsathletics.bigteams.com
Base Domain bigteams.com
Scan Status Ok
Last Scan2024-11-07T01:28:02+00:00
Next Scan 2024-12-07T01:28:02+00:00

Last Scan

Scanned2024-11-07T01:28:02+00:00
URL https://rbchsathletics.bigteams.com/robots.txt
Domain IPs 3.223.94.181, 3.230.240.193
Response IP 3.223.94.181
Found Yes
Hash 140d3fd80244aa1906be42cdfda560046908fabccb4960476741555654f54f8e
SimHash f31ee1b0e3a9

Groups

mj12bot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

spbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

applebot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

amazonadbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bitsightbot

Rule Path
Disallow /

facebot twitterbot

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

amazon-kendra

Product Comment
amazon-kendra Amazon Kendra Web Crawler
Rule Path Comment
Disallow / disallow access to any pages

*

Rule Path
Disallow /admin/
Disallow /cfformprotect/
Disallow /cftags/
Disallow /common/
Disallow /config/
Disallow /export/
Disallow /fonts/
Disallow /frameworks/
Disallow /img/
Disallow /includes/
Disallow /layouts/
Disallow /model/
Disallow /modules/
Disallow /services/
Disallow /src/
Disallow /udf/
Disallow /WEB-INF/