yellowbridge.com
robots.txt

Robots Exclusion Standard data for yellowbridge.com

Resource Scan

Scan Details

Site Domain yellowbridge.com
Base Domain yellowbridge.com
Scan Status Ok
Last Scan2025-01-15T14:42:16+00:00
Next Scan 2025-01-22T14:42:16+00:00

Last Scan

Scanned2025-01-15T14:42:16+00:00
URL https://yellowbridge.com/robots.txt
Redirect https://www.yellowbridge.com/robots.txt
Redirect Domain www.yellowbridge.com
Redirect Base yellowbridge.com
Domain IPs 172.96.180.47
Redirect IPs 172.96.180.47
Response IP 172.96.180.47
Found Yes
Hash 0e8868160b64432afd63c9f025003612b2583d6fd167eb0f18e805c78984aa12
SimHash 425ddd51e501

Groups

*

Rule Path
Disallow

googlebot
bingbot
msnbot
slurp
mediapartners-google*
yisouspider
yandex
baiduspider
sogou spider

Rule Path
Disallow

dotbot
googlebot-image
heritrix
ia_archiver
psbot
webcite
nutch
blexbot
mj12bot
dotbot
ahrefsbot
acapbot
semrushbot
ccbot
barkrowler
gptbot
amazonbot
mail.ru_bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.yellowbridge.com/sitemap.xml