fashionjobs.com
robots.txt

Robots Exclusion Standard data for fashionjobs.com

Resource Scan

Scan Details

Site Domain fashionjobs.com
Base Domain fashionjobs.com
Scan Status Ok
Last Scan2024-11-10T23:49:46+00:00
Next Scan 2024-11-17T23:49:46+00:00

Last Scan

Scanned2024-11-10T23:49:46+00:00
URL https://fashionjobs.com/robots.txt
Domain IPs 104.22.60.115, 104.22.61.115, 172.67.22.146
Response IP 104.22.60.115
Found Yes
Hash 38569e67cfec241681059ad2c480afab08f6dc7739cc6a5532908f3abfa1598f
SimHash ab00cd7dc293

Groups

amazonbot

Rule Path
Disallow /

amazon-kendra-web-crawler-*

Rule Path
Disallow /

applebot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

*

Rule Path
Disallow /*/../*
Disallow /*ac%3Doff*
Disallow /*aff%3D1*
Disallow /*affiche_imprime_annonce.php*
Disallow /*emploi/textile/
Disallow /*emploi/vendeur/
Disallow /*/application/*
Disallow /*error*
Disallow /*err%3Dall*
Disallow /*goto.php*
Disallow /*link_log*
Disallow /*PHPSESSID*
Disallow /*popup%3D*/
Disallow /*repondre_annonce.php*
Disallow /*redirect.php*
Disallow /*send_friend_news.php*
Disallow /*site_fashion*
Disallow /*version_pdf.php*
Disallow /*/apply/
Disallow /*/getform/
Disallow /*/iframe/
Disallow /admin/
Disallow /ajax/
Disallow /candidat/
Disallow /candidats/
Disallow /contact/
Disallow /cv/
Disallow /dashboard/
Disallow /documentation/
Disallow /fashion_build/js/l-js-optimized*
Disallow /fichiers/
Disallow /flux/
Disallow /FTP/
Disallow /job/application/*
Disallow /include/
Disallow /login/*
Disallow /menu/
Disallow /mini_site*
Disallow /network/
Disallow /news/
Disallow /popup/
Disallow /redir/
Disallow /redir/*
Disallow /register/
Disallow /s/ajax/
Disallow /s/?categories=*
Disallow /s/?gold=*
Disallow /s/?keyword=*
Disallow /s/?soc=*
Disallow /s/?metier=*
Disallow /s/?page=*
Disallow /societes/
Disallow /societeCompte/
Disallow /texte/
Disallow /traduction/
Disallow /transaction/
Disallow /societesRecrutent/ajax/
Disallow /fragments/*

Other Records

Field Value
sitemap /sitemap/index.xml

Comments

  • Fragments