kelbillet.com
robots.txt

Robots Exclusion Standard data for kelbillet.com

Resource Scan

Scan Details

Site Domain kelbillet.com
Base Domain kelbillet.com
Scan Status Ok
Last Scan2024-11-15T02:42:23+00:00
Next Scan 2024-11-22T02:42:23+00:00

Last Scan

Scanned2024-11-15T02:42:23+00:00
URL https://kelbillet.com/robots.txt
Redirect https://www.kelbillet.com/robots.txt
Redirect Domain www.kelbillet.com
Redirect Base kelbillet.com
Domain IPs 91.121.52.100
Redirect IPs 91.121.52.100
Response IP 91.121.52.100
Found Yes
Hash 0388d8667e8d14606a9f979bc4d646df1fc331d1794cc1052807dddee2c21a54
SimHash 40dc0f7f6391

Groups

*

Rule Path
Disallow /rechercher-billet-de-train.php?*
Disallow /billet-avion-pas-cher.php?*
Disallow /train/recherche-billet-de-train.php?*
Disallow /recherche/*
Disallow /partners/compavols/proxy.php*
Disallow /train/horaire/horaire_train_search.php*
Disallow /voiture/voiture_personnelle.php*
Disallow /ajax*
Disallow /u/*
Disallow /partners/*
Disallow /pub/*
Disallow /generated/*
Disallow /rdc/*
Disallow /services/*
Disallow /*/voyageurs%2C*%2C*$
Disallow /redirection*
Disallow /perso.php*
Disallow /perso_*
Disallow /train/gare/question/report_abuse_qa.php*
Disallow /billet_report_abuse.php*
Disallow *?popin
Disallow /blog/wp-admin
Disallow /blog/cgi-bin
Disallow /blog/wp-content/cache
Disallow /blog/*/trackback
Disallow /blog/*.php$
Disallow /blog/*.inc$
Disallow /blog/*.txt$
Allow /blog/wp-content/uploads
Disallow /train/billet/*-*-b0*.html
Disallow /train/billet/*-*-b1*.html
Disallow /train/billet/*-*-b2*.html
Disallow /train/billet/*-*-b3*.html
Disallow /train/billet/*-*-b4*.html
Disallow /train/billet/*-*-b5*.html
Disallow /train/billet/*-*-b6*.html
Disallow /train/billet/*-*-b7*.html
Disallow /train/billet/*-*-b8*.html
Disallow /train/billet/*-*-b9*.html
Disallow /es/redirect*
Disallow /es/gopilisearchengine/webservice/*

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /u/*
Disallow /rechercher-billet-de-train.php?*
Disallow /billet-avion-pas-cher.php?*
Disallow /train/recherche-billet-de-train.php?*
Disallow /recherche/*
Disallow /partners/compavols/proxy.php*
Disallow /train/horaire/horaire_train_search.php*
Disallow /voiture/voiture_personnelle.php*
Disallow /redirection*
Disallow *?popin

blexbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.kelbillet.com/sitemap.xml
sitemap https://www.kelbillet.com/blog/sitemap_index.xml
sitemap https://www.kelbillet.com/sitemap-trajet.xml
sitemap https://www.kelbillet.com/sitemap-trajet2.xml
sitemap https://www.kelbillet.com/sitemap-trajet3.xml
sitemap https://www.kelbillet.com/sitemap-horaires.xml
sitemap https://www.kelbillet.com/sitemap-bus.xml
sitemap https://www.kelbillet.com/sitemap-covoiturage.xml
sitemap https://www.kelbillet.com/sitemap-itineraire.xml
sitemap https://www.kelbillet.com/sitemap-itineraire2.xml
sitemap https://www.kelbillet.com/sitemap-avion.xml