Log In Sign Up

oldwildwest.fr
robots.txt

Robots Exclusion Standard data for oldwildwest.fr

Resource Scan

Scan Details

Site Domain oldwildwest.fr
Base Domain oldwildwest.fr
Scan Status Ok
Last Scan2025-07-07T15:47:09+00:00
Next Scan 2025-08-06T15:47:09+00:00

Last Scan

Scanned2025-07-07T15:47:09+00:00
URL https://oldwildwest.fr/robots.txt
Redirect https://www.oldwildwest.fr/robots.txt
Redirect Domain www.oldwildwest.fr
Redirect Base oldwildwest.fr
Domain IPs 23.101.66.12
Redirect IPs 23.101.66.12
Response IP 23.101.66.12
Found Yes
Hash 39c02c845989424ad4a6ef32e434dd88553044a0e7dc24cf93ed3da79a1b73df
SimHash 0b3b044d0374

Groups

blp_bbot
businessdbbot
ccbot
covarioids
converacrawler
curl/
discobot
download ninja
email exractor
ezooms
fdm 3.x
flaxcrawler
grabber
grapeshot
gslfbot
heritrix
httrack
intelium_bot
istellabot
java/
larbin
lemurwebcrawler
libwww-perl
metamojicrawler
mj12bot
nutch
openacoon
php/
plukkie
proximic
python-urllib
ruby
seokicks
spbot
turnitinbot
yandexbot
wbsearchbot
weblexbot
wget
wire/0.
zyborg

Rule Path
Disallow /

msnbot/bingbot
bingbot
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /*.wgx$
Disallow /AdminCMS
Disallow /admincms
Disallow /BatchCMS
Disallow /batchcms
Disallow /Admin/
Disallow /admin/
Disallow /Auth/
Disallow /Auth$
Disallow /auth/
Disallow /Batch/
Disallow /batch/
Disallow /Custom/
Disallow /custom/
Disallow /Tmp/
Disallow /tmp/
Disallow /LazyLogin
Disallow /lazylogin
Disallow /ShowReel
Disallow /showreel
Disallow /Search/SearchCMS
Disallow /search/searchcms
Disallow /*%3Dprint%3Dtrue
Disallow /*%26ListMode%3D*
Disallow /*%26listmode%3D*
Disallow /*?ListMode=*
Disallow /*?listmode=*
Disallow /*%26SortMode%3D*
Disallow /*%26sortmode%3D*
Disallow /*?SortMode=*
Disallow /*?sortmode=*
Disallow /AreaPersonale
Back to top

Other Records

Field Value
sitemap https://www.oldwildwest.fr/sitemapcms
Back to top

Warnings

  • 1 invalid line.
Back to top