gpaley.ch
robots.txt

Robots Exclusion Standard data for gpaley.ch

Resource Scan

Scan Details

Site Domain gpaley.ch
Base Domain gpaley.ch
Scan Status Ok
Last Scan2024-09-09T03:19:20+00:00
Next Scan 2024-10-09T03:19:20+00:00

Last Scan

Scanned2024-09-09T03:19:20+00:00
URL https://gpaley.ch/robots.txt
Redirect https://www.gpaley.ch/robots.txt
Redirect Domain www.gpaley.ch
Redirect Base gpaley.ch
Domain IPs 5.148.186.78
Redirect IPs 5.148.186.78
Response IP 5.148.186.78
Found Yes
Hash fb12add322e7732a189d1080fc7bb1b973fc514a798fda53fe7d0adb8ae8f6ad
SimHash 6e551d13e2d3

Groups

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
applebot
applenewsbot
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
bingbot
bingpreview
bublupbot
ccbot
cliqzbot
coccoc
coccocbot-image
coccocbot-web
daumoa
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebookexternalhit
facebot
feedly
findxbot
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mediapartners-google
mojeekbot
msnbot
msnbot-media
orangebot
pinterest
plukkie
qwantify
rambler
seznambot
sosospider
slurp
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
sputnikbot
teoma
twitterbot
wotbox
yacybot
yandex
yandexmobilebot
yeti
yioopbot
yoozbot
youdaobot
seobility
ahrefsbot

Rule Path
Disallow /specific/files
Disallow /networks
Disallow /users
Disallow /*/ajax

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gpaley.ch/sitemap.xml

Comments

  • ROBOTS.TXT
  • Updates can be retrieved from: https://www.ditig.com/robots-txt-template
  • This document is licensed with a CC BY-NC-SA 4.0 license.
  • Last update: 2021-11-04

Warnings

  • 3 invalid lines.