wp.fuw.ch
robots.txt

Robots Exclusion Standard data for wp.fuw.ch

Resource Scan

Scan Details

Site Domain wp.fuw.ch
Base Domain fuw.ch
Scan Status Ok
Last Scan2024-11-13T08:48:45+00:00
Next Scan 2024-11-20T08:48:45+00:00

Last Scan

Scanned2024-11-13T08:48:45+00:00
URL https://wp.fuw.ch/robots.txt
Domain IPs 104.18.16.127, 104.18.17.127, 2606:4700::6812:107f, 2606:4700::6812:117f
Response IP 104.18.16.127
Found Yes
Hash abc19a74fe1cfb3cbf5c1e1fe02cf2cdeaff8c5ebfb9d8018256188252d67e08
SimHash 6b0c58533ba2

Groups

*

Rule Path
Disallow /extern_templates/emulations/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Disallow /*?*preview=true
Disallow /wp-login.php
Disallow /wp-login.php*
Disallow /wp-content/plugins/piwik/external/jsonapi.php*
Disallow /suchresultate
Disallow /article/$
Disallow /boerse/portfolio/
Disallow /boerse/watchlist/

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

nutch

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

socialrankiobot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

companybook crawler

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

Comments

  • FuW robots.txt 06.03.2018