Log In Sign Up

stockholm.pauker.at
robots.txt

Robots Exclusion Standard data for stockholm.pauker.at

Resource Scan

Scan Details

Site Domain stockholm.pauker.at
Base Domain pauker.at
Scan Status Ok
Last Scan2024-11-13T02:46:03+00:00
Next Scan 2024-11-20T02:46:03+00:00

Last Scan

Scanned2024-11-13T02:46:03+00:00
URL http://stockholm.pauker.at/robots.txt
Redirect https://www.pauker.at/robots.txt
Redirect Domain www.pauker.at
Redirect Base pauker.at
Redirect IPs 46.4.83.133
Response IP 46.4.83.133
Found Yes
Hash 48a580bbe82603b865dbd96c57ef753499c5ea832b3a59e6e0c1117fa95907b3
SimHash 2342c8422e70

Groups

*

Rule Path
Disallow /pasu.php
Disallow /VIP/SindbadkaroL/
Disallow /p.php
Disallow /pa.php
Disallow /pauker_joomla_wrapper.php

mj12bot
webaroobot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.pauker.at/sitemap/index.xml
Back to top

Comments

  • robots.txt for http://www.beispiel.de/
  • Zugriff auf alle Dateien erlauben
  • Crawl-Delay: 1
  • Crawl-Delay: 3
Back to top

Warnings

  • 2 invalid lines.
Back to top