aktuelkatalogu.com
robots.txt

Robots Exclusion Standard data for aktuelkatalogu.com

Resource Scan

Scan Details

Site Domain aktuelkatalogu.com
Base Domain aktuelkatalogu.com
Scan Status Ok
Last Scan2024-09-25T21:58:53+00:00
Next Scan 2024-10-02T21:58:53+00:00

Last Scan

Scanned2024-09-25T21:58:53+00:00
URL https://aktuelkatalogu.com/robots.txt
Domain IPs 89.252.190.167
Response IP 89.252.190.167
Found Yes
Hash cb8df81f85069e7a71d2fd301f5a024c4d7d29a0ea2aad3911b9247801286083
SimHash 0c54d6c25515

Groups

*

Rule Path
Allow /
Disallow /*?*

googlebot

Rule Path
Allow /
Disallow /*?*

mediapartners-google

Rule Path
Allow /
Disallow /*?*

googlebot-news

Rule Path
Allow /
Disallow /*?*

googlebot-video

Rule Path
Allow /
Disallow /*?*

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /
Disallow /*?*

googlebot-mobile

Rule Path
Allow /
Disallow /*?*

slurp

Rule Path
Allow /
Disallow /*?*

bing

Rule Path
Allow /
Disallow /*?*

msnbot

Rule Path
Allow /
Disallow /*?*

yandex

Rule Path
Allow /
Disallow /*?*

ninjabot

Rule Path
Allow /
Disallow /*?*

teoma

Rule Path
Allow /
Disallow /*?*

twiceler

Rule Path
Allow /
Disallow /*?*

gigabot

Rule Path
Allow /
Disallow /*?*

scrubby

Rule Path
Allow /
Disallow /*?*

robozilla

Rule Path
Allow /
Disallow /*?*

nutch

Rule Path
Allow /
Disallow /*?*

ia_archiver

Rule Path
Allow /
Disallow /*?*

baiduspider

Rule Path
Allow /
Disallow /*?*

naverbot

Rule Path
Allow /
Disallow /*?*

yeti

Rule Path
Allow /
Disallow /*?*

yahoo-mmcrawler

Rule Path
Allow /
Disallow /*?*

yahoo-blogs/v3.9

Rule Path
Allow /
Disallow /*?*

psbot

Rule Path
Allow /
Disallow /*?*

asterias

Rule Path
Allow /
Disallow /*?*

Other Records

Field Value
sitemap https://aktuelkatalogu.com/sitemap/
sitemap https://aktuelkatalogu.com/sitemap-news/
sitemap https://aktuelkatalogu.com/sitemap-image/