topfreizeit.de
robots.txt

Robots Exclusion Standard data for topfreizeit.de

Resource Scan

Scan Details

Site Domain topfreizeit.de
Base Domain topfreizeit.de
Scan Status Ok
Last Scan2024-11-19T03:41:12+00:00
Next Scan 2024-11-26T03:41:12+00:00

Last Scan

Scanned2024-11-19T03:41:12+00:00
URL https://topfreizeit.de/robots.txt
Redirect https://www.topfreizeit.de/robots.txt
Redirect Domain www.topfreizeit.de
Redirect Base topfreizeit.de
Domain IPs 144.76.112.27
Redirect IPs 144.76.112.27
Response IP 144.76.112.27
Found Yes
Hash d72606d55dc62b80e920ec36f5d0e46c6d10e44e43413d72ed51c5568bd4fd39
SimHash 04085f91ca12

Groups

magpie-crawler
ccbot
mj12bot
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
semrushbot
semruchbot-sa
ahrefsbot
petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin
Disallow /setup/

Other Records

Field Value
sitemap https://www.topfreizeit.de/sitemap.xml

Comments

  • robots.txt
  • Server: topfreizeit.de
  • last change: 2021-09-29
  • Sitemaps

Warnings

  • 1 invalid line.