Log In Sign Up

direct-geld.com
robots.txt

Robots Exclusion Standard data for direct-geld.com

Resource Scan

Scan Details

Site Domain direct-geld.com
Base Domain direct-geld.com
Scan Status Ok
Last Scan2024-06-26T23:54:11+00:00
Next Scan 2024-07-26T23:54:11+00:00

Last Scan

Scanned2024-06-26T23:54:11+00:00
URL https://direct-geld.com/robots.txt
Domain IPs 2a01:7c8:f0:1052::5cdd:2cb, 85.10.159.48
Response IP 85.10.159.48
Found Yes
Hash 2037ea61b33558bf4f4d54e3933c614c494b45278c8415040bf1a769a2c7df17
SimHash 0e4edc30e211

Groups

blexbot

Rule Path
Disallow /

baidu spider

Rule Path
Disallow /

yandex bot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

duckduckgo bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /*?s=
Disallow /*%26s%3D
Back to top

Other Records

Field Value
sitemap https://direct-geld.com/sitemap_index.xml
Back to top

Comments

  • Website Sitemap
  • Crawlers Setup
  • Directories
Back to top