language.exchange
robots.txt

Robots Exclusion Standard data for language.exchange

Resource Scan

Scan Details

Site Domain language.exchange
Base Domain language.exchange
Scan Status Ok
Last Scan2024-11-09T21:46:48+00:00
Next Scan 2024-11-16T21:46:48+00:00

Last Scan

Scanned2024-11-09T21:46:48+00:00
URL https://language.exchange/robots.txt
Domain IPs 91.134.190.187
Response IP 91.134.190.187
Found Yes
Hash 8d17b46860f485c86869ee5987f23af38852fc4f99462599de29ef5f2f159380
SimHash 674d4455c195

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

smtbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

sogou web spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://language.exchange/sitemaps/sitemap.xml