онлайн-нейросеть.рф
robots.txt

Robots Exclusion Standard data for онлайн-нейросеть.рф

Resource Scan

Scan Details

Site Domain онлайн-нейросеть.рф
Base Domain онлайн-нейросеть.рф
Scan Status Ok
Last Scan2024-09-19T01:37:25+00:00
Next Scan 2024-10-19T01:37:25+00:00

Last Scan

Scanned2024-09-19T01:37:25+00:00
URL https://онлайн-нейросеть.рф/robots.txt
Redirect https://xn----7sbqarcjpdbejzpq4n.xn--p1ai/robots.txt
Domain IPs 104.21.29.84, 172.67.148.162, 2606:4700:3033::6815:1d54, 2606:4700:3036::ac43:94a2
Response IP 104.21.29.84
Found Yes
Hash 8bd488a3186f1c18a9c8a0c3fee1c1a9dd37849a0739193c805797891a694bc8
SimHash 2c9299ecab10

Groups

*

Rule Path
Disallow /pages/*
Disallow */register
Disallow /password/
Disallow /cdn-cgi/*
Disallow */developers/*
Disallow */developers
Disallow /account/*
Disallow */login
Disallow */public/*
Disallow /email/*

googlebot

Rule Path
Disallow /pages/*
Disallow */register
Disallow /password/
Disallow /cdn-cgi/*
Disallow */developers/*
Disallow */developers
Disallow /account/*
Disallow */login
Disallow */public/*
Disallow /email/*

yandex

Rule Path
Disallow /pages/*
Disallow */register
Disallow /password/
Disallow /cdn-cgi/*
Disallow */developers/*
Disallow */developers
Disallow /account/*
Disallow */login
Disallow */public/*
Disallow /email/*

Other Records

Field Value
sitemap https://xn----7sbqarcjpdbejzpq4n.xn--p1ai/sitemap.xml

Warnings

  • `clean-param` is not a known field.