чатгпт-в-россии.рф
robots.txt
Robots Exclusion Standard data for чатгпт-в-россии.рф
Resource Scan
Scan Details
Site Domain | чатгпт-в-россии.рф |
Base Domain | чатгпт-в-россии.рф |
Scan Status | Ok |
Last Scan | 2024-06-15T07:45:47+00:00 |
Next Scan | 2024-06-16T07:45:47+00:00 |
Last Scan
Scanned | 2024-06-15T07:45:47+00:00 |
URL | https://чатгпт-в-россии.рф/robots.txt |
Redirect | https://xn-----6kcjd7aa0cfnmaec4e.xn--p1ai/robots.txt |
Domain IPs | 104.21.28.98, 172.67.145.209, 2606:4700:3031::6815:1c62, 2606:4700:3033::ac43:91d1 |
Response IP | 172.67.145.209 |
Found | Yes |
Hash | 69f792d79ecb9c976e3a3bb2b6fca211efd3fe11a4ae8143a94e03952d4e9a8a |
SimHash | a5703bd28a40 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-json/* |
Disallow | /page* |
Disallow | /oembed* |
Disallow | /xmlrpc.php |
Disallow | *?s= |
Disallow | *%26s%3D |
Disallow | *?p=* |
Disallow | /search |
Disallow | */trackback |
Disallow | */feed |
Disallow | */rss |
Disallow | */embed |
Disallow | /xmlrpc.php |
Disallow | *utm%3D |
Disallow | *openstat%3D |
Other Records
Field | Value |
---|---|
crawl-delay | 35 |