samuelson.biz
robots.txt

Robots Exclusion Standard data for samuelson.biz

Resource Scan

Scan Details

Site Domain samuelson.biz
Base Domain samuelson.biz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-16T13:17:12+00:00
Next Scan 2026-02-14T13:17:12+00:00

Last Successful Scan

Scanned2023-01-06T16:10:29+00:00
URL http://samuelson.biz/robots.txt
Domain IPs 92.53.96.134
Response IP 92.53.96.134
Found Yes
Hash 2bb288d76f5dd830da4f71934513d9480a4bb703b6b6102abb134eb06b85dec4
SimHash 6b41b6c207c4

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /tag

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /tag

Other Records

Field Value
sitemap http://samuelson.biz /sitemap.xml.gz
sitemap http://samuelson.biz /sitemap.xml

Warnings

  • `host` is not a known field.