remember70ties.com
robots.txt

Robots Exclusion Standard data for remember70ties.com

Resource Scan

Scan Details

Site Domain remember70ties.com
Base Domain remember70ties.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-17T21:31:54+00:00
Next Scan 2025-12-01T21:31:54+00:00

Last Successful Scan

Scanned2025-11-02T06:24:55+00:00
URL https://remember70ties.com/robots.txt
Redirect https://www.remember70ties.com/robots.txt
Redirect Domain www.remember70ties.com
Redirect Base remember70ties.com
Domain IPs 2a02:4780:15:a658:70ea:3b7c:2859:17f3, 2a02:4780:38:946d:9c5f:b23f:9ff3:63b1, 84.32.84.150, 84.32.84.68
Redirect IPs 2a02:4780:38:2669:1b0e:7cb8:7d27:ae7b, 2a02:4780:39:495c:7eed:4d11:c16a:cd75, 84.32.84.138, 84.32.84.80
Response IP 191.101.228.31
Found Yes
Hash c1081b507e6721dcddd133f18c63fb791c3659221975ba1ed8f56631b4490075
SimHash 6ba1da60c293

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /*.css$
Allow /*.js$
Allow /wp-content/uploads/
Disallow /?s=
Disallow */trackback/

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://remember70ties.com/sitemap_index.xml