Log In Sign Up

gori.me
robots.txt

Robots Exclusion Standard data for gori.me

Resource Scan

Scan Details

Site Domain gori.me
Base Domain gori.me
Scan Status Ok
Last Scan2024-09-15T08:37:55+00:00
Next Scan 2024-09-22T08:37:55+00:00

Last Scan

Scanned2024-09-15T08:37:55+00:00
URL https://gori.me/robots.txt
Domain IPs 13.33.88.101, 13.33.88.50, 13.33.88.82, 13.33.88.90, 2600:9000:223b:3000:18:b8e4:ce00:93a1, 2600:9000:223b:4600:18:b8e4:ce00:93a1, 2600:9000:223b:6000:18:b8e4:ce00:93a1, 2600:9000:223b:6800:18:b8e4:ce00:93a1, 2600:9000:223b:7800:18:b8e4:ce00:93a1, 2600:9000:223b:ac00:18:b8e4:ce00:93a1, 2600:9000:223b:cc00:18:b8e4:ce00:93a1, 2600:9000:223b:ee00:18:b8e4:ce00:93a1
Response IP 13.33.88.90
Found Yes
Hash e994877533263227234a40d1319593e305940b5d42c536b58700042f7920088f
SimHash ea264d10f2f5

Groups

*

Rule Path
Disallow /wp-content/
Disallow /trackback/
Disallow /wp-admin/
Disallow /feed/
Disallow /archives/
Disallow /index.php
Disallow /*?
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow */feed/
Disallow */trackback/
Disallow /page/
Disallow /tag/
Disallow /category/

googlebot

Rule Path
Allow /*.js$
Allow /*.css$

mediapartners-google*

Rule Path
Allow /*
Allow /ads/preferences/
Allow /gpt/
Allow /static/glade/

twitterbot

Rule Path
Disallow /wp-includes/
Allow /wp-content/uploads/

googlebot-image

Rule Path
Disallow /wp-includes/
Allow /wp-content/uploads/
Back to top

Other Records

Field Value
sitemap http://gori.me/sitemap.xml
Back to top

Comments

  • allow Googlebot to css/js
  • allow Google Ad bot on entire site
  • allow Twitter bot on entire site
Back to top