gori.me
robots.txt

Robots Exclusion Standard data for gori.me

Resource Scan

Scan Details

Site Domain gori.me
Base Domain gori.me
Scan Status Ok
Last Scan2024-11-10T19:20:41+00:00
Next Scan 2024-11-17T19:20:41+00:00

Last Scan

Scanned2024-11-10T19:20:41+00:00
URL https://gori.me/robots.txt
Domain IPs 13.33.88.101, 13.33.88.50, 13.33.88.82, 13.33.88.90, 2600:9000:223b:200:18:b8e4:ce00:93a1, 2600:9000:223b:6400:18:b8e4:ce00:93a1, 2600:9000:223b:9600:18:b8e4:ce00:93a1, 2600:9000:223b:b200:18:b8e4:ce00:93a1, 2600:9000:223b:b600:18:b8e4:ce00:93a1, 2600:9000:223b:d000:18:b8e4:ce00:93a1, 2600:9000:223b:d600:18:b8e4:ce00:93a1, 2600:9000:223b:ee00:18:b8e4:ce00:93a1
Response IP 13.33.88.90
Found Yes
Hash e994877533263227234a40d1319593e305940b5d42c536b58700042f7920088f
SimHash ea264d10f2f5

Groups

*

Rule Path
Disallow /wp-content/
Disallow /trackback/
Disallow /wp-admin/
Disallow /feed/
Disallow /archives/
Disallow /index.php
Disallow /*?
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow */feed/
Disallow */trackback/
Disallow /page/
Disallow /tag/
Disallow /category/

googlebot

Rule Path
Allow /*.js$
Allow /*.css$

mediapartners-google*

Rule Path
Allow /*
Allow /ads/preferences/
Allow /gpt/
Allow /static/glade/

twitterbot

Rule Path
Disallow /wp-includes/
Allow /wp-content/uploads/

googlebot-image

Rule Path
Disallow /wp-includes/
Allow /wp-content/uploads/

Other Records

Field Value
sitemap http://gori.me/sitemap.xml

Comments

  • allow Googlebot to css/js
  • allow Google Ad bot on entire site
  • allow Twitter bot on entire site