theworldnewsagency.online
robots.txt

Robots Exclusion Standard data for theworldnewsagency.online

Resource Scan

Scan Details

Site Domain theworldnewsagency.online
Base Domain theworldnewsagency.online
Scan Status Ok
Last Scan2024-11-16T02:35:38+00:00
Next Scan 2024-11-23T02:35:38+00:00

Last Scan

Scanned2024-11-16T02:35:38+00:00
URL https://theworldnewsagency.online/robots.txt
Redirect https://www.theworldnewsagency.online/robots.txt
Redirect Domain www.theworldnewsagency.online
Redirect Base theworldnewsagency.online
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 2404:6800:4003:c1a::79, 74.125.130.121
Response IP 74.125.200.121
Found Yes
Hash b9d20bf82c0d845fb5649ba171cb0e39a1100e3253dc3a38042dfaef1902145b
SimHash 64de2e96e456

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow
Allow /ads/preferences/
Allow /dtt/k
Allow /gpt/
Allow /pagead/show_ads.js
Allow /pagead/js/adsbygoogle.js
Allow /pagead/*/show_ads_impl.js
Allow /static/glade.js
Allow /static/glade/
Allow /tag/js/
Allow /collect
Allow /search-console/

googlebot

Rule Path
Allow /

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /private/
Allow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow
Allow /ads/preferences/
Allow /dtt/k
Allow /gpt/
Allow /pagead/show_ads.js
Allow /pagead/js/adsbygoogle.js
Allow /pagead/*/show_ads_impl.js
Allow /static/glade.js
Allow /static/glade/
Allow /tag/js/
Allow /collect
Allow /search-console/

googlebot

Rule Path
Allow /

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /private/
Allow /

Other Records

Field Value
sitemap https://wambuamwanza.blogspot.com/sitemap.xml
sitemap https://www.theworldnewsagency.online/sitemap.xml
sitemap https://wambuamwanza.blogspot.com/sitemap.xml
sitemap https://www.theworldnewsagency.online/sitemap.xml

Comments

  • Allow specific resources related to ads
  • Allow access to Google Analytics
  • Allow access to Google Search Console
  • Allow access to sitemap
  • Allow specific resources related to ads
  • Allow access to Google Analytics
  • Allow access to Google Search Console
  • Allow access to sitemap