Log In Sign Up

newsnow.org
robots.txt

Robots Exclusion Standard data for newsnow.org

Resource Scan

Scan Details

Site Domain newsnow.org
Base Domain newsnow.org
Scan Status Ok
Last Scan2024-05-10T13:35:52+00:00
Next Scan 2024-05-17T13:35:52+00:00

Last Scan

Scanned2024-05-10T13:35:52+00:00
URL http://newsnow.org/robots.txt
Redirect https://www.newsnow.com/robots.txt?utm_source=newsnow&utm_campaign=domains&utm_medium=web&utm_content=newsnow.org
Redirect Domain www.newsnow.com
Redirect Base newsnow.com
Domain IPs 213.146.191.132
Redirect IPs 149.6.126.132, 213.146.191.132
Response IP 149.6.126.132
Found Yes
Hash f972c44830f300f0481f9a62c263df997a85b669562fdbbdc1a8aac178b74c5a
SimHash e3842582e401

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /classifieds/

*

Rule Path
Disallow /us/*?p=
Disallow /us/*%26p%3D
Disallow /cgi-bin
Disallow /livefeed
Disallow /A
Disallow /share
Disallow /cgi/NGoto
Disallow /brand-new-look.html
Disallow /reg/*
Disallow /housead*
Disallow /http%3A*
Disallow /https%3A*
Allow /classifieds/*.js
Allow /classifieds/*.css
Allow /classifieds/*.jpg
Allow /classifieds/*?browse=
Disallow /classifieds/*itemindex*
Disallow /classifieds/SaveAd/
Disallow /classifieds/confirm-search/
Disallow /classifieds/get-filter-results/
Disallow /classifieds/get-top-box-results/
Disallow /classifieds/login-saved-searches/
Disallow /classifieds/manage-saved-searches/
Disallow /classifieds/recover-password/
Disallow /classifieds/register-saved-searches/
Disallow /classifieds/SavedSearch/
Disallow /classifieds/ss-logout/
Disallow /classifieds/Subscriptions/
Disallow /classifieds/update-frequency/
Disallow /classifieds/update-password/
Disallow /classifieds/Account/
Disallow /classifieds/SingleAdPage/
Disallow /classifieds/SingleAdPage/Home/
Disallow /classifieds/SingleAdPage/Product/
Disallow /classifieds/SingleAdPage/Similar/
Disallow /classifieds/*ajax.svc*
Disallow /classifieds/*_nif
Disallow /classifieds/admanagement/*
Disallow /classifieds/Controls/*
Disallow /classifieds/controls/*
Disallow /classifieds/data/*
Disallow /classifieds/external-login/
Disallow /classifieds/ExternalApi/
Disallow /classifieds/get-results/*
Disallow /classifieds/JsonProvider/Components
Disallow /classifieds/mobile/search/
Disallow /classifieds/Report/
Disallow /classifieds/Rss/
Disallow /classifieds/SitemapHandler/
Disallow /classifieds/PartnerIntegration/
Disallow /classifieds/XmlProvider/
Disallow /classifieds/api/
Disallow /classifieds/*.aspx
Disallow /classifieds/Reviews/
Disallow /classifieds/serp/
Disallow /ico/1.gif
Disallow /pharos.js*
Disallow /test-please-ignore/
Back to top

Comments

  • All robots all dirs
Back to top