Log In Sign Up

newsnow.co.uk
robots.txt

Robots Exclusion Standard data for newsnow.co.uk

Resource Scan

Scan Details

Site Domain newsnow.co.uk
Base Domain newsnow.co.uk
Scan Status Ok
Last Scan2024-05-01T16:59:08+00:00
Next Scan 2024-05-08T16:59:08+00:00

Last Scan

Scanned2024-05-01T16:59:08+00:00
URL https://newsnow.co.uk/robots.txt
Redirect https://www.newsnow.co.uk/robots.txt?utm_source=newsnow&utm_campaign=domains&utm_medium=web&utm_content=newsnow.co.uk
Redirect Domain www.newsnow.co.uk
Redirect Base newsnow.co.uk
Domain IPs 149.6.126.132, 213.146.191.132
Redirect IPs 149.6.126.132, 213.146.191.132
Response IP 213.146.191.132
Found Yes
Hash 08337adfe52c5852f7026ffa78a866568c30b89890c488fb172b046c16a1c883
SimHash e7846783e403

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /classifieds/

*

Rule Path
Disallow /h/*?p=
Disallow /h/*%26p%3D
Disallow /cgi-bin
Disallow /livefeed
Disallow /A
Disallow /share
Disallow /cgi/NGoto
Disallow /brand-new-look.html
Disallow /reg/*
Disallow /housead*
Disallow /http%3A*
Disallow /https%3A*
Allow /classifieds/*.js
Allow /classifieds/*.css
Allow /classifieds/*.jpg
Allow /classifieds/*?browse=
Disallow /classifieds/*itemindex*
Disallow /classifieds/SaveAd/
Disallow /classifieds/confirm-search/
Disallow /classifieds/get-filter-results/
Disallow /classifieds/get-top-box-results/
Disallow /classifieds/login-saved-searches/
Disallow /classifieds/manage-saved-searches/
Disallow /classifieds/recover-password/
Disallow /classifieds/register-saved-searches/
Disallow /classifieds/SavedSearch/
Disallow /classifieds/ss-logout/
Disallow /classifieds/Subscriptions/
Disallow /classifieds/update-frequency/
Disallow /classifieds/update-password/
Disallow /classifieds/Account/
Disallow /classifieds/SingleAdPage/
Disallow /classifieds/SingleAdPage/Home/
Disallow /classifieds/SingleAdPage/Product/
Disallow /classifieds/SingleAdPage/Similar/
Disallow /classifieds/*ajax.svc*
Disallow /classifieds/*_nif
Disallow /classifieds/admanagement/*
Disallow /classifieds/Controls/*
Disallow /classifieds/controls/*
Disallow /classifieds/data/*
Disallow /classifieds/external-login/
Disallow /classifieds/ExternalApi/
Disallow /classifieds/get-results/*
Disallow /classifieds/JsonProvider/Components
Disallow /classifieds/mobile/search/
Disallow /classifieds/Report/
Disallow /classifieds/Rss/
Disallow /classifieds/SitemapHandler/
Disallow /classifieds/PartnerIntegration/
Disallow /classifieds/XmlProvider/
Disallow /classifieds/api/
Disallow /classifieds/*.aspx
Disallow /classifieds/Reviews/
Disallow /classifieds/serp/
Disallow /ico/1.gif
Disallow /pharos.js*
Disallow /test-please-ignore/
Back to top

Comments

  • All robots all dirs
Back to top