rsvplive.ie
robots.txt

Robots Exclusion Standard data for rsvplive.ie

Resource Scan

Scan Details

Site Domain rsvplive.ie
Base Domain rsvplive.ie
Scan Status Ok
Last Scan2024-05-20T17:08:52+00:00
Next Scan 2024-05-27T17:08:52+00:00

Last Scan

Scanned2024-05-20T17:08:52+00:00
URL https://rsvplive.ie/robots.txt
Redirect https://www.rsvplive.ie/robots.txt
Redirect Domain www.rsvplive.ie
Redirect Base rsvplive.ie
Domain IPs 34.247.224.185, 54.229.47.82
Redirect IPs 108.138.246.107, 108.138.246.117, 108.138.246.122, 108.138.246.124
Response IP 18.165.171.89
Found Yes
Hash 9428d0ce02f378ead64e979861a4db1cbbfee287de0c4abf1487a9a9629f5033
SimHash c1bc8cf3a457

Groups

*

Rule Path
Disallow /topics/*
Disallow /topics
Disallow /*token%3D*
Disallow /search/
Disallow /comm-part-test/
Disallow /*service%3Dajax
Disallow /centenary-fund/
Disallow /3am/weird-celeb-news/xxx-1341448
Disallow /3am/weird-celeb-news/tamara-ecclestone-watched-boyfriends-sex-1341448
Disallow /comm-part-test/oh-like-beside-seaside-uk-1722203
Disallow /5293/
Disallow /*.ece
Disallow /news/irish-news/paedophile-jason-clancy-told-boy-7398312

Other Records

Field Value
crawl-delay 10.0

daumoa

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10.0

semetrical

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rsvplive.ie/map_news.xml
sitemap https://www.rsvplive.ie/sitemaps/sitemap_index.xml

Comments

  • Agent Specific Disallowed Sections